Note: This is test shard 4 of 8.
[==========] Running 7 tests from 6 test suites.
[----------] Global test environment set-up.
[----------] 1 test from LocationAwareRebalancingBasicTest
[ RUN ] LocationAwareRebalancingBasicTest.Basic
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260807 13:50:10.321208 23982 ts_itest-base.cc:115] Starting cluster with:
I20260807 13:50:10.321444 23982 ts_itest-base.cc:116] --------------
I20260807 13:50:10.321535 23982 ts_itest-base.cc:117] 6 tablet servers
I20260807 13:50:10.321669 23982 ts_itest-base.cc:118] 3 replicas per TS
I20260807 13:50:10.321731 23982 ts_itest-base.cc:119] --------------
2026-08-07T13:50:10Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-07T13:50:10Z Disabled control of system clock
I20260807 13:50:10.352818 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.107.190:32953
--webserver_interface=127.23.107.190
--webserver_port=0
--builtin_ntp_servers=127.23.107.148:40545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.107.190:32953
--location_mapping_cmd=/tmp/dist-test-task2KnpY3/build/asan/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/location-assignment.state --map /A:2 --map /B:2 --map /C:2
--tserver_unresponsive_timeout_ms=3000
--enable_range_replica_placement=false
--raft_prepare_replacement_before_eviction=true
--enable_range_replica_placement=false with env {}
W20260807 13:50:10.701184 23997 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:10.701530 23997 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:50:10.701601 23997 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:50:10.709895 23997 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 13:50:10.710029 23997 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:50:10.710103 23997 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 13:50:10.710152 23997 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260807 13:50:10.720373 23997 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:40545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal
--enable_range_replica_placement=false
--location_mapping_cmd=/tmp/dist-test-task2KnpY3/build/asan/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/location-assignment.state --map /A:2 --map /B:2 --map /C:2
--ipki_ca_key_size=768
--master_addresses=127.23.107.190:32953
--tserver_unresponsive_timeout_ms=3000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.107.190:32953
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.23.107.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:50:10.722131 23997 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:50:10.723918 23997 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:50:10.732409 24005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:10.732442 24004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:10.733215 24007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:50:10.733632 23997 server_base.cc:1061] running on GCE node
I20260807 13:50:10.734411 23997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:50:10.735843 23997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:50:10.737080 23997 hybrid_clock.cc:648] HybridClock initialized: now 1786110610737036 us; error 122 us; skew 500 ppm
I20260807 13:50:10.737506 23997 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:50:10.739607 23997 webserver.cc:533] Webserver started at http://127.23.107.190:39333/ using document root <none> and password file <none>
I20260807 13:50:10.740357 23997 fs_manager.cc:362] Metadata directory not provided
I20260807 13:50:10.740494 23997 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:50:10.740855 23997 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:50:10.743319 23997 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "390327110c964252a3831f16b119c997"
format_stamp: "Formatted at 2026-08-07 13:50:10 on dist-test-slave-bw88"
I20260807 13:50:10.744143 23997 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "390327110c964252a3831f16b119c997"
format_stamp: "Formatted at 2026-08-07 13:50:10 on dist-test-slave-bw88"
I20260807 13:50:10.749656 23997 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260807 13:50:10.753168 24015 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:10.754633 23997 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 13:50:10.754832 23997 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal
uuid: "390327110c964252a3831f16b119c997"
format_stamp: "Formatted at 2026-08-07 13:50:10 on dist-test-slave-bw88"
I20260807 13:50:10.755071 23997 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:50:10.774417 23997 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:50:10.775359 23997 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:50:10.775662 23997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:50:10.796653 23997 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.190:32953
I20260807 13:50:10.796674 24092 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.190:32953 every 8 connection(s)
I20260807 13:50:10.798317 23997 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260807 13:50:10.802625 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 23997
I20260807 13:50:10.802774 24093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:10.802992 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260807 13:50:10.814318 24093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 390327110c964252a3831f16b119c997: Bootstrap starting.
I20260807 13:50:10.817520 24093 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 390327110c964252a3831f16b119c997: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:10.818735 24093 log.cc:826] T 00000000000000000000000000000000 P 390327110c964252a3831f16b119c997: Log is configured to *not* fsync() on all Append() calls
I20260807 13:50:10.821682 24093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 390327110c964252a3831f16b119c997: No bootstrap required, opened a new log
I20260807 13:50:10.827273 24093 raft_consensus.cc:359] T 00000000000000000000000000000000 P 390327110c964252a3831f16b119c997 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "390327110c964252a3831f16b119c997" member_type: VOTER last_known_addr { host: "127.23.107.190" port: 32953 } }
I20260807 13:50:10.827683 24093 raft_consensus.cc:385] T 00000000000000000000000000000000 P 390327110c964252a3831f16b119c997 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:10.827812 24093 raft_consensus.cc:740] T 00000000000000000000000000000000 P 390327110c964252a3831f16b119c997 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 390327110c964252a3831f16b119c997, State: Initialized, Role: FOLLOWER
I20260807 13:50:10.828512 24093 consensus_queue.cc:260] T 00000000000000000000000000000000 P 390327110c964252a3831f16b119c997 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "390327110c964252a3831f16b119c997" member_type: VOTER last_known_addr { host: "127.23.107.190" port: 32953 } }
I20260807 13:50:10.828765 24093 raft_consensus.cc:399] T 00000000000000000000000000000000 P 390327110c964252a3831f16b119c997 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 13:50:10.828922 24093 raft_consensus.cc:493] T 00000000000000000000000000000000 P 390327110c964252a3831f16b119c997 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 13:50:10.829126 24093 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 390327110c964252a3831f16b119c997 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:10.831657 24093 raft_consensus.cc:515] T 00000000000000000000000000000000 P 390327110c964252a3831f16b119c997 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "390327110c964252a3831f16b119c997" member_type: VOTER last_known_addr { host: "127.23.107.190" port: 32953 } }
I20260807 13:50:10.832145 24093 leader_election.cc:304] T 00000000000000000000000000000000 P 390327110c964252a3831f16b119c997 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 390327110c964252a3831f16b119c997; no voters:
I20260807 13:50:10.832759 24093 leader_election.cc:290] T 00000000000000000000000000000000 P 390327110c964252a3831f16b119c997 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 13:50:10.832929 24099 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 390327110c964252a3831f16b119c997 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:10.833653 24099 raft_consensus.cc:697] T 00000000000000000000000000000000 P 390327110c964252a3831f16b119c997 [term 1 LEADER]: Becoming Leader. State: Replica: 390327110c964252a3831f16b119c997, State: Running, Role: LEADER
I20260807 13:50:10.834208 24099 consensus_queue.cc:237] T 00000000000000000000000000000000 P 390327110c964252a3831f16b119c997 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "390327110c964252a3831f16b119c997" member_type: VOTER last_known_addr { host: "127.23.107.190" port: 32953 } }
I20260807 13:50:10.835009 24093 sys_catalog.cc:565] T 00000000000000000000000000000000 P 390327110c964252a3831f16b119c997 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 13:50:10.837518 24101 sys_catalog.cc:455] T 00000000000000000000000000000000 P 390327110c964252a3831f16b119c997 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 390327110c964252a3831f16b119c997. Latest consensus state: current_term: 1 leader_uuid: "390327110c964252a3831f16b119c997" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "390327110c964252a3831f16b119c997" member_type: VOTER last_known_addr { host: "127.23.107.190" port: 32953 } } }
I20260807 13:50:10.837852 24101 sys_catalog.cc:458] T 00000000000000000000000000000000 P 390327110c964252a3831f16b119c997 [sys.catalog]: This master's current role is: LEADER
I20260807 13:50:10.838225 24100 sys_catalog.cc:455] T 00000000000000000000000000000000 P 390327110c964252a3831f16b119c997 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "390327110c964252a3831f16b119c997" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "390327110c964252a3831f16b119c997" member_type: VOTER last_known_addr { host: "127.23.107.190" port: 32953 } } }
I20260807 13:50:10.838627 24100 sys_catalog.cc:458] T 00000000000000000000000000000000 P 390327110c964252a3831f16b119c997 [sys.catalog]: This master's current role is: LEADER
I20260807 13:50:10.842480 24112 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260807 13:50:10.848694 24112 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260807 13:50:10.857684 24112 catalog_manager.cc:1383] Generated new cluster ID: 16b8bf70d9874ea0b098161eda5ef885
I20260807 13:50:10.857815 24112 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260807 13:50:10.875250 24112 catalog_manager.cc:1406] Generated new certificate authority record
I20260807 13:50:10.876457 24112 catalog_manager.cc:1540] Loading token signing keys...
I20260807 13:50:10.886118 24112 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 390327110c964252a3831f16b119c997: Generated new TSK 0
I20260807 13:50:10.887020 24112 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260807 13:50:10.902436 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.129:0
--local_ip_for_outbound_sockets=127.23.107.129
--webserver_interface=127.23.107.129
--webserver_port=0
--tserver_master_addrs=127.23.107.190:32953
--builtin_ntp_servers=127.23.107.148:40545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20260807 13:50:11.355187 24127 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:11.355479 24127 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:50:11.355562 24127 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:50:11.364300 24127 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:50:11.364543 24127 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.129
I20260807 13:50:11.375687 24127 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:40545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.23.107.129
--webserver_port=0
--tserver_master_addrs=127.23.107.190:32953
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.129
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:50:11.377547 24127 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:50:11.379465 24127 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:50:11.390257 24136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:11.390226 24135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:11.391065 24139 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:50:11.392470 24127 server_base.cc:1061] running on GCE node
I20260807 13:50:11.393031 24127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:50:11.394032 24127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:50:11.395272 24127 hybrid_clock.cc:648] HybridClock initialized: now 1786110611395198 us; error 67 us; skew 500 ppm
I20260807 13:50:11.395599 24127 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:50:11.397882 24127 webserver.cc:533] Webserver started at http://127.23.107.129:37447/ using document root <none> and password file <none>
I20260807 13:50:11.398757 24127 fs_manager.cc:362] Metadata directory not provided
I20260807 13:50:11.398896 24127 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:50:11.399299 24127 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:50:11.401888 24127 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4"
format_stamp: "Formatted at 2026-08-07 13:50:11 on dist-test-slave-bw88"
I20260807 13:50:11.402714 24127 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4"
format_stamp: "Formatted at 2026-08-07 13:50:11 on dist-test-slave-bw88"
I20260807 13:50:11.408694 24127 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 13:50:11.412660 24148 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:11.414346 24127 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260807 13:50:11.414551 24127 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4"
format_stamp: "Formatted at 2026-08-07 13:50:11 on dist-test-slave-bw88"
I20260807 13:50:11.414785 24127 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:50:11.452543 24127 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:50:11.453589 24127 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:50:11.453890 24127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:50:11.454919 24127 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:50:11.456738 24127 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:50:11.456867 24127 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:11.457018 24127 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:50:11.457110 24127 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:11.494324 24127 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.129:39973
I20260807 13:50:11.494416 24304 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.129:39973 every 8 connection(s)
I20260807 13:50:11.495925 24127 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260807 13:50:11.500602 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 24127
I20260807 13:50:11.500813 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260807 13:50:11.504668 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.130:0
--local_ip_for_outbound_sockets=127.23.107.130
--webserver_interface=127.23.107.130
--webserver_port=0
--tserver_master_addrs=127.23.107.190:32953
--builtin_ntp_servers=127.23.107.148:40545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20260807 13:50:11.510495 24305 heartbeater.cc:344] Connected to a master server at 127.23.107.190:32953
I20260807 13:50:11.510946 24305 heartbeater.cc:461] Registering TS with master...
I20260807 13:50:11.512054 24305 heartbeater.cc:507] Master 127.23.107.190:32953 requested a full tablet report, sending...
I20260807 13:50:11.583201 24041 ts_manager.cc:194] Registered new tserver with Master: 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973)
I20260807 13:50:11.585141 24041 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.129:52281
W20260807 13:50:11.866958 24310 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:11.867323 24310 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:50:11.867466 24310 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:50:11.876061 24310 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:50:11.876292 24310 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.130
I20260807 13:50:11.886487 24310 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:40545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.23.107.130
--webserver_port=0
--tserver_master_addrs=127.23.107.190:32953
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.130
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:50:11.888207 24310 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:50:11.890129 24310 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:50:11.899966 24320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:11.900000 24319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:11.900398 24327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:50:11.901392 24310 server_base.cc:1061] running on GCE node
I20260807 13:50:11.902014 24310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:50:11.902918 24310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:50:11.904134 24310 hybrid_clock.cc:648] HybridClock initialized: now 1786110611904087 us; error 31 us; skew 500 ppm
I20260807 13:50:11.904445 24310 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:50:11.906632 24310 webserver.cc:533] Webserver started at http://127.23.107.130:37539/ using document root <none> and password file <none>
I20260807 13:50:11.907398 24310 fs_manager.cc:362] Metadata directory not provided
I20260807 13:50:11.907536 24310 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:50:11.907941 24310 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:50:11.910558 24310 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "fe8f3cec39fb4964a4fccfd5baa4077b"
format_stamp: "Formatted at 2026-08-07 13:50:11 on dist-test-slave-bw88"
I20260807 13:50:11.911367 24310 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "fe8f3cec39fb4964a4fccfd5baa4077b"
format_stamp: "Formatted at 2026-08-07 13:50:11 on dist-test-slave-bw88"
I20260807 13:50:11.916738 24310 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260807 13:50:11.920418 24338 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:11.921897 24310 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 13:50:11.922079 24310 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "fe8f3cec39fb4964a4fccfd5baa4077b"
format_stamp: "Formatted at 2026-08-07 13:50:11 on dist-test-slave-bw88"
I20260807 13:50:11.922299 24310 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:50:11.939991 24310 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:50:11.940886 24310 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:50:11.941200 24310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:50:11.942202 24310 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:50:11.944063 24310 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:50:11.944162 24310 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:11.944320 24310 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:50:11.944417 24310 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:11.980019 24310 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.130:35619
I20260807 13:50:11.980111 24486 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.130:35619 every 8 connection(s)
I20260807 13:50:11.981717 24310 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260807 13:50:11.985972 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 24310
I20260807 13:50:11.986239 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260807 13:50:11.990458 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.131:0
--local_ip_for_outbound_sockets=127.23.107.131
--webserver_interface=127.23.107.131
--webserver_port=0
--tserver_master_addrs=127.23.107.190:32953
--builtin_ntp_servers=127.23.107.148:40545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20260807 13:50:11.997398 24487 heartbeater.cc:344] Connected to a master server at 127.23.107.190:32953
I20260807 13:50:11.997788 24487 heartbeater.cc:461] Registering TS with master...
I20260807 13:50:11.998731 24487 heartbeater.cc:507] Master 127.23.107.190:32953 requested a full tablet report, sending...
I20260807 13:50:12.063339 24041 ts_manager.cc:194] Registered new tserver with Master: fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619)
I20260807 13:50:12.064677 24041 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.130:59105
W20260807 13:50:12.351444 24490 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:12.351752 24490 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:50:12.351827 24490 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:50:12.360025 24490 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:50:12.360203 24490 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.131
I20260807 13:50:12.370191 24490 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:40545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.23.107.131
--webserver_port=0
--tserver_master_addrs=127.23.107.190:32953
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.131
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:50:12.371879 24490 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:50:12.373778 24490 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:50:12.383576 24496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:12.383574 24498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:12.384377 24500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:50:12.385222 24490 server_base.cc:1061] running on GCE node
I20260807 13:50:12.385867 24490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:50:12.386755 24490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:50:12.387956 24490 hybrid_clock.cc:648] HybridClock initialized: now 1786110612387918 us; error 30 us; skew 500 ppm
I20260807 13:50:12.388239 24490 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:50:12.390677 24490 webserver.cc:533] Webserver started at http://127.23.107.131:43977/ using document root <none> and password file <none>
I20260807 13:50:12.391403 24490 fs_manager.cc:362] Metadata directory not provided
I20260807 13:50:12.391496 24490 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:50:12.391831 24490 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:50:12.394261 24490 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "c8d4866795004103a4b0243906fe4d60"
format_stamp: "Formatted at 2026-08-07 13:50:12 on dist-test-slave-bw88"
I20260807 13:50:12.394989 24490 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "c8d4866795004103a4b0243906fe4d60"
format_stamp: "Formatted at 2026-08-07 13:50:12 on dist-test-slave-bw88"
I20260807 13:50:12.400344 24490 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 13:50:12.403949 24508 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:12.405401 24490 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 13:50:12.405586 24490 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "c8d4866795004103a4b0243906fe4d60"
format_stamp: "Formatted at 2026-08-07 13:50:12 on dist-test-slave-bw88"
I20260807 13:50:12.405830 24490 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:50:12.424680 24490 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:50:12.425655 24490 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:50:12.425938 24490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:50:12.426967 24490 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:50:12.428727 24490 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:50:12.428864 24490 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:12.428983 24490 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:50:12.429070 24490 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:12.465559 24490 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.131:46641
I20260807 13:50:12.465647 24664 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.131:46641 every 8 connection(s)
I20260807 13:50:12.467129 24490 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260807 13:50:12.472409 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 24490
I20260807 13:50:12.472594 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260807 13:50:12.475925 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.132:0
--local_ip_for_outbound_sockets=127.23.107.132
--webserver_interface=127.23.107.132
--webserver_port=0
--tserver_master_addrs=127.23.107.190:32953
--builtin_ntp_servers=127.23.107.148:40545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20260807 13:50:12.485456 24665 heartbeater.cc:344] Connected to a master server at 127.23.107.190:32953
I20260807 13:50:12.485839 24665 heartbeater.cc:461] Registering TS with master...
I20260807 13:50:12.486708 24665 heartbeater.cc:507] Master 127.23.107.190:32953 requested a full tablet report, sending...
I20260807 13:50:12.549569 24041 ts_manager.cc:194] Registered new tserver with Master: c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641)
I20260807 13:50:12.550556 24041 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.131:39811
I20260807 13:50:12.589651 24305 heartbeater.cc:499] Master 127.23.107.190:32953 was elected leader, sending a full tablet report...
W20260807 13:50:12.833846 24669 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:12.834183 24669 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:50:12.834327 24669 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:50:12.842804 24669 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:50:12.843009 24669 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.132
I20260807 13:50:12.852847 24669 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:40545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.23.107.132
--webserver_port=0
--tserver_master_addrs=127.23.107.190:32953
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.132
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:50:12.854624 24669 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:50:12.856575 24669 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:50:12.866750 24678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:12.866652 24675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:12.866696 24676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:50:12.868227 24669 server_base.cc:1061] running on GCE node
I20260807 13:50:12.868818 24669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:50:12.869846 24669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:50:12.871084 24669 hybrid_clock.cc:648] HybridClock initialized: now 1786110612871017 us; error 72 us; skew 500 ppm
I20260807 13:50:12.871404 24669 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:50:12.873646 24669 webserver.cc:533] Webserver started at http://127.23.107.132:42913/ using document root <none> and password file <none>
I20260807 13:50:12.874413 24669 fs_manager.cc:362] Metadata directory not provided
I20260807 13:50:12.874564 24669 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:50:12.874944 24669 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:50:12.877471 24669 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "b890fcdb46dc4597bd9991906433c391"
format_stamp: "Formatted at 2026-08-07 13:50:12 on dist-test-slave-bw88"
I20260807 13:50:12.878324 24669 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "b890fcdb46dc4597bd9991906433c391"
format_stamp: "Formatted at 2026-08-07 13:50:12 on dist-test-slave-bw88"
I20260807 13:50:12.883754 24669 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 13:50:12.887301 24687 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:12.888667 24669 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 13:50:12.888870 24669 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "b890fcdb46dc4597bd9991906433c391"
format_stamp: "Formatted at 2026-08-07 13:50:12 on dist-test-slave-bw88"
I20260807 13:50:12.889106 24669 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:50:12.919277 24669 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:50:12.920321 24669 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:50:12.920632 24669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:50:12.921728 24669 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:50:12.923454 24669 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:50:12.923573 24669 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:12.923707 24669 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:50:12.923812 24669 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:12.960187 24669 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.132:44189
I20260807 13:50:12.960199 24837 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.132:44189 every 8 connection(s)
I20260807 13:50:12.961823 24669 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20260807 13:50:12.967999 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 24669
I20260807 13:50:12.968230 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20260807 13:50:12.972098 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.133:0
--local_ip_for_outbound_sockets=127.23.107.133
--webserver_interface=127.23.107.133
--webserver_port=0
--tserver_master_addrs=127.23.107.190:32953
--builtin_ntp_servers=127.23.107.148:40545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20260807 13:50:12.977404 24838 heartbeater.cc:344] Connected to a master server at 127.23.107.190:32953
I20260807 13:50:12.977856 24838 heartbeater.cc:461] Registering TS with master...
I20260807 13:50:12.979012 24838 heartbeater.cc:507] Master 127.23.107.190:32953 requested a full tablet report, sending...
I20260807 13:50:13.043782 24041 ts_manager.cc:194] Registered new tserver with Master: b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189)
I20260807 13:50:13.045138 24041 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.132:48007
I20260807 13:50:13.067855 24487 heartbeater.cc:499] Master 127.23.107.190:32953 was elected leader, sending a full tablet report...
W20260807 13:50:13.340885 24841 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:13.341215 24841 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:50:13.341310 24841 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:50:13.350013 24841 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:50:13.350168 24841 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.133
I20260807 13:50:13.360234 24841 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:40545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.133:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.23.107.133
--webserver_port=0
--tserver_master_addrs=127.23.107.190:32953
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.133
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:50:13.362067 24841 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:50:13.364037 24841 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:50:13.374405 24848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:13.374370 24849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:13.376013 24851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:50:13.376240 24841 server_base.cc:1061] running on GCE node
I20260807 13:50:13.376904 24841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:50:13.377980 24841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:50:13.379264 24841 hybrid_clock.cc:648] HybridClock initialized: now 1786110613379209 us; error 40 us; skew 500 ppm
I20260807 13:50:13.379635 24841 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:50:13.381955 24841 webserver.cc:533] Webserver started at http://127.23.107.133:40365/ using document root <none> and password file <none>
I20260807 13:50:13.382736 24841 fs_manager.cc:362] Metadata directory not provided
I20260807 13:50:13.382876 24841 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:50:13.383265 24841 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:50:13.385764 24841 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/instance:
uuid: "d6d3ef3a235844cbbce1370e3aeb809f"
format_stamp: "Formatted at 2026-08-07 13:50:13 on dist-test-slave-bw88"
I20260807 13:50:13.386610 24841 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal/instance:
uuid: "d6d3ef3a235844cbbce1370e3aeb809f"
format_stamp: "Formatted at 2026-08-07 13:50:13 on dist-test-slave-bw88"
I20260807 13:50:13.392050 24841 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 13:50:13.395699 24858 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:13.397292 24841 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 13:50:13.397550 24841 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "d6d3ef3a235844cbbce1370e3aeb809f"
format_stamp: "Formatted at 2026-08-07 13:50:13 on dist-test-slave-bw88"
I20260807 13:50:13.397792 24841 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:50:13.416121 24841 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:50:13.417092 24841 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:50:13.417508 24841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:50:13.418531 24841 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:50:13.420444 24841 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:50:13.420568 24841 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:13.420711 24841 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:50:13.420815 24841 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:13.457525 24841 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.133:40131
I20260807 13:50:13.457574 25016 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.133:40131 every 8 connection(s)
I20260807 13:50:13.459153 24841 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20260807 13:50:13.467866 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 24841
I20260807 13:50:13.468051 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal/instance
I20260807 13:50:13.472292 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.134:0
--local_ip_for_outbound_sockets=127.23.107.134
--webserver_interface=127.23.107.134
--webserver_port=0
--tserver_master_addrs=127.23.107.190:32953
--builtin_ntp_servers=127.23.107.148:40545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20260807 13:50:13.473824 25017 heartbeater.cc:344] Connected to a master server at 127.23.107.190:32953
I20260807 13:50:13.474206 25017 heartbeater.cc:461] Registering TS with master...
I20260807 13:50:13.475066 25017 heartbeater.cc:507] Master 127.23.107.190:32953 requested a full tablet report, sending...
I20260807 13:50:13.537271 24041 ts_manager.cc:194] Registered new tserver with Master: d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131)
I20260807 13:50:13.538362 24041 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.133:58943
I20260807 13:50:13.553573 24665 heartbeater.cc:499] Master 127.23.107.190:32953 was elected leader, sending a full tablet report...
W20260807 13:50:13.828421 25020 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:13.828744 25020 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:50:13.828826 25020 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:50:13.837040 25020 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:50:13.837196 25020 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.134
I20260807 13:50:13.847175 25020 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:40545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.134:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--webserver_interface=127.23.107.134
--webserver_port=0
--tserver_master_addrs=127.23.107.190:32953
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.134
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:50:13.848815 25020 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:50:13.850855 25020 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:50:13.860687 25031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:13.860808 25030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:13.861301 25035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:50:13.862139 25020 server_base.cc:1061] running on GCE node
I20260807 13:50:13.862707 25020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:50:13.863677 25020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:50:13.864907 25020 hybrid_clock.cc:648] HybridClock initialized: now 1786110613864865 us; error 54 us; skew 500 ppm
I20260807 13:50:13.865223 25020 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:50:13.867560 25020 webserver.cc:533] Webserver started at http://127.23.107.134:36455/ using document root <none> and password file <none>
I20260807 13:50:13.868321 25020 fs_manager.cc:362] Metadata directory not provided
I20260807 13:50:13.868459 25020 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:50:13.868860 25020 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:50:13.871601 25020 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/instance:
uuid: "d1d858e0ace34c39a641ede1db85be11"
format_stamp: "Formatted at 2026-08-07 13:50:13 on dist-test-slave-bw88"
I20260807 13:50:13.872411 25020 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal/instance:
uuid: "d1d858e0ace34c39a641ede1db85be11"
format_stamp: "Formatted at 2026-08-07 13:50:13 on dist-test-slave-bw88"
I20260807 13:50:13.878197 25020 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 13:50:13.881918 25046 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:13.883359 25020 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 13:50:13.883574 25020 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal
uuid: "d1d858e0ace34c39a641ede1db85be11"
format_stamp: "Formatted at 2026-08-07 13:50:13 on dist-test-slave-bw88"
I20260807 13:50:13.883801 25020 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:50:13.904449 25020 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:50:13.905406 25020 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:50:13.905701 25020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:50:13.906813 25020 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:50:13.908588 25020 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:50:13.908721 25020 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:13.908846 25020 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:50:13.908939 25020 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:13.947444 25020 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.134:46341
I20260807 13:50:13.947506 25196 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.134:46341 every 8 connection(s)
I20260807 13:50:13.948920 25020 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/info.pb
I20260807 13:50:13.957763 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 25020
I20260807 13:50:13.958001 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal/instance
I20260807 13:50:13.964082 25197 heartbeater.cc:344] Connected to a master server at 127.23.107.190:32953
I20260807 13:50:13.964509 25197 heartbeater.cc:461] Registering TS with master...
I20260807 13:50:13.965644 25197 heartbeater.cc:507] Master 127.23.107.190:32953 requested a full tablet report, sending...
I20260807 13:50:14.029922 24041 ts_manager.cc:194] Registered new tserver with Master: d1d858e0ace34c39a641ede1db85be11 (127.23.107.134:46341)
I20260807 13:50:14.030956 24041 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.134:56363
I20260807 13:50:14.036966 23982 external_mini_cluster.cc:955] 6 TS(s) registered with all masters
I20260807 13:50:14.048316 24838 heartbeater.cc:499] Master 127.23.107.190:32953 was elected leader, sending a full tablet report...
I20260807 13:50:14.060153 23982 external_mini_cluster.cc:955] 6 TS(s) registered with all masters
I20260807 13:50:14.541548 25017 heartbeater.cc:499] Master 127.23.107.190:32953 was elected leader, sending a full tablet report...
I20260807 13:50:15.034526 25197 heartbeater.cc:499] Master 127.23.107.190:32953 was elected leader, sending a full tablet report...
I20260807 13:50:17.814690 24041 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43984:
name: "rebalance_test_table_0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:50:17.867480 24210 tablet_service.cc:1511] Processing CreateTablet for tablet 51b7e3d8d45545739a2bf1b23b3e2c3f (DEFAULT_TABLE table=rebalance_test_table_0 [id=0655842fb9cd410cba7a4bb48fedf3a2]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:17.874974 24572 tablet_service.cc:1511] Processing CreateTablet for tablet 51b7e3d8d45545739a2bf1b23b3e2c3f (DEFAULT_TABLE table=rebalance_test_table_0 [id=0655842fb9cd410cba7a4bb48fedf3a2]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:17.875458 24926 tablet_service.cc:1511] Processing CreateTablet for tablet 51b7e3d8d45545739a2bf1b23b3e2c3f (DEFAULT_TABLE table=rebalance_test_table_0 [id=0655842fb9cd410cba7a4bb48fedf3a2]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:17.875116 24927 tablet_service.cc:1511] Processing CreateTablet for tablet 60e313c07c85407fabb232ac871b2f16 (DEFAULT_TABLE table=rebalance_test_table_0 [id=0655842fb9cd410cba7a4bb48fedf3a2]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:17.876768 24926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51b7e3d8d45545739a2bf1b23b3e2c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:17.876770 24572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51b7e3d8d45545739a2bf1b23b3e2c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:17.877254 24927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60e313c07c85407fabb232ac871b2f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:17.880735 24210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51b7e3d8d45545739a2bf1b23b3e2c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:17.869791 24211 tablet_service.cc:1511] Processing CreateTablet for tablet 60e313c07c85407fabb232ac871b2f16 (DEFAULT_TABLE table=rebalance_test_table_0 [id=0655842fb9cd410cba7a4bb48fedf3a2]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:17.880924 25107 tablet_service.cc:1511] Processing CreateTablet for tablet 580c303c25314c439540b482893ec2f2 (DEFAULT_TABLE table=rebalance_test_table_0 [id=0655842fb9cd410cba7a4bb48fedf3a2]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:17.882112 24211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60e313c07c85407fabb232ac871b2f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:17.882609 25107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580c303c25314c439540b482893ec2f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:17.881292 24751 tablet_service.cc:1511] Processing CreateTablet for tablet 580c303c25314c439540b482893ec2f2 (DEFAULT_TABLE table=rebalance_test_table_0 [id=0655842fb9cd410cba7a4bb48fedf3a2]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:17.886160 24573 tablet_service.cc:1511] Processing CreateTablet for tablet 60e313c07c85407fabb232ac871b2f16 (DEFAULT_TABLE table=rebalance_test_table_0 [id=0655842fb9cd410cba7a4bb48fedf3a2]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:17.887356 24751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580c303c25314c439540b482893ec2f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:17.887873 24573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60e313c07c85407fabb232ac871b2f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:17.902426 24396 tablet_service.cc:1511] Processing CreateTablet for tablet 580c303c25314c439540b482893ec2f2 (DEFAULT_TABLE table=rebalance_test_table_0 [id=0655842fb9cd410cba7a4bb48fedf3a2]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:17.905283 24396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580c303c25314c439540b482893ec2f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:17.930722 25234 tablet_bootstrap.cc:492] T 51b7e3d8d45545739a2bf1b23b3e2c3f P d6d3ef3a235844cbbce1370e3aeb809f: Bootstrap starting.
I20260807 13:50:17.944080 25236 tablet_bootstrap.cc:492] T 580c303c25314c439540b482893ec2f2 P fe8f3cec39fb4964a4fccfd5baa4077b: Bootstrap starting.
I20260807 13:50:17.945834 25231 tablet_bootstrap.cc:492] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Bootstrap starting.
I20260807 13:50:17.946604 25232 tablet_bootstrap.cc:492] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11: Bootstrap starting.
I20260807 13:50:17.950109 25236 tablet_bootstrap.cc:654] T 580c303c25314c439540b482893ec2f2 P fe8f3cec39fb4964a4fccfd5baa4077b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:17.950116 25231 tablet_bootstrap.cc:654] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:17.950707 25232 tablet_bootstrap.cc:654] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:17.951606 25231 log.cc:826] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Log is configured to *not* fsync() on all Append() calls
I20260807 13:50:17.951617 25236 log.cc:826] T 580c303c25314c439540b482893ec2f2 P fe8f3cec39fb4964a4fccfd5baa4077b: Log is configured to *not* fsync() on all Append() calls
I20260807 13:50:17.952066 25234 tablet_bootstrap.cc:654] T 51b7e3d8d45545739a2bf1b23b3e2c3f P d6d3ef3a235844cbbce1370e3aeb809f: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:17.952466 25232 log.cc:826] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11: Log is configured to *not* fsync() on all Append() calls
I20260807 13:50:17.953042 25237 tablet_bootstrap.cc:492] T 60e313c07c85407fabb232ac871b2f16 P c8d4866795004103a4b0243906fe4d60: Bootstrap starting.
I20260807 13:50:17.956844 25237 tablet_bootstrap.cc:654] T 60e313c07c85407fabb232ac871b2f16 P c8d4866795004103a4b0243906fe4d60: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:17.958611 25234 log.cc:826] T 51b7e3d8d45545739a2bf1b23b3e2c3f P d6d3ef3a235844cbbce1370e3aeb809f: Log is configured to *not* fsync() on all Append() calls
I20260807 13:50:17.960763 25237 log.cc:826] T 60e313c07c85407fabb232ac871b2f16 P c8d4866795004103a4b0243906fe4d60: Log is configured to *not* fsync() on all Append() calls
I20260807 13:50:17.961796 25241 tablet_bootstrap.cc:492] T 580c303c25314c439540b482893ec2f2 P b890fcdb46dc4597bd9991906433c391: Bootstrap starting.
I20260807 13:50:17.967681 25232 tablet_bootstrap.cc:492] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11: No bootstrap required, opened a new log
I20260807 13:50:17.967994 25232 ts_tablet_manager.cc:1403] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11: Time spent bootstrapping tablet: real 0.023s user 0.010s sys 0.005s
I20260807 13:50:17.970474 25241 tablet_bootstrap.cc:654] T 580c303c25314c439540b482893ec2f2 P b890fcdb46dc4597bd9991906433c391: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:17.971148 25231 tablet_bootstrap.cc:492] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4: No bootstrap required, opened a new log
I20260807 13:50:17.971465 25231 ts_tablet_manager.cc:1403] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent bootstrapping tablet: real 0.026s user 0.007s sys 0.006s
I20260807 13:50:17.972229 25241 log.cc:826] T 580c303c25314c439540b482893ec2f2 P b890fcdb46dc4597bd9991906433c391: Log is configured to *not* fsync() on all Append() calls
I20260807 13:50:17.974866 25236 tablet_bootstrap.cc:492] T 580c303c25314c439540b482893ec2f2 P fe8f3cec39fb4964a4fccfd5baa4077b: No bootstrap required, opened a new log
I20260807 13:50:17.974865 25237 tablet_bootstrap.cc:492] T 60e313c07c85407fabb232ac871b2f16 P c8d4866795004103a4b0243906fe4d60: No bootstrap required, opened a new log
I20260807 13:50:17.975198 25236 ts_tablet_manager.cc:1403] T 580c303c25314c439540b482893ec2f2 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent bootstrapping tablet: real 0.032s user 0.011s sys 0.000s
I20260807 13:50:17.975198 25237 ts_tablet_manager.cc:1403] T 60e313c07c85407fabb232ac871b2f16 P c8d4866795004103a4b0243906fe4d60: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.000s
I20260807 13:50:17.981066 25231 raft_consensus.cc:359] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:17.981752 25231 raft_consensus.cc:385] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:17.981927 25231 raft_consensus.cc:740] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Initialized, Role: FOLLOWER
I20260807 13:50:17.981998 25241 tablet_bootstrap.cc:492] T 580c303c25314c439540b482893ec2f2 P b890fcdb46dc4597bd9991906433c391: No bootstrap required, opened a new log
I20260807 13:50:17.982318 25241 ts_tablet_manager.cc:1403] T 580c303c25314c439540b482893ec2f2 P b890fcdb46dc4597bd9991906433c391: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.008s
I20260807 13:50:17.984222 25234 tablet_bootstrap.cc:492] T 51b7e3d8d45545739a2bf1b23b3e2c3f P d6d3ef3a235844cbbce1370e3aeb809f: No bootstrap required, opened a new log
I20260807 13:50:17.984529 25234 ts_tablet_manager.cc:1403] T 51b7e3d8d45545739a2bf1b23b3e2c3f P d6d3ef3a235844cbbce1370e3aeb809f: Time spent bootstrapping tablet: real 0.054s user 0.013s sys 0.000s
I20260807 13:50:17.986332 25237 raft_consensus.cc:359] T 60e313c07c85407fabb232ac871b2f16 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:17.986761 25237 raft_consensus.cc:385] T 60e313c07c85407fabb232ac871b2f16 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:17.986860 25237 raft_consensus.cc:740] T 60e313c07c85407fabb232ac871b2f16 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8d4866795004103a4b0243906fe4d60, State: Initialized, Role: FOLLOWER
I20260807 13:50:17.987660 25237 consensus_queue.cc:260] T 60e313c07c85407fabb232ac871b2f16 P c8d4866795004103a4b0243906fe4d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:17.990331 25241 raft_consensus.cc:359] T 580c303c25314c439540b482893ec2f2 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:17.990885 25241 raft_consensus.cc:385] T 580c303c25314c439540b482893ec2f2 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:17.991040 25241 raft_consensus.cc:740] T 580c303c25314c439540b482893ec2f2 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b890fcdb46dc4597bd9991906433c391, State: Initialized, Role: FOLLOWER
I20260807 13:50:17.991915 25241 consensus_queue.cc:260] T 580c303c25314c439540b482893ec2f2 P b890fcdb46dc4597bd9991906433c391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:17.992805 25234 raft_consensus.cc:359] T 51b7e3d8d45545739a2bf1b23b3e2c3f P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:17.994136 25231 consensus_queue.cc:260] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:17.994979 25234 raft_consensus.cc:385] T 51b7e3d8d45545739a2bf1b23b3e2c3f P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:17.995189 25234 raft_consensus.cc:740] T 51b7e3d8d45545739a2bf1b23b3e2c3f P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d3ef3a235844cbbce1370e3aeb809f, State: Initialized, Role: FOLLOWER
I20260807 13:50:17.996119 25234 consensus_queue.cc:260] T 51b7e3d8d45545739a2bf1b23b3e2c3f P d6d3ef3a235844cbbce1370e3aeb809f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:17.996249 25236 raft_consensus.cc:359] T 580c303c25314c439540b482893ec2f2 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:17.998597 25241 ts_tablet_manager.cc:1434] T 580c303c25314c439540b482893ec2f2 P b890fcdb46dc4597bd9991906433c391: Time spent starting tablet: real 0.016s user 0.010s sys 0.003s
I20260807 13:50:17.998602 25237 ts_tablet_manager.cc:1434] T 60e313c07c85407fabb232ac871b2f16 P c8d4866795004103a4b0243906fe4d60: Time spent starting tablet: real 0.023s user 0.014s sys 0.005s
I20260807 13:50:17.999167 25237 tablet_bootstrap.cc:492] T 51b7e3d8d45545739a2bf1b23b3e2c3f P c8d4866795004103a4b0243906fe4d60: Bootstrap starting.
I20260807 13:50:18.000296 25234 ts_tablet_manager.cc:1434] T 51b7e3d8d45545739a2bf1b23b3e2c3f P d6d3ef3a235844cbbce1370e3aeb809f: Time spent starting tablet: real 0.016s user 0.010s sys 0.001s
I20260807 13:50:18.000787 25234 tablet_bootstrap.cc:492] T 60e313c07c85407fabb232ac871b2f16 P d6d3ef3a235844cbbce1370e3aeb809f: Bootstrap starting.
I20260807 13:50:18.001868 25237 tablet_bootstrap.cc:654] T 51b7e3d8d45545739a2bf1b23b3e2c3f P c8d4866795004103a4b0243906fe4d60: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:18.004122 25234 tablet_bootstrap.cc:654] T 60e313c07c85407fabb232ac871b2f16 P d6d3ef3a235844cbbce1370e3aeb809f: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:18.006775 25231 ts_tablet_manager.cc:1434] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent starting tablet: real 0.035s user 0.016s sys 0.000s
I20260807 13:50:18.007460 25231 tablet_bootstrap.cc:492] T 60e313c07c85407fabb232ac871b2f16 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Bootstrap starting.
I20260807 13:50:18.017654 25236 raft_consensus.cc:385] T 580c303c25314c439540b482893ec2f2 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:18.019784 25236 raft_consensus.cc:740] T 580c303c25314c439540b482893ec2f2 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8f3cec39fb4964a4fccfd5baa4077b, State: Initialized, Role: FOLLOWER
I20260807 13:50:18.019942 25231 tablet_bootstrap.cc:654] T 60e313c07c85407fabb232ac871b2f16 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:18.022601 25236 consensus_queue.cc:260] T 580c303c25314c439540b482893ec2f2 P fe8f3cec39fb4964a4fccfd5baa4077b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:18.022962 25231 tablet_bootstrap.cc:492] T 60e313c07c85407fabb232ac871b2f16 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: No bootstrap required, opened a new log
I20260807 13:50:18.022964 25234 tablet_bootstrap.cc:492] T 60e313c07c85407fabb232ac871b2f16 P d6d3ef3a235844cbbce1370e3aeb809f: No bootstrap required, opened a new log
I20260807 13:50:18.023126 25231 ts_tablet_manager.cc:1403] T 60e313c07c85407fabb232ac871b2f16 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
I20260807 13:50:18.023140 25234 ts_tablet_manager.cc:1403] T 60e313c07c85407fabb232ac871b2f16 P d6d3ef3a235844cbbce1370e3aeb809f: Time spent bootstrapping tablet: real 0.022s user 0.006s sys 0.014s
I20260807 13:50:18.024197 25234 raft_consensus.cc:359] T 60e313c07c85407fabb232ac871b2f16 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:18.024197 25231 raft_consensus.cc:359] T 60e313c07c85407fabb232ac871b2f16 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:18.024398 25234 raft_consensus.cc:385] T 60e313c07c85407fabb232ac871b2f16 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:18.024398 25231 raft_consensus.cc:385] T 60e313c07c85407fabb232ac871b2f16 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:18.024500 25234 raft_consensus.cc:740] T 60e313c07c85407fabb232ac871b2f16 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d3ef3a235844cbbce1370e3aeb809f, State: Initialized, Role: FOLLOWER
I20260807 13:50:18.024500 25231 raft_consensus.cc:740] T 60e313c07c85407fabb232ac871b2f16 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Initialized, Role: FOLLOWER
I20260807 13:50:18.024760 25231 consensus_queue.cc:260] T 60e313c07c85407fabb232ac871b2f16 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:18.024842 25234 consensus_queue.cc:260] T 60e313c07c85407fabb232ac871b2f16 P d6d3ef3a235844cbbce1370e3aeb809f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:18.025453 25231 ts_tablet_manager.cc:1434] T 60e313c07c85407fabb232ac871b2f16 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 13:50:18.026253 25234 ts_tablet_manager.cc:1434] T 60e313c07c85407fabb232ac871b2f16 P d6d3ef3a235844cbbce1370e3aeb809f: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260807 13:50:18.023945 25232 raft_consensus.cc:359] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:18.027463 25232 raft_consensus.cc:385] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:18.027691 25232 raft_consensus.cc:740] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Initialized, Role: FOLLOWER
I20260807 13:50:18.030983 25232 consensus_queue.cc:260] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:18.032634 25237 tablet_bootstrap.cc:492] T 51b7e3d8d45545739a2bf1b23b3e2c3f P c8d4866795004103a4b0243906fe4d60: No bootstrap required, opened a new log
I20260807 13:50:18.032847 25232 ts_tablet_manager.cc:1434] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11: Time spent starting tablet: real 0.065s user 0.011s sys 0.003s
I20260807 13:50:18.032855 25237 ts_tablet_manager.cc:1403] T 51b7e3d8d45545739a2bf1b23b3e2c3f P c8d4866795004103a4b0243906fe4d60: Time spent bootstrapping tablet: real 0.034s user 0.015s sys 0.016s
I20260807 13:50:18.033685 25236 ts_tablet_manager.cc:1434] T 580c303c25314c439540b482893ec2f2 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent starting tablet: real 0.058s user 0.013s sys 0.002s
I20260807 13:50:18.034094 25237 raft_consensus.cc:359] T 51b7e3d8d45545739a2bf1b23b3e2c3f P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:18.034322 25237 raft_consensus.cc:385] T 51b7e3d8d45545739a2bf1b23b3e2c3f P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:18.034440 25237 raft_consensus.cc:740] T 51b7e3d8d45545739a2bf1b23b3e2c3f P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8d4866795004103a4b0243906fe4d60, State: Initialized, Role: FOLLOWER
I20260807 13:50:18.034747 25237 consensus_queue.cc:260] T 51b7e3d8d45545739a2bf1b23b3e2c3f P c8d4866795004103a4b0243906fe4d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:18.035571 25237 ts_tablet_manager.cc:1434] T 51b7e3d8d45545739a2bf1b23b3e2c3f P c8d4866795004103a4b0243906fe4d60: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:50:18.037667 25249 raft_consensus.cc:493] T 60e313c07c85407fabb232ac871b2f16 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:18.037953 25249 raft_consensus.cc:515] T 60e313c07c85407fabb232ac871b2f16 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:18.039992 25249 leader_election.cc:290] T 60e313c07c85407fabb232ac871b2f16 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641), d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131)
I20260807 13:50:18.048337 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60e313c07c85407fabb232ac871b2f16" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60" is_pre_election: true
I20260807 13:50:18.048858 24601 raft_consensus.cc:2468] T 60e313c07c85407fabb232ac871b2f16 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 0.
I20260807 13:50:18.048801 24956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60e313c07c85407fabb232ac871b2f16" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" is_pre_election: true
I20260807 13:50:18.049419 24956 raft_consensus.cc:2468] T 60e313c07c85407fabb232ac871b2f16 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 0.
I20260807 13:50:18.049664 24152 leader_election.cc:304] T 60e313c07c85407fabb232ac871b2f16 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, c8d4866795004103a4b0243906fe4d60; no voters:
I20260807 13:50:18.050110 25249 raft_consensus.cc:2804] T 60e313c07c85407fabb232ac871b2f16 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:18.050304 25249 raft_consensus.cc:493] T 60e313c07c85407fabb232ac871b2f16 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:18.050432 25249 raft_consensus.cc:3060] T 60e313c07c85407fabb232ac871b2f16 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:18.052979 25249 raft_consensus.cc:515] T 60e313c07c85407fabb232ac871b2f16 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:18.053702 25249 leader_election.cc:290] T 60e313c07c85407fabb232ac871b2f16 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 election: Requested vote from peers c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641), d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131)
I20260807 13:50:18.054476 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60e313c07c85407fabb232ac871b2f16" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60"
I20260807 13:50:18.054543 24956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60e313c07c85407fabb232ac871b2f16" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d3ef3a235844cbbce1370e3aeb809f"
I20260807 13:50:18.054692 24601 raft_consensus.cc:3060] T 60e313c07c85407fabb232ac871b2f16 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:18.054749 24956 raft_consensus.cc:3060] T 60e313c07c85407fabb232ac871b2f16 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:18.056931 24601 raft_consensus.cc:2468] T 60e313c07c85407fabb232ac871b2f16 P c8d4866795004103a4b0243906fe4d60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 1.
I20260807 13:50:18.056934 24956 raft_consensus.cc:2468] T 60e313c07c85407fabb232ac871b2f16 P d6d3ef3a235844cbbce1370e3aeb809f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 1.
I20260807 13:50:18.057417 24152 leader_election.cc:304] T 60e313c07c85407fabb232ac871b2f16 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, d6d3ef3a235844cbbce1370e3aeb809f; no voters:
I20260807 13:50:18.057715 25249 raft_consensus.cc:2804] T 60e313c07c85407fabb232ac871b2f16 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:18.058183 25249 raft_consensus.cc:697] T 60e313c07c85407fabb232ac871b2f16 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 LEADER]: Becoming Leader. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Running, Role: LEADER
I20260807 13:50:18.058812 25249 consensus_queue.cc:237] T 60e313c07c85407fabb232ac871b2f16 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:18.063907 24041 catalog_manager.cc:5697] T 60e313c07c85407fabb232ac871b2f16 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129). New cstate: current_term: 1 leader_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } health_report { overall_health: UNKNOWN } } }
I20260807 13:50:18.159242 25258 raft_consensus.cc:493] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:18.159619 25258 raft_consensus.cc:515] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:18.161652 25258 leader_election.cc:290] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619), b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189)
I20260807 13:50:18.171501 24777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580c303c25314c439540b482893ec2f2" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b890fcdb46dc4597bd9991906433c391" is_pre_election: true
I20260807 13:50:18.171501 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580c303c25314c439540b482893ec2f2" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" is_pre_election: true
I20260807 13:50:18.172101 24427 raft_consensus.cc:2468] T 580c303c25314c439540b482893ec2f2 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 0.
I20260807 13:50:18.172112 24777 raft_consensus.cc:2468] T 580c303c25314c439540b482893ec2f2 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 0.
I20260807 13:50:18.172914 25047 leader_election.cc:304] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b890fcdb46dc4597bd9991906433c391, d1d858e0ace34c39a641ede1db85be11; no voters:
I20260807 13:50:18.173411 25258 raft_consensus.cc:2804] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:18.173616 25258 raft_consensus.cc:493] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:18.173734 25258 raft_consensus.cc:3060] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:18.175858 25258 raft_consensus.cc:515] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:18.176443 25258 leader_election.cc:290] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 election: Requested vote from peers fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619), b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189)
I20260807 13:50:18.176946 24777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580c303c25314c439540b482893ec2f2" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b890fcdb46dc4597bd9991906433c391"
I20260807 13:50:18.176975 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580c303c25314c439540b482893ec2f2" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b"
I20260807 13:50:18.177134 24777 raft_consensus.cc:3060] T 580c303c25314c439540b482893ec2f2 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:18.177191 24427 raft_consensus.cc:3060] T 580c303c25314c439540b482893ec2f2 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:18.179314 24777 raft_consensus.cc:2468] T 580c303c25314c439540b482893ec2f2 P b890fcdb46dc4597bd9991906433c391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 1.
I20260807 13:50:18.179345 24427 raft_consensus.cc:2468] T 580c303c25314c439540b482893ec2f2 P fe8f3cec39fb4964a4fccfd5baa4077b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 1.
I20260807 13:50:18.179778 25047 leader_election.cc:304] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b890fcdb46dc4597bd9991906433c391, d1d858e0ace34c39a641ede1db85be11; no voters:
I20260807 13:50:18.180083 25258 raft_consensus.cc:2804] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:18.180540 25258 raft_consensus.cc:697] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11 [term 1 LEADER]: Becoming Leader. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Running, Role: LEADER
I20260807 13:50:18.181136 25258 consensus_queue.cc:237] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:18.187041 24041 catalog_manager.cc:5697] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1d858e0ace34c39a641ede1db85be11 (127.23.107.134). New cstate: current_term: 1 leader_uuid: "d1d858e0ace34c39a641ede1db85be11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } health_report { overall_health: UNKNOWN } } }
W20260807 13:50:18.203797 25198 tablet.cc:2406] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 13:50:18.214417 25018 tablet.cc:2406] T 51b7e3d8d45545739a2bf1b23b3e2c3f P d6d3ef3a235844cbbce1370e3aeb809f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 13:50:18.217450 24839 tablet.cc:2406] T 580c303c25314c439540b482893ec2f2 P b890fcdb46dc4597bd9991906433c391: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 13:50:18.222666 24666 tablet.cc:2406] T 51b7e3d8d45545739a2bf1b23b3e2c3f P c8d4866795004103a4b0243906fe4d60: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 13:50:18.238123 24488 tablet.cc:2406] T 580c303c25314c439540b482893ec2f2 P fe8f3cec39fb4964a4fccfd5baa4077b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 13:50:18.253131 24307 tablet.cc:2406] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 13:50:18.419533 25250 raft_consensus.cc:493] T 51b7e3d8d45545739a2bf1b23b3e2c3f P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:18.419803 25250 raft_consensus.cc:515] T 51b7e3d8d45545739a2bf1b23b3e2c3f P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:18.420783 25249 raft_consensus.cc:493] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:18.421011 25249 raft_consensus.cc:515] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:18.421896 25249 leader_election.cc:290] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131), c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641)
I20260807 13:50:18.421983 25250 leader_election.cc:290] T 51b7e3d8d45545739a2bf1b23b3e2c3f P d6d3ef3a235844cbbce1370e3aeb809f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641), 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973)
I20260807 13:50:18.422911 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b7e3d8d45545739a2bf1b23b3e2c3f" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60" is_pre_election: true
I20260807 13:50:18.423218 24601 raft_consensus.cc:2468] T 51b7e3d8d45545739a2bf1b23b3e2c3f P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 0.
I20260807 13:50:18.423722 24956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b7e3d8d45545739a2bf1b23b3e2c3f" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" is_pre_election: true
I20260807 13:50:18.423794 24152 leader_election.cc:304] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, c8d4866795004103a4b0243906fe4d60; no voters:
I20260807 13:50:18.423975 24956 raft_consensus.cc:2468] T 51b7e3d8d45545739a2bf1b23b3e2c3f P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 0.
I20260807 13:50:18.424778 25249 raft_consensus.cc:2804] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:18.424904 25249 raft_consensus.cc:493] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:18.425020 25249 raft_consensus.cc:3060] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:18.428125 25249 raft_consensus.cc:515] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:18.429252 24956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b7e3d8d45545739a2bf1b23b3e2c3f" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d3ef3a235844cbbce1370e3aeb809f"
I20260807 13:50:18.429528 24956 raft_consensus.cc:3060] T 51b7e3d8d45545739a2bf1b23b3e2c3f P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:18.429775 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b7e3d8d45545739a2bf1b23b3e2c3f" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60"
I20260807 13:50:18.429997 24601 raft_consensus.cc:3060] T 51b7e3d8d45545739a2bf1b23b3e2c3f P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:18.432237 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b7e3d8d45545739a2bf1b23b3e2c3f" candidate_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60" is_pre_election: true
I20260807 13:50:18.432399 24601 raft_consensus.cc:2468] T 51b7e3d8d45545739a2bf1b23b3e2c3f P c8d4866795004103a4b0243906fe4d60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 1.
I20260807 13:50:18.432525 24956 raft_consensus.cc:2468] T 51b7e3d8d45545739a2bf1b23b3e2c3f P d6d3ef3a235844cbbce1370e3aeb809f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 1.
I20260807 13:50:18.432431 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b7e3d8d45545739a2bf1b23b3e2c3f" candidate_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" is_pre_election: true
I20260807 13:50:18.432740 24600 raft_consensus.cc:2393] T 51b7e3d8d45545739a2bf1b23b3e2c3f P c8d4866795004103a4b0243906fe4d60 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d6d3ef3a235844cbbce1370e3aeb809f in current term 1: Already voted for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in this term.
I20260807 13:50:18.432895 24152 leader_election.cc:304] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, c8d4866795004103a4b0243906fe4d60; no voters:
I20260807 13:50:18.433017 24240 raft_consensus.cc:2393] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d6d3ef3a235844cbbce1370e3aeb809f in current term 1: Already voted for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in this term.
I20260807 13:50:18.433101 25249 leader_election.cc:290] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 election: Requested vote from peers d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131), c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641)
I20260807 13:50:18.433367 25249 raft_consensus.cc:2804] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:18.433609 25249 raft_consensus.cc:697] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 LEADER]: Becoming Leader. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Running, Role: LEADER
I20260807 13:50:18.433928 25249 consensus_queue.cc:237] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:18.434273 24863 leader_election.cc:304] T 51b7e3d8d45545739a2bf1b23b3e2c3f P d6d3ef3a235844cbbce1370e3aeb809f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6d3ef3a235844cbbce1370e3aeb809f; no voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, c8d4866795004103a4b0243906fe4d60
I20260807 13:50:18.434742 25250 raft_consensus.cc:2749] T 51b7e3d8d45545739a2bf1b23b3e2c3f P d6d3ef3a235844cbbce1370e3aeb809f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:50:18.436898 24041 catalog_manager.cc:5697] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129). New cstate: current_term: 1 leader_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } health_report { overall_health: HEALTHY } } }
I20260807 13:50:18.500244 25249 consensus_queue.cc:1048] T 60e313c07c85407fabb232ac871b2f16 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:18.514658 25261 consensus_queue.cc:1048] T 60e313c07c85407fabb232ac871b2f16 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:18.678444 25258 consensus_queue.cc:1048] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:18.687976 25281 consensus_queue.cc:1048] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:50:18.937085 25278 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:18.937494 25278 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260807 13:50:18.941829 25274 consensus_queue.cc:1048] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:18.947887 25274 consensus_queue.cc:1048] T 51b7e3d8d45545739a2bf1b23b3e2c3f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Using table 'rebalance_test_table_0'
INSERT report
rows total: 2000
time total: 264.283 ms
time per row: 0.132141 ms
I20260807 13:50:19.396715 24031 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43984:
name: "rebalance_test_table_1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:50:19.407310 24396 tablet_service.cc:1511] Processing CreateTablet for tablet 2196f5d34beb485ea0b595dbe53c025e (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e547783b99645a493da173c825c4b3b]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:19.407469 24751 tablet_service.cc:1511] Processing CreateTablet for tablet 2196f5d34beb485ea0b595dbe53c025e (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e547783b99645a493da173c825c4b3b]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:19.407858 24396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2196f5d34beb485ea0b595dbe53c025e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:19.407971 24751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2196f5d34beb485ea0b595dbe53c025e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:19.409850 24210 tablet_service.cc:1511] Processing CreateTablet for tablet 532000bd82914bb99de0af06604aaaa6 (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e547783b99645a493da173c825c4b3b]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:19.410323 24210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 532000bd82914bb99de0af06604aaaa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:19.414165 24750 tablet_service.cc:1511] Processing CreateTablet for tablet ff57497da5e34a1988f65e6d07f8a115 (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e547783b99645a493da173c825c4b3b]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:19.414498 25107 tablet_service.cc:1511] Processing CreateTablet for tablet 2196f5d34beb485ea0b595dbe53c025e (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e547783b99645a493da173c825c4b3b]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:19.414669 24750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff57497da5e34a1988f65e6d07f8a115. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:19.414986 25107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2196f5d34beb485ea0b595dbe53c025e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:19.421096 24573 tablet_service.cc:1511] Processing CreateTablet for tablet 532000bd82914bb99de0af06604aaaa6 (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e547783b99645a493da173c825c4b3b]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:19.421098 25106 tablet_service.cc:1511] Processing CreateTablet for tablet ff57497da5e34a1988f65e6d07f8a115 (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e547783b99645a493da173c825c4b3b]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:19.421159 24926 tablet_service.cc:1511] Processing CreateTablet for tablet 532000bd82914bb99de0af06604aaaa6 (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e547783b99645a493da173c825c4b3b]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:19.421602 24573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 532000bd82914bb99de0af06604aaaa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:19.421613 24926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 532000bd82914bb99de0af06604aaaa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:19.421653 25106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff57497da5e34a1988f65e6d07f8a115. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:19.426199 24395 tablet_service.cc:1511] Processing CreateTablet for tablet ff57497da5e34a1988f65e6d07f8a115 (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e547783b99645a493da173c825c4b3b]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:19.426707 24395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff57497da5e34a1988f65e6d07f8a115. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:19.430593 25365 tablet_bootstrap.cc:492] T 532000bd82914bb99de0af06604aaaa6 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Bootstrap starting.
I20260807 13:50:19.432417 25363 tablet_bootstrap.cc:492] T 2196f5d34beb485ea0b595dbe53c025e P fe8f3cec39fb4964a4fccfd5baa4077b: Bootstrap starting.
I20260807 13:50:19.433835 25365 tablet_bootstrap.cc:654] T 532000bd82914bb99de0af06604aaaa6 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:19.435340 25368 tablet_bootstrap.cc:492] T 532000bd82914bb99de0af06604aaaa6 P c8d4866795004103a4b0243906fe4d60: Bootstrap starting.
I20260807 13:50:19.437897 25368 tablet_bootstrap.cc:654] T 532000bd82914bb99de0af06604aaaa6 P c8d4866795004103a4b0243906fe4d60: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:19.439477 25370 tablet_bootstrap.cc:492] T 532000bd82914bb99de0af06604aaaa6 P d6d3ef3a235844cbbce1370e3aeb809f: Bootstrap starting.
I20260807 13:50:19.439991 25363 tablet_bootstrap.cc:654] T 2196f5d34beb485ea0b595dbe53c025e P fe8f3cec39fb4964a4fccfd5baa4077b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:19.442824 25370 tablet_bootstrap.cc:654] T 532000bd82914bb99de0af06604aaaa6 P d6d3ef3a235844cbbce1370e3aeb809f: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:19.443845 25367 tablet_bootstrap.cc:492] T 2196f5d34beb485ea0b595dbe53c025e P d1d858e0ace34c39a641ede1db85be11: Bootstrap starting.
I20260807 13:50:19.450006 25363 tablet_bootstrap.cc:492] T 2196f5d34beb485ea0b595dbe53c025e P fe8f3cec39fb4964a4fccfd5baa4077b: No bootstrap required, opened a new log
I20260807 13:50:19.450178 25368 tablet_bootstrap.cc:492] T 532000bd82914bb99de0af06604aaaa6 P c8d4866795004103a4b0243906fe4d60: No bootstrap required, opened a new log
I20260807 13:50:19.450181 25363 ts_tablet_manager.cc:1403] T 2196f5d34beb485ea0b595dbe53c025e P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.000s
I20260807 13:50:19.450446 25368 ts_tablet_manager.cc:1403] T 532000bd82914bb99de0af06604aaaa6 P c8d4866795004103a4b0243906fe4d60: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.004s
I20260807 13:50:19.451267 25363 raft_consensus.cc:359] T 2196f5d34beb485ea0b595dbe53c025e P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:19.451274 25368 raft_consensus.cc:359] T 532000bd82914bb99de0af06604aaaa6 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:19.451488 25363 raft_consensus.cc:385] T 2196f5d34beb485ea0b595dbe53c025e P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:19.451624 25368 raft_consensus.cc:385] T 532000bd82914bb99de0af06604aaaa6 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:19.451614 25363 raft_consensus.cc:740] T 2196f5d34beb485ea0b595dbe53c025e P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8f3cec39fb4964a4fccfd5baa4077b, State: Initialized, Role: FOLLOWER
I20260807 13:50:19.451851 25368 raft_consensus.cc:740] T 532000bd82914bb99de0af06604aaaa6 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8d4866795004103a4b0243906fe4d60, State: Initialized, Role: FOLLOWER
I20260807 13:50:19.451961 25370 tablet_bootstrap.cc:492] T 532000bd82914bb99de0af06604aaaa6 P d6d3ef3a235844cbbce1370e3aeb809f: No bootstrap required, opened a new log
I20260807 13:50:19.451885 25363 consensus_queue.cc:260] T 2196f5d34beb485ea0b595dbe53c025e P fe8f3cec39fb4964a4fccfd5baa4077b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:19.452247 25370 ts_tablet_manager.cc:1403] T 532000bd82914bb99de0af06604aaaa6 P d6d3ef3a235844cbbce1370e3aeb809f: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.004s
I20260807 13:50:19.452301 25368 consensus_queue.cc:260] T 532000bd82914bb99de0af06604aaaa6 P c8d4866795004103a4b0243906fe4d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:19.453400 25370 raft_consensus.cc:359] T 532000bd82914bb99de0af06604aaaa6 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:19.453725 25370 raft_consensus.cc:385] T 532000bd82914bb99de0af06604aaaa6 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:19.453892 25370 raft_consensus.cc:740] T 532000bd82914bb99de0af06604aaaa6 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d3ef3a235844cbbce1370e3aeb809f, State: Initialized, Role: FOLLOWER
I20260807 13:50:19.455376 25370 consensus_queue.cc:260] T 532000bd82914bb99de0af06604aaaa6 P d6d3ef3a235844cbbce1370e3aeb809f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:19.456714 25368 ts_tablet_manager.cc:1434] T 532000bd82914bb99de0af06604aaaa6 P c8d4866795004103a4b0243906fe4d60: Time spent starting tablet: real 0.006s user 0.001s sys 0.004s
I20260807 13:50:19.457077 25363 ts_tablet_manager.cc:1434] T 2196f5d34beb485ea0b595dbe53c025e P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent starting tablet: real 0.007s user 0.000s sys 0.004s
I20260807 13:50:19.458669 25370 ts_tablet_manager.cc:1434] T 532000bd82914bb99de0af06604aaaa6 P d6d3ef3a235844cbbce1370e3aeb809f: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260807 13:50:19.460079 25367 tablet_bootstrap.cc:654] T 2196f5d34beb485ea0b595dbe53c025e P d1d858e0ace34c39a641ede1db85be11: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:19.461427 25363 tablet_bootstrap.cc:492] T ff57497da5e34a1988f65e6d07f8a115 P fe8f3cec39fb4964a4fccfd5baa4077b: Bootstrap starting.
I20260807 13:50:19.462188 25364 tablet_bootstrap.cc:492] T 2196f5d34beb485ea0b595dbe53c025e P b890fcdb46dc4597bd9991906433c391: Bootstrap starting.
I20260807 13:50:19.464536 25363 tablet_bootstrap.cc:654] T ff57497da5e34a1988f65e6d07f8a115 P fe8f3cec39fb4964a4fccfd5baa4077b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:19.464922 25364 tablet_bootstrap.cc:654] T 2196f5d34beb485ea0b595dbe53c025e P b890fcdb46dc4597bd9991906433c391: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:19.469700 25364 tablet_bootstrap.cc:492] T 2196f5d34beb485ea0b595dbe53c025e P b890fcdb46dc4597bd9991906433c391: No bootstrap required, opened a new log
I20260807 13:50:19.470320 25364 ts_tablet_manager.cc:1403] T 2196f5d34beb485ea0b595dbe53c025e P b890fcdb46dc4597bd9991906433c391: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.004s
I20260807 13:50:19.471534 25364 raft_consensus.cc:359] T 2196f5d34beb485ea0b595dbe53c025e P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:19.473984 25364 raft_consensus.cc:385] T 2196f5d34beb485ea0b595dbe53c025e P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:19.474265 25364 raft_consensus.cc:740] T 2196f5d34beb485ea0b595dbe53c025e P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b890fcdb46dc4597bd9991906433c391, State: Initialized, Role: FOLLOWER
I20260807 13:50:19.474822 25364 consensus_queue.cc:260] T 2196f5d34beb485ea0b595dbe53c025e P b890fcdb46dc4597bd9991906433c391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:19.478848 25365 tablet_bootstrap.cc:492] T 532000bd82914bb99de0af06604aaaa6 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: No bootstrap required, opened a new log
I20260807 13:50:19.479127 25365 ts_tablet_manager.cc:1403] T 532000bd82914bb99de0af06604aaaa6 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent bootstrapping tablet: real 0.049s user 0.009s sys 0.020s
I20260807 13:50:19.479424 25364 ts_tablet_manager.cc:1434] T 2196f5d34beb485ea0b595dbe53c025e P b890fcdb46dc4597bd9991906433c391: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260807 13:50:19.480233 25364 tablet_bootstrap.cc:492] T ff57497da5e34a1988f65e6d07f8a115 P b890fcdb46dc4597bd9991906433c391: Bootstrap starting.
I20260807 13:50:19.480204 25365 raft_consensus.cc:359] T 532000bd82914bb99de0af06604aaaa6 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:19.480474 25365 raft_consensus.cc:385] T 532000bd82914bb99de0af06604aaaa6 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:19.480626 25365 raft_consensus.cc:740] T 532000bd82914bb99de0af06604aaaa6 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Initialized, Role: FOLLOWER
I20260807 13:50:19.480957 25365 consensus_queue.cc:260] T 532000bd82914bb99de0af06604aaaa6 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:19.481855 25365 ts_tablet_manager.cc:1434] T 532000bd82914bb99de0af06604aaaa6 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260807 13:50:19.482971 25363 tablet_bootstrap.cc:492] T ff57497da5e34a1988f65e6d07f8a115 P fe8f3cec39fb4964a4fccfd5baa4077b: No bootstrap required, opened a new log
I20260807 13:50:19.483234 25363 ts_tablet_manager.cc:1403] T ff57497da5e34a1988f65e6d07f8a115 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.002s
I20260807 13:50:19.484305 25364 tablet_bootstrap.cc:654] T ff57497da5e34a1988f65e6d07f8a115 P b890fcdb46dc4597bd9991906433c391: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:19.484431 25363 raft_consensus.cc:359] T ff57497da5e34a1988f65e6d07f8a115 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:19.484755 25363 raft_consensus.cc:385] T ff57497da5e34a1988f65e6d07f8a115 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:19.484900 25363 raft_consensus.cc:740] T ff57497da5e34a1988f65e6d07f8a115 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8f3cec39fb4964a4fccfd5baa4077b, State: Initialized, Role: FOLLOWER
I20260807 13:50:19.485318 25363 consensus_queue.cc:260] T ff57497da5e34a1988f65e6d07f8a115 P fe8f3cec39fb4964a4fccfd5baa4077b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:19.487569 25367 tablet_bootstrap.cc:492] T 2196f5d34beb485ea0b595dbe53c025e P d1d858e0ace34c39a641ede1db85be11: No bootstrap required, opened a new log
I20260807 13:50:19.487769 25367 ts_tablet_manager.cc:1403] T 2196f5d34beb485ea0b595dbe53c025e P d1d858e0ace34c39a641ede1db85be11: Time spent bootstrapping tablet: real 0.044s user 0.007s sys 0.007s
I20260807 13:50:19.489089 25367 raft_consensus.cc:359] T 2196f5d34beb485ea0b595dbe53c025e P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:19.489490 25367 raft_consensus.cc:385] T 2196f5d34beb485ea0b595dbe53c025e P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:19.489648 25367 raft_consensus.cc:740] T 2196f5d34beb485ea0b595dbe53c025e P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Initialized, Role: FOLLOWER
I20260807 13:50:19.489682 25363 ts_tablet_manager.cc:1434] T ff57497da5e34a1988f65e6d07f8a115 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260807 13:50:19.490042 25367 consensus_queue.cc:260] T 2196f5d34beb485ea0b595dbe53c025e P d1d858e0ace34c39a641ede1db85be11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:19.490835 25367 ts_tablet_manager.cc:1434] T 2196f5d34beb485ea0b595dbe53c025e P d1d858e0ace34c39a641ede1db85be11: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260807 13:50:19.491210 25367 tablet_bootstrap.cc:492] T ff57497da5e34a1988f65e6d07f8a115 P d1d858e0ace34c39a641ede1db85be11: Bootstrap starting.
I20260807 13:50:19.493242 25367 tablet_bootstrap.cc:654] T ff57497da5e34a1988f65e6d07f8a115 P d1d858e0ace34c39a641ede1db85be11: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:19.505590 25258 raft_consensus.cc:493] T 2196f5d34beb485ea0b595dbe53c025e P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:19.505777 25258 raft_consensus.cc:515] T 2196f5d34beb485ea0b595dbe53c025e P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:19.506569 25258 leader_election.cc:290] T 2196f5d34beb485ea0b595dbe53c025e P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619), b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189)
I20260807 13:50:19.507503 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2196f5d34beb485ea0b595dbe53c025e" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" is_pre_election: true
I20260807 13:50:19.507776 24427 raft_consensus.cc:2468] T 2196f5d34beb485ea0b595dbe53c025e P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 0.
I20260807 13:50:19.508179 24777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2196f5d34beb485ea0b595dbe53c025e" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b890fcdb46dc4597bd9991906433c391" is_pre_election: true
I20260807 13:50:19.508466 24777 raft_consensus.cc:2468] T 2196f5d34beb485ea0b595dbe53c025e P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 0.
I20260807 13:50:19.508497 25049 leader_election.cc:304] T 2196f5d34beb485ea0b595dbe53c025e P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1d858e0ace34c39a641ede1db85be11, fe8f3cec39fb4964a4fccfd5baa4077b; no voters:
I20260807 13:50:19.508826 25258 raft_consensus.cc:2804] T 2196f5d34beb485ea0b595dbe53c025e P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:19.508951 25258 raft_consensus.cc:493] T 2196f5d34beb485ea0b595dbe53c025e P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:19.509047 25258 raft_consensus.cc:3060] T 2196f5d34beb485ea0b595dbe53c025e P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:19.510174 25364 tablet_bootstrap.cc:492] T ff57497da5e34a1988f65e6d07f8a115 P b890fcdb46dc4597bd9991906433c391: No bootstrap required, opened a new log
I20260807 13:50:19.510397 25364 ts_tablet_manager.cc:1403] T ff57497da5e34a1988f65e6d07f8a115 P b890fcdb46dc4597bd9991906433c391: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.005s
I20260807 13:50:19.511528 25364 raft_consensus.cc:359] T ff57497da5e34a1988f65e6d07f8a115 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:19.511811 25364 raft_consensus.cc:385] T ff57497da5e34a1988f65e6d07f8a115 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:19.511902 25364 raft_consensus.cc:740] T ff57497da5e34a1988f65e6d07f8a115 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b890fcdb46dc4597bd9991906433c391, State: Initialized, Role: FOLLOWER
I20260807 13:50:19.512195 25258 raft_consensus.cc:515] T 2196f5d34beb485ea0b595dbe53c025e P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:19.512251 25364 consensus_queue.cc:260] T ff57497da5e34a1988f65e6d07f8a115 P b890fcdb46dc4597bd9991906433c391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:19.513010 25364 ts_tablet_manager.cc:1434] T ff57497da5e34a1988f65e6d07f8a115 P b890fcdb46dc4597bd9991906433c391: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260807 13:50:19.515648 24777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2196f5d34beb485ea0b595dbe53c025e" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b890fcdb46dc4597bd9991906433c391"
I20260807 13:50:19.515887 24777 raft_consensus.cc:3060] T 2196f5d34beb485ea0b595dbe53c025e P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:19.519858 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2196f5d34beb485ea0b595dbe53c025e" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b"
I20260807 13:50:19.520149 24427 raft_consensus.cc:3060] T 2196f5d34beb485ea0b595dbe53c025e P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:19.523075 25367 tablet_bootstrap.cc:492] T ff57497da5e34a1988f65e6d07f8a115 P d1d858e0ace34c39a641ede1db85be11: No bootstrap required, opened a new log
I20260807 13:50:19.523284 25367 ts_tablet_manager.cc:1403] T ff57497da5e34a1988f65e6d07f8a115 P d1d858e0ace34c39a641ede1db85be11: Time spent bootstrapping tablet: real 0.032s user 0.009s sys 0.009s
I20260807 13:50:19.523382 24427 raft_consensus.cc:2468] T 2196f5d34beb485ea0b595dbe53c025e P fe8f3cec39fb4964a4fccfd5baa4077b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 1.
I20260807 13:50:19.523736 24777 raft_consensus.cc:2468] T 2196f5d34beb485ea0b595dbe53c025e P b890fcdb46dc4597bd9991906433c391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 1.
I20260807 13:50:19.524061 25258 leader_election.cc:290] T 2196f5d34beb485ea0b595dbe53c025e P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 election: Requested vote from peers fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619), b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189)
I20260807 13:50:19.524183 25367 raft_consensus.cc:359] T ff57497da5e34a1988f65e6d07f8a115 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:19.524448 25367 raft_consensus.cc:385] T ff57497da5e34a1988f65e6d07f8a115 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:19.524413 25047 leader_election.cc:304] T 2196f5d34beb485ea0b595dbe53c025e P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b890fcdb46dc4597bd9991906433c391, d1d858e0ace34c39a641ede1db85be11; no voters:
I20260807 13:50:19.524552 25367 raft_consensus.cc:740] T ff57497da5e34a1988f65e6d07f8a115 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Initialized, Role: FOLLOWER
I20260807 13:50:19.524783 25367 consensus_queue.cc:260] T ff57497da5e34a1988f65e6d07f8a115 P d1d858e0ace34c39a641ede1db85be11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:19.525282 25367 ts_tablet_manager.cc:1434] T ff57497da5e34a1988f65e6d07f8a115 P d1d858e0ace34c39a641ede1db85be11: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260807 13:50:19.524922 25258 raft_consensus.cc:2804] T 2196f5d34beb485ea0b595dbe53c025e P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:19.526010 25258 raft_consensus.cc:697] T 2196f5d34beb485ea0b595dbe53c025e P d1d858e0ace34c39a641ede1db85be11 [term 1 LEADER]: Becoming Leader. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Running, Role: LEADER
I20260807 13:50:19.526335 25258 consensus_queue.cc:237] T 2196f5d34beb485ea0b595dbe53c025e P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:19.529652 24034 catalog_manager.cc:5697] T 2196f5d34beb485ea0b595dbe53c025e P d1d858e0ace34c39a641ede1db85be11 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1d858e0ace34c39a641ede1db85be11 (127.23.107.134). New cstate: current_term: 1 leader_uuid: "d1d858e0ace34c39a641ede1db85be11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } health_report { overall_health: HEALTHY } } }
I20260807 13:50:19.535853 25341 raft_consensus.cc:493] T 532000bd82914bb99de0af06604aaaa6 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:19.536036 25341 raft_consensus.cc:515] T 532000bd82914bb99de0af06604aaaa6 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:19.536883 25341 leader_election.cc:290] T 532000bd82914bb99de0af06604aaaa6 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641), d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131)
I20260807 13:50:19.537510 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532000bd82914bb99de0af06604aaaa6" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60" is_pre_election: true
I20260807 13:50:19.537575 24955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532000bd82914bb99de0af06604aaaa6" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" is_pre_election: true
I20260807 13:50:19.537750 24601 raft_consensus.cc:2468] T 532000bd82914bb99de0af06604aaaa6 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 0.
I20260807 13:50:19.537856 24955 raft_consensus.cc:2468] T 532000bd82914bb99de0af06604aaaa6 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 0.
I20260807 13:50:19.538321 24152 leader_election.cc:304] T 532000bd82914bb99de0af06604aaaa6 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, c8d4866795004103a4b0243906fe4d60; no voters:
I20260807 13:50:19.538655 25341 raft_consensus.cc:2804] T 532000bd82914bb99de0af06604aaaa6 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:19.538800 25341 raft_consensus.cc:493] T 532000bd82914bb99de0af06604aaaa6 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:19.538906 25341 raft_consensus.cc:3060] T 532000bd82914bb99de0af06604aaaa6 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:19.539613 25383 raft_consensus.cc:493] T ff57497da5e34a1988f65e6d07f8a115 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:19.539812 25383 raft_consensus.cc:515] T ff57497da5e34a1988f65e6d07f8a115 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:19.541157 25341 raft_consensus.cc:515] T 532000bd82914bb99de0af06604aaaa6 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:19.541668 25383 leader_election.cc:290] T ff57497da5e34a1988f65e6d07f8a115 P b890fcdb46dc4597bd9991906433c391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1d858e0ace34c39a641ede1db85be11 (127.23.107.134:46341), fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619)
I20260807 13:50:19.541882 25341 leader_election.cc:290] T 532000bd82914bb99de0af06604aaaa6 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 election: Requested vote from peers c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641), d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131)
I20260807 13:50:19.543781 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532000bd82914bb99de0af06604aaaa6" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60"
I20260807 13:50:19.543823 24955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532000bd82914bb99de0af06604aaaa6" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d3ef3a235844cbbce1370e3aeb809f"
I20260807 13:50:19.544034 24601 raft_consensus.cc:3060] T 532000bd82914bb99de0af06604aaaa6 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:19.544075 24955 raft_consensus.cc:3060] T 532000bd82914bb99de0af06604aaaa6 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:19.547191 24601 raft_consensus.cc:2468] T 532000bd82914bb99de0af06604aaaa6 P c8d4866795004103a4b0243906fe4d60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 1.
I20260807 13:50:19.547741 24152 leader_election.cc:304] T 532000bd82914bb99de0af06604aaaa6 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, c8d4866795004103a4b0243906fe4d60; no voters:
I20260807 13:50:19.548110 25341 raft_consensus.cc:2804] T 532000bd82914bb99de0af06604aaaa6 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:19.548288 25341 raft_consensus.cc:697] T 532000bd82914bb99de0af06604aaaa6 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 LEADER]: Becoming Leader. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Running, Role: LEADER
I20260807 13:50:19.548264 24955 raft_consensus.cc:2468] T 532000bd82914bb99de0af06604aaaa6 P d6d3ef3a235844cbbce1370e3aeb809f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 1.
I20260807 13:50:19.548637 25341 consensus_queue.cc:237] T 532000bd82914bb99de0af06604aaaa6 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:19.551326 25131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff57497da5e34a1988f65e6d07f8a115" candidate_uuid: "b890fcdb46dc4597bd9991906433c391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1d858e0ace34c39a641ede1db85be11" is_pre_election: true
I20260807 13:50:19.551832 25131 raft_consensus.cc:2468] T ff57497da5e34a1988f65e6d07f8a115 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b890fcdb46dc4597bd9991906433c391 in term 0.
I20260807 13:50:19.552484 24688 leader_election.cc:304] T ff57497da5e34a1988f65e6d07f8a115 P b890fcdb46dc4597bd9991906433c391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b890fcdb46dc4597bd9991906433c391, d1d858e0ace34c39a641ede1db85be11; no voters:
I20260807 13:50:19.552912 25383 raft_consensus.cc:2804] T ff57497da5e34a1988f65e6d07f8a115 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:19.553071 25383 raft_consensus.cc:493] T ff57497da5e34a1988f65e6d07f8a115 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:19.553194 25383 raft_consensus.cc:3060] T ff57497da5e34a1988f65e6d07f8a115 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:19.555716 24034 catalog_manager.cc:5697] T 532000bd82914bb99de0af06604aaaa6 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129). New cstate: current_term: 1 leader_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } health_report { overall_health: UNKNOWN } } }
I20260807 13:50:19.556227 25383 raft_consensus.cc:515] T ff57497da5e34a1988f65e6d07f8a115 P b890fcdb46dc4597bd9991906433c391 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:19.556988 25383 leader_election.cc:290] T ff57497da5e34a1988f65e6d07f8a115 P b890fcdb46dc4597bd9991906433c391 [CANDIDATE]: Term 1 election: Requested vote from peers d1d858e0ace34c39a641ede1db85be11 (127.23.107.134:46341), fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619)
I20260807 13:50:19.557708 25131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff57497da5e34a1988f65e6d07f8a115" candidate_uuid: "b890fcdb46dc4597bd9991906433c391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1d858e0ace34c39a641ede1db85be11"
I20260807 13:50:19.557919 25131 raft_consensus.cc:3060] T ff57497da5e34a1988f65e6d07f8a115 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:19.560437 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff57497da5e34a1988f65e6d07f8a115" candidate_uuid: "b890fcdb46dc4597bd9991906433c391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" is_pre_election: true
I20260807 13:50:19.560719 24427 raft_consensus.cc:2468] T ff57497da5e34a1988f65e6d07f8a115 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b890fcdb46dc4597bd9991906433c391 in term 0.
I20260807 13:50:19.560810 25131 raft_consensus.cc:2468] T ff57497da5e34a1988f65e6d07f8a115 P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b890fcdb46dc4597bd9991906433c391 in term 1.
I20260807 13:50:19.560631 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff57497da5e34a1988f65e6d07f8a115" candidate_uuid: "b890fcdb46dc4597bd9991906433c391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b"
I20260807 13:50:19.561058 24425 raft_consensus.cc:3060] T ff57497da5e34a1988f65e6d07f8a115 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:19.561483 24688 leader_election.cc:304] T ff57497da5e34a1988f65e6d07f8a115 P b890fcdb46dc4597bd9991906433c391 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b890fcdb46dc4597bd9991906433c391, d1d858e0ace34c39a641ede1db85be11; no voters:
I20260807 13:50:19.561797 25383 raft_consensus.cc:2804] T ff57497da5e34a1988f65e6d07f8a115 P b890fcdb46dc4597bd9991906433c391 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:19.562274 25383 raft_consensus.cc:697] T ff57497da5e34a1988f65e6d07f8a115 P b890fcdb46dc4597bd9991906433c391 [term 1 LEADER]: Becoming Leader. State: Replica: b890fcdb46dc4597bd9991906433c391, State: Running, Role: LEADER
I20260807 13:50:19.563136 25383 consensus_queue.cc:237] T ff57497da5e34a1988f65e6d07f8a115 P b890fcdb46dc4597bd9991906433c391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:19.564169 24425 raft_consensus.cc:2468] T ff57497da5e34a1988f65e6d07f8a115 P fe8f3cec39fb4964a4fccfd5baa4077b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b890fcdb46dc4597bd9991906433c391 in term 1.
I20260807 13:50:19.567127 24034 catalog_manager.cc:5697] T ff57497da5e34a1988f65e6d07f8a115 P b890fcdb46dc4597bd9991906433c391 reported cstate change: term changed from 0 to 1, leader changed from <none> to b890fcdb46dc4597bd9991906433c391 (127.23.107.132). New cstate: current_term: 1 leader_uuid: "b890fcdb46dc4597bd9991906433c391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } health_report { overall_health: HEALTHY } } }
I20260807 13:50:19.928402 25258 consensus_queue.cc:1048] T 2196f5d34beb485ea0b595dbe53c025e P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:19.935392 25284 consensus_queue.cc:1048] T 2196f5d34beb485ea0b595dbe53c025e P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:50:19.952344 25398 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:19.952672 25398 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_1'
I20260807 13:50:20.064774 25341 consensus_queue.cc:1048] T 532000bd82914bb99de0af06604aaaa6 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:20.087281 25341 consensus_queue.cc:1048] T 532000bd82914bb99de0af06604aaaa6 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:20.147171 25383 consensus_queue.cc:1048] T ff57497da5e34a1988f65e6d07f8a115 P b890fcdb46dc4597bd9991906433c391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:20.210862 25383 consensus_queue.cc:1048] T ff57497da5e34a1988f65e6d07f8a115 P b890fcdb46dc4597bd9991906433c391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:20.297539 25406 mvcc.cc:204] Tried to move back new op lower bound from 7315909100374024192 to 7315909097736294400. Current Snapshot: MvccSnapshot[applied={T|T < 7315909100206194688}]
INSERT report
rows total: 2000
time total: 321.23 ms
time per row: 0.160615 ms
I20260807 13:50:20.452946 24034 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43984:
name: "rebalance_test_table_2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:50:20.463411 24573 tablet_service.cc:1511] Processing CreateTablet for tablet 044e19d6fe5142d991949fdc3f9c73d3 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a9b0fac44d3c4e008fd6f8b95a365c1d]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:20.463986 24573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 044e19d6fe5142d991949fdc3f9c73d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:20.465271 24572 tablet_service.cc:1511] Processing CreateTablet for tablet 5fc5d057ab2d4998b5c9c014802396e3 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a9b0fac44d3c4e008fd6f8b95a365c1d]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:20.465811 24572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fc5d057ab2d4998b5c9c014802396e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:20.465853 25107 tablet_service.cc:1511] Processing CreateTablet for tablet 60a54e3cce4941c5bd4055e40aa1e4a3 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a9b0fac44d3c4e008fd6f8b95a365c1d]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:20.466315 25107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60a54e3cce4941c5bd4055e40aa1e4a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:20.470162 24395 tablet_service.cc:1511] Processing CreateTablet for tablet 60a54e3cce4941c5bd4055e40aa1e4a3 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a9b0fac44d3c4e008fd6f8b95a365c1d]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:20.470271 24751 tablet_service.cc:1511] Processing CreateTablet for tablet 60a54e3cce4941c5bd4055e40aa1e4a3 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a9b0fac44d3c4e008fd6f8b95a365c1d]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:20.470604 24395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60a54e3cce4941c5bd4055e40aa1e4a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:20.470752 24751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60a54e3cce4941c5bd4055e40aa1e4a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:20.474105 24926 tablet_service.cc:1511] Processing CreateTablet for tablet 044e19d6fe5142d991949fdc3f9c73d3 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a9b0fac44d3c4e008fd6f8b95a365c1d]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:20.474534 24926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 044e19d6fe5142d991949fdc3f9c73d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:20.475061 24210 tablet_service.cc:1511] Processing CreateTablet for tablet 044e19d6fe5142d991949fdc3f9c73d3 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a9b0fac44d3c4e008fd6f8b95a365c1d]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:20.475188 24211 tablet_service.cc:1511] Processing CreateTablet for tablet 5fc5d057ab2d4998b5c9c014802396e3 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a9b0fac44d3c4e008fd6f8b95a365c1d]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:20.475567 24210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 044e19d6fe5142d991949fdc3f9c73d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:20.475766 24211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fc5d057ab2d4998b5c9c014802396e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:20.477766 24927 tablet_service.cc:1511] Processing CreateTablet for tablet 5fc5d057ab2d4998b5c9c014802396e3 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a9b0fac44d3c4e008fd6f8b95a365c1d]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:20.478152 24927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fc5d057ab2d4998b5c9c014802396e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:20.490281 25495 tablet_bootstrap.cc:492] T 044e19d6fe5142d991949fdc3f9c73d3 P d6d3ef3a235844cbbce1370e3aeb809f: Bootstrap starting.
I20260807 13:50:20.493875 25495 tablet_bootstrap.cc:654] T 044e19d6fe5142d991949fdc3f9c73d3 P d6d3ef3a235844cbbce1370e3aeb809f: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:20.499490 25498 tablet_bootstrap.cc:492] T 60a54e3cce4941c5bd4055e40aa1e4a3 P fe8f3cec39fb4964a4fccfd5baa4077b: Bootstrap starting.
I20260807 13:50:20.505033 25493 tablet_bootstrap.cc:492] T 5fc5d057ab2d4998b5c9c014802396e3 P c8d4866795004103a4b0243906fe4d60: Bootstrap starting.
I20260807 13:50:20.507682 25498 tablet_bootstrap.cc:654] T 60a54e3cce4941c5bd4055e40aa1e4a3 P fe8f3cec39fb4964a4fccfd5baa4077b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:20.510308 25492 tablet_bootstrap.cc:492] T 60a54e3cce4941c5bd4055e40aa1e4a3 P d1d858e0ace34c39a641ede1db85be11: Bootstrap starting.
I20260807 13:50:20.513744 25494 tablet_bootstrap.cc:492] T 5fc5d057ab2d4998b5c9c014802396e3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Bootstrap starting.
I20260807 13:50:20.514225 25493 tablet_bootstrap.cc:654] T 5fc5d057ab2d4998b5c9c014802396e3 P c8d4866795004103a4b0243906fe4d60: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:20.514376 25492 tablet_bootstrap.cc:654] T 60a54e3cce4941c5bd4055e40aa1e4a3 P d1d858e0ace34c39a641ede1db85be11: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:20.515875 25494 tablet_bootstrap.cc:654] T 5fc5d057ab2d4998b5c9c014802396e3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:20.516821 25495 tablet_bootstrap.cc:492] T 044e19d6fe5142d991949fdc3f9c73d3 P d6d3ef3a235844cbbce1370e3aeb809f: No bootstrap required, opened a new log
I20260807 13:50:20.517019 25495 ts_tablet_manager.cc:1403] T 044e19d6fe5142d991949fdc3f9c73d3 P d6d3ef3a235844cbbce1370e3aeb809f: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.000s
I20260807 13:50:20.518173 25495 raft_consensus.cc:359] T 044e19d6fe5142d991949fdc3f9c73d3 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:20.518425 25495 raft_consensus.cc:385] T 044e19d6fe5142d991949fdc3f9c73d3 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:20.518544 25495 raft_consensus.cc:740] T 044e19d6fe5142d991949fdc3f9c73d3 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d3ef3a235844cbbce1370e3aeb809f, State: Initialized, Role: FOLLOWER
I20260807 13:50:20.518654 25493 tablet_bootstrap.cc:492] T 5fc5d057ab2d4998b5c9c014802396e3 P c8d4866795004103a4b0243906fe4d60: No bootstrap required, opened a new log
I20260807 13:50:20.518842 25493 ts_tablet_manager.cc:1403] T 5fc5d057ab2d4998b5c9c014802396e3 P c8d4866795004103a4b0243906fe4d60: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.002s
I20260807 13:50:20.518827 25495 consensus_queue.cc:260] T 044e19d6fe5142d991949fdc3f9c73d3 P d6d3ef3a235844cbbce1370e3aeb809f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:20.520466 25493 raft_consensus.cc:359] T 5fc5d057ab2d4998b5c9c014802396e3 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:20.521075 25495 ts_tablet_manager.cc:1434] T 044e19d6fe5142d991949fdc3f9c73d3 P d6d3ef3a235844cbbce1370e3aeb809f: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260807 13:50:20.521066 25493 raft_consensus.cc:385] T 5fc5d057ab2d4998b5c9c014802396e3 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:20.521462 25495 tablet_bootstrap.cc:492] T 5fc5d057ab2d4998b5c9c014802396e3 P d6d3ef3a235844cbbce1370e3aeb809f: Bootstrap starting.
I20260807 13:50:20.521297 25493 raft_consensus.cc:740] T 5fc5d057ab2d4998b5c9c014802396e3 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8d4866795004103a4b0243906fe4d60, State: Initialized, Role: FOLLOWER
I20260807 13:50:20.521957 25493 consensus_queue.cc:260] T 5fc5d057ab2d4998b5c9c014802396e3 P c8d4866795004103a4b0243906fe4d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:20.522608 25493 ts_tablet_manager.cc:1434] T 5fc5d057ab2d4998b5c9c014802396e3 P c8d4866795004103a4b0243906fe4d60: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260807 13:50:20.522992 25493 tablet_bootstrap.cc:492] T 044e19d6fe5142d991949fdc3f9c73d3 P c8d4866795004103a4b0243906fe4d60: Bootstrap starting.
I20260807 13:50:20.523511 25496 tablet_bootstrap.cc:492] T 60a54e3cce4941c5bd4055e40aa1e4a3 P b890fcdb46dc4597bd9991906433c391: Bootstrap starting.
I20260807 13:50:20.524931 25493 tablet_bootstrap.cc:654] T 044e19d6fe5142d991949fdc3f9c73d3 P c8d4866795004103a4b0243906fe4d60: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:20.527228 25496 tablet_bootstrap.cc:654] T 60a54e3cce4941c5bd4055e40aa1e4a3 P b890fcdb46dc4597bd9991906433c391: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:20.528434 25498 tablet_bootstrap.cc:492] T 60a54e3cce4941c5bd4055e40aa1e4a3 P fe8f3cec39fb4964a4fccfd5baa4077b: No bootstrap required, opened a new log
I20260807 13:50:20.528618 25498 ts_tablet_manager.cc:1403] T 60a54e3cce4941c5bd4055e40aa1e4a3 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.000s
I20260807 13:50:20.529767 25498 raft_consensus.cc:359] T 60a54e3cce4941c5bd4055e40aa1e4a3 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:20.529991 25498 raft_consensus.cc:385] T 60a54e3cce4941c5bd4055e40aa1e4a3 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:20.530128 25498 raft_consensus.cc:740] T 60a54e3cce4941c5bd4055e40aa1e4a3 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8f3cec39fb4964a4fccfd5baa4077b, State: Initialized, Role: FOLLOWER
I20260807 13:50:20.530392 25498 consensus_queue.cc:260] T 60a54e3cce4941c5bd4055e40aa1e4a3 P fe8f3cec39fb4964a4fccfd5baa4077b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:20.530989 25498 ts_tablet_manager.cc:1434] T 60a54e3cce4941c5bd4055e40aa1e4a3 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:50:20.531157 25494 tablet_bootstrap.cc:492] T 5fc5d057ab2d4998b5c9c014802396e3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: No bootstrap required, opened a new log
I20260807 13:50:20.531431 25494 ts_tablet_manager.cc:1403] T 5fc5d057ab2d4998b5c9c014802396e3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.000s
I20260807 13:50:20.532207 25495 tablet_bootstrap.cc:654] T 5fc5d057ab2d4998b5c9c014802396e3 P d6d3ef3a235844cbbce1370e3aeb809f: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:20.532702 25494 raft_consensus.cc:359] T 5fc5d057ab2d4998b5c9c014802396e3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:20.533051 25494 raft_consensus.cc:385] T 5fc5d057ab2d4998b5c9c014802396e3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:20.533236 25494 raft_consensus.cc:740] T 5fc5d057ab2d4998b5c9c014802396e3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Initialized, Role: FOLLOWER
I20260807 13:50:20.533689 25494 consensus_queue.cc:260] T 5fc5d057ab2d4998b5c9c014802396e3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:20.535565 25494 ts_tablet_manager.cc:1434] T 5fc5d057ab2d4998b5c9c014802396e3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260807 13:50:20.536026 25494 tablet_bootstrap.cc:492] T 044e19d6fe5142d991949fdc3f9c73d3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Bootstrap starting.
I20260807 13:50:20.539630 25494 tablet_bootstrap.cc:654] T 044e19d6fe5142d991949fdc3f9c73d3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:20.546195 25494 tablet_bootstrap.cc:492] T 044e19d6fe5142d991949fdc3f9c73d3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: No bootstrap required, opened a new log
I20260807 13:50:20.549595 25496 tablet_bootstrap.cc:492] T 60a54e3cce4941c5bd4055e40aa1e4a3 P b890fcdb46dc4597bd9991906433c391: No bootstrap required, opened a new log
I20260807 13:50:20.549703 25493 tablet_bootstrap.cc:492] T 044e19d6fe5142d991949fdc3f9c73d3 P c8d4866795004103a4b0243906fe4d60: No bootstrap required, opened a new log
I20260807 13:50:20.549886 25496 ts_tablet_manager.cc:1403] T 60a54e3cce4941c5bd4055e40aa1e4a3 P b890fcdb46dc4597bd9991906433c391: Time spent bootstrapping tablet: real 0.028s user 0.012s sys 0.011s
I20260807 13:50:20.549897 25493 ts_tablet_manager.cc:1403] T 044e19d6fe5142d991949fdc3f9c73d3 P c8d4866795004103a4b0243906fe4d60: Time spent bootstrapping tablet: real 0.027s user 0.007s sys 0.002s
I20260807 13:50:20.550120 25492 tablet_bootstrap.cc:492] T 60a54e3cce4941c5bd4055e40aa1e4a3 P d1d858e0ace34c39a641ede1db85be11: No bootstrap required, opened a new log
I20260807 13:50:20.550386 25492 ts_tablet_manager.cc:1403] T 60a54e3cce4941c5bd4055e40aa1e4a3 P d1d858e0ace34c39a641ede1db85be11: Time spent bootstrapping tablet: real 0.040s user 0.005s sys 0.000s
I20260807 13:50:20.550963 25493 raft_consensus.cc:359] T 044e19d6fe5142d991949fdc3f9c73d3 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:20.550951 25496 raft_consensus.cc:359] T 60a54e3cce4941c5bd4055e40aa1e4a3 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:20.551182 25493 raft_consensus.cc:385] T 044e19d6fe5142d991949fdc3f9c73d3 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:20.551260 25493 raft_consensus.cc:740] T 044e19d6fe5142d991949fdc3f9c73d3 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8d4866795004103a4b0243906fe4d60, State: Initialized, Role: FOLLOWER
I20260807 13:50:20.551369 25496 raft_consensus.cc:385] T 60a54e3cce4941c5bd4055e40aa1e4a3 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:20.551527 25496 raft_consensus.cc:740] T 60a54e3cce4941c5bd4055e40aa1e4a3 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b890fcdb46dc4597bd9991906433c391, State: Initialized, Role: FOLLOWER
I20260807 13:50:20.551496 25492 raft_consensus.cc:359] T 60a54e3cce4941c5bd4055e40aa1e4a3 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:20.551776 25492 raft_consensus.cc:385] T 60a54e3cce4941c5bd4055e40aa1e4a3 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:20.552018 25492 raft_consensus.cc:740] T 60a54e3cce4941c5bd4055e40aa1e4a3 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Initialized, Role: FOLLOWER
I20260807 13:50:20.551923 25496 consensus_queue.cc:260] T 60a54e3cce4941c5bd4055e40aa1e4a3 P b890fcdb46dc4597bd9991906433c391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:20.552354 25493 consensus_queue.cc:260] T 044e19d6fe5142d991949fdc3f9c73d3 P c8d4866795004103a4b0243906fe4d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:20.552397 25492 consensus_queue.cc:260] T 60a54e3cce4941c5bd4055e40aa1e4a3 P d1d858e0ace34c39a641ede1db85be11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:20.553018 25493 ts_tablet_manager.cc:1434] T 044e19d6fe5142d991949fdc3f9c73d3 P c8d4866795004103a4b0243906fe4d60: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:50:20.553148 25492 ts_tablet_manager.cc:1434] T 60a54e3cce4941c5bd4055e40aa1e4a3 P d1d858e0ace34c39a641ede1db85be11: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:50:20.553376 25494 ts_tablet_manager.cc:1403] T 044e19d6fe5142d991949fdc3f9c73d3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.000s
I20260807 13:50:20.553790 25496 ts_tablet_manager.cc:1434] T 60a54e3cce4941c5bd4055e40aa1e4a3 P b890fcdb46dc4597bd9991906433c391: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260807 13:50:20.554280 25494 raft_consensus.cc:359] T 044e19d6fe5142d991949fdc3f9c73d3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:20.554497 25494 raft_consensus.cc:385] T 044e19d6fe5142d991949fdc3f9c73d3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:20.554566 25494 raft_consensus.cc:740] T 044e19d6fe5142d991949fdc3f9c73d3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Initialized, Role: FOLLOWER
I20260807 13:50:20.556569 25494 consensus_queue.cc:260] T 044e19d6fe5142d991949fdc3f9c73d3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:20.557274 25494 ts_tablet_manager.cc:1434] T 044e19d6fe5142d991949fdc3f9c73d3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260807 13:50:20.559643 25495 tablet_bootstrap.cc:492] T 5fc5d057ab2d4998b5c9c014802396e3 P d6d3ef3a235844cbbce1370e3aeb809f: No bootstrap required, opened a new log
I20260807 13:50:20.559875 25495 ts_tablet_manager.cc:1403] T 5fc5d057ab2d4998b5c9c014802396e3 P d6d3ef3a235844cbbce1370e3aeb809f: Time spent bootstrapping tablet: real 0.038s user 0.013s sys 0.011s
I20260807 13:50:20.561021 25495 raft_consensus.cc:359] T 5fc5d057ab2d4998b5c9c014802396e3 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:20.561293 25495 raft_consensus.cc:385] T 5fc5d057ab2d4998b5c9c014802396e3 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:20.561416 25495 raft_consensus.cc:740] T 5fc5d057ab2d4998b5c9c014802396e3 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d3ef3a235844cbbce1370e3aeb809f, State: Initialized, Role: FOLLOWER
I20260807 13:50:20.561731 25495 consensus_queue.cc:260] T 5fc5d057ab2d4998b5c9c014802396e3 P d6d3ef3a235844cbbce1370e3aeb809f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:20.562232 25495 ts_tablet_manager.cc:1434] T 5fc5d057ab2d4998b5c9c014802396e3 P d6d3ef3a235844cbbce1370e3aeb809f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:50:20.576309 25443 raft_consensus.cc:493] T 5fc5d057ab2d4998b5c9c014802396e3 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:20.576561 25443 raft_consensus.cc:515] T 5fc5d057ab2d4998b5c9c014802396e3 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:20.578297 25443 leader_election.cc:290] T 5fc5d057ab2d4998b5c9c014802396e3 P c8d4866795004103a4b0243906fe4d60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131), 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973)
I20260807 13:50:20.584923 25341 raft_consensus.cc:493] T 044e19d6fe5142d991949fdc3f9c73d3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:20.585191 25341 raft_consensus.cc:515] T 044e19d6fe5142d991949fdc3f9c73d3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:20.586038 25341 leader_election.cc:290] T 044e19d6fe5142d991949fdc3f9c73d3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641), d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131)
I20260807 13:50:20.586278 24955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc5d057ab2d4998b5c9c014802396e3" candidate_uuid: "c8d4866795004103a4b0243906fe4d60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" is_pre_election: true
I20260807 13:50:20.586428 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc5d057ab2d4998b5c9c014802396e3" candidate_uuid: "c8d4866795004103a4b0243906fe4d60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" is_pre_election: true
I20260807 13:50:20.586584 24955 raft_consensus.cc:2468] T 5fc5d057ab2d4998b5c9c014802396e3 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8d4866795004103a4b0243906fe4d60 in term 0.
I20260807 13:50:20.586576 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044e19d6fe5142d991949fdc3f9c73d3" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60" is_pre_election: true
I20260807 13:50:20.586665 24240 raft_consensus.cc:2468] T 5fc5d057ab2d4998b5c9c014802396e3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8d4866795004103a4b0243906fe4d60 in term 0.
I20260807 13:50:20.586687 24956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044e19d6fe5142d991949fdc3f9c73d3" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" is_pre_election: true
I20260807 13:50:20.586803 24601 raft_consensus.cc:2468] T 044e19d6fe5142d991949fdc3f9c73d3 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 0.
I20260807 13:50:20.586846 24956 raft_consensus.cc:2468] T 044e19d6fe5142d991949fdc3f9c73d3 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 0.
I20260807 13:50:20.587265 24512 leader_election.cc:304] T 5fc5d057ab2d4998b5c9c014802396e3 P c8d4866795004103a4b0243906fe4d60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8d4866795004103a4b0243906fe4d60, d6d3ef3a235844cbbce1370e3aeb809f; no voters:
I20260807 13:50:20.587389 24152 leader_election.cc:304] T 044e19d6fe5142d991949fdc3f9c73d3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, d6d3ef3a235844cbbce1370e3aeb809f; no voters:
I20260807 13:50:20.587695 25443 raft_consensus.cc:2804] T 5fc5d057ab2d4998b5c9c014802396e3 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:20.587812 25443 raft_consensus.cc:493] T 5fc5d057ab2d4998b5c9c014802396e3 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:20.587914 25443 raft_consensus.cc:3060] T 5fc5d057ab2d4998b5c9c014802396e3 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:20.587930 25341 raft_consensus.cc:2804] T 044e19d6fe5142d991949fdc3f9c73d3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:20.588037 25341 raft_consensus.cc:493] T 044e19d6fe5142d991949fdc3f9c73d3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:20.588148 25341 raft_consensus.cc:3060] T 044e19d6fe5142d991949fdc3f9c73d3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:20.590523 25341 raft_consensus.cc:515] T 044e19d6fe5142d991949fdc3f9c73d3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:20.590555 25443 raft_consensus.cc:515] T 5fc5d057ab2d4998b5c9c014802396e3 P c8d4866795004103a4b0243906fe4d60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:20.591173 25341 leader_election.cc:290] T 044e19d6fe5142d991949fdc3f9c73d3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 election: Requested vote from peers c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641), d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131)
I20260807 13:50:20.591210 25443 leader_election.cc:290] T 5fc5d057ab2d4998b5c9c014802396e3 P c8d4866795004103a4b0243906fe4d60 [CANDIDATE]: Term 1 election: Requested vote from peers d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131), 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973)
I20260807 13:50:20.591708 24955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044e19d6fe5142d991949fdc3f9c73d3" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d3ef3a235844cbbce1370e3aeb809f"
I20260807 13:50:20.591972 24955 raft_consensus.cc:3060] T 044e19d6fe5142d991949fdc3f9c73d3 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:20.592012 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "044e19d6fe5142d991949fdc3f9c73d3" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60"
I20260807 13:50:20.592119 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc5d057ab2d4998b5c9c014802396e3" candidate_uuid: "c8d4866795004103a4b0243906fe4d60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4"
I20260807 13:50:20.592222 24601 raft_consensus.cc:3060] T 044e19d6fe5142d991949fdc3f9c73d3 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:20.592317 24240 raft_consensus.cc:3060] T 5fc5d057ab2d4998b5c9c014802396e3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:20.591703 24956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc5d057ab2d4998b5c9c014802396e3" candidate_uuid: "c8d4866795004103a4b0243906fe4d60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d3ef3a235844cbbce1370e3aeb809f"
I20260807 13:50:20.593456 24956 raft_consensus.cc:3060] T 5fc5d057ab2d4998b5c9c014802396e3 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:20.595296 24601 raft_consensus.cc:2468] T 044e19d6fe5142d991949fdc3f9c73d3 P c8d4866795004103a4b0243906fe4d60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 1.
I20260807 13:50:20.595306 24955 raft_consensus.cc:2468] T 044e19d6fe5142d991949fdc3f9c73d3 P d6d3ef3a235844cbbce1370e3aeb809f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 1.
I20260807 13:50:20.595898 24152 leader_election.cc:304] T 044e19d6fe5142d991949fdc3f9c73d3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, d6d3ef3a235844cbbce1370e3aeb809f; no voters:
I20260807 13:50:20.596293 25341 raft_consensus.cc:2804] T 044e19d6fe5142d991949fdc3f9c73d3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:20.596493 24956 raft_consensus.cc:2468] T 5fc5d057ab2d4998b5c9c014802396e3 P d6d3ef3a235844cbbce1370e3aeb809f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d4866795004103a4b0243906fe4d60 in term 1.
I20260807 13:50:20.596684 25341 raft_consensus.cc:697] T 044e19d6fe5142d991949fdc3f9c73d3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 LEADER]: Becoming Leader. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Running, Role: LEADER
I20260807 13:50:20.597195 25341 consensus_queue.cc:237] T 044e19d6fe5142d991949fdc3f9c73d3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:20.597648 24512 leader_election.cc:304] T 5fc5d057ab2d4998b5c9c014802396e3 P c8d4866795004103a4b0243906fe4d60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8d4866795004103a4b0243906fe4d60, d6d3ef3a235844cbbce1370e3aeb809f; no voters:
I20260807 13:50:20.598011 25443 raft_consensus.cc:2804] T 5fc5d057ab2d4998b5c9c014802396e3 P c8d4866795004103a4b0243906fe4d60 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:20.598577 25443 raft_consensus.cc:697] T 5fc5d057ab2d4998b5c9c014802396e3 P c8d4866795004103a4b0243906fe4d60 [term 1 LEADER]: Becoming Leader. State: Replica: c8d4866795004103a4b0243906fe4d60, State: Running, Role: LEADER
I20260807 13:50:20.599467 25443 consensus_queue.cc:237] T 5fc5d057ab2d4998b5c9c014802396e3 P c8d4866795004103a4b0243906fe4d60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:20.599701 24240 raft_consensus.cc:2468] T 5fc5d057ab2d4998b5c9c014802396e3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d4866795004103a4b0243906fe4d60 in term 1.
I20260807 13:50:20.602730 24029 catalog_manager.cc:5697] T 044e19d6fe5142d991949fdc3f9c73d3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129). New cstate: current_term: 1 leader_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } health_report { overall_health: HEALTHY } } }
I20260807 13:50:20.603832 24034 catalog_manager.cc:5697] T 5fc5d057ab2d4998b5c9c014802396e3 P c8d4866795004103a4b0243906fe4d60 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8d4866795004103a4b0243906fe4d60 (127.23.107.131). New cstate: current_term: 1 leader_uuid: "c8d4866795004103a4b0243906fe4d60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } health_report { overall_health: UNKNOWN } } }
I20260807 13:50:20.679469 25284 raft_consensus.cc:493] T 60a54e3cce4941c5bd4055e40aa1e4a3 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:20.679750 25284 raft_consensus.cc:515] T 60a54e3cce4941c5bd4055e40aa1e4a3 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:20.680388 25284 leader_election.cc:290] T 60a54e3cce4941c5bd4055e40aa1e4a3 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619), b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189)
I20260807 13:50:20.681068 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a54e3cce4941c5bd4055e40aa1e4a3" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" is_pre_election: true
I20260807 13:50:20.681077 24777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a54e3cce4941c5bd4055e40aa1e4a3" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b890fcdb46dc4597bd9991906433c391" is_pre_election: true
I20260807 13:50:20.681357 24425 raft_consensus.cc:2468] T 60a54e3cce4941c5bd4055e40aa1e4a3 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 0.
I20260807 13:50:20.681375 24777 raft_consensus.cc:2468] T 60a54e3cce4941c5bd4055e40aa1e4a3 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 0.
I20260807 13:50:20.681964 25049 leader_election.cc:304] T 60a54e3cce4941c5bd4055e40aa1e4a3 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1d858e0ace34c39a641ede1db85be11, fe8f3cec39fb4964a4fccfd5baa4077b; no voters:
I20260807 13:50:20.682251 25284 raft_consensus.cc:2804] T 60a54e3cce4941c5bd4055e40aa1e4a3 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:20.682338 25284 raft_consensus.cc:493] T 60a54e3cce4941c5bd4055e40aa1e4a3 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:20.682420 25284 raft_consensus.cc:3060] T 60a54e3cce4941c5bd4055e40aa1e4a3 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:20.684348 25284 raft_consensus.cc:515] T 60a54e3cce4941c5bd4055e40aa1e4a3 P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:20.684983 25284 leader_election.cc:290] T 60a54e3cce4941c5bd4055e40aa1e4a3 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 election: Requested vote from peers fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619), b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189)
I20260807 13:50:20.685546 24777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a54e3cce4941c5bd4055e40aa1e4a3" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b890fcdb46dc4597bd9991906433c391"
I20260807 13:50:20.685592 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a54e3cce4941c5bd4055e40aa1e4a3" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b"
I20260807 13:50:20.685765 24777 raft_consensus.cc:3060] T 60a54e3cce4941c5bd4055e40aa1e4a3 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:20.685796 24425 raft_consensus.cc:3060] T 60a54e3cce4941c5bd4055e40aa1e4a3 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:20.688262 24777 raft_consensus.cc:2468] T 60a54e3cce4941c5bd4055e40aa1e4a3 P b890fcdb46dc4597bd9991906433c391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 1.
I20260807 13:50:20.688419 24425 raft_consensus.cc:2468] T 60a54e3cce4941c5bd4055e40aa1e4a3 P fe8f3cec39fb4964a4fccfd5baa4077b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 1.
I20260807 13:50:20.688840 25047 leader_election.cc:304] T 60a54e3cce4941c5bd4055e40aa1e4a3 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b890fcdb46dc4597bd9991906433c391, d1d858e0ace34c39a641ede1db85be11; no voters:
I20260807 13:50:20.689112 25284 raft_consensus.cc:2804] T 60a54e3cce4941c5bd4055e40aa1e4a3 P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:20.689284 25284 raft_consensus.cc:697] T 60a54e3cce4941c5bd4055e40aa1e4a3 P d1d858e0ace34c39a641ede1db85be11 [term 1 LEADER]: Becoming Leader. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Running, Role: LEADER
I20260807 13:50:20.689580 25284 consensus_queue.cc:237] T 60a54e3cce4941c5bd4055e40aa1e4a3 P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:20.692358 24034 catalog_manager.cc:5697] T 60a54e3cce4941c5bd4055e40aa1e4a3 P d1d858e0ace34c39a641ede1db85be11 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1d858e0ace34c39a641ede1db85be11 (127.23.107.134). New cstate: current_term: 1 leader_uuid: "d1d858e0ace34c39a641ede1db85be11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } health_report { overall_health: HEALTHY } } }
I20260807 13:50:21.031620 25341 consensus_queue.cc:1048] T 044e19d6fe5142d991949fdc3f9c73d3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:21.038280 25341 consensus_queue.cc:1048] T 044e19d6fe5142d991949fdc3f9c73d3 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:21.058312 25443 consensus_queue.cc:1048] T 5fc5d057ab2d4998b5c9c014802396e3 P c8d4866795004103a4b0243906fe4d60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:21.064342 25443 consensus_queue.cc:1048] T 5fc5d057ab2d4998b5c9c014802396e3 P c8d4866795004103a4b0243906fe4d60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:50:21.128456 25522 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:21.128824 25522 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_2'
I20260807 13:50:21.171034 25284 consensus_queue.cc:1048] T 60a54e3cce4941c5bd4055e40aa1e4a3 P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:21.180451 25404 consensus_queue.cc:1048] T 60a54e3cce4941c5bd4055e40aa1e4a3 P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 241.393 ms
time per row: 0.120697 ms
I20260807 13:50:21.591337 24031 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43984:
name: "rebalance_test_table_3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:50:21.601248 25107 tablet_service.cc:1511] Processing CreateTablet for tablet 51180d8d91ad4e7ca4deee717d7da8d9 (DEFAULT_TABLE table=rebalance_test_table_3 [id=0a3db85288a64c36a9cb13f994950dee]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:21.601658 24395 tablet_service.cc:1511] Processing CreateTablet for tablet 51180d8d91ad4e7ca4deee717d7da8d9 (DEFAULT_TABLE table=rebalance_test_table_3 [id=0a3db85288a64c36a9cb13f994950dee]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:21.601811 25107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51180d8d91ad4e7ca4deee717d7da8d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:21.602152 24395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51180d8d91ad4e7ca4deee717d7da8d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:21.603793 24572 tablet_service.cc:1511] Processing CreateTablet for tablet d8b5a7dedd094b9888dd41572e1d6b74 (DEFAULT_TABLE table=rebalance_test_table_3 [id=0a3db85288a64c36a9cb13f994950dee]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:21.604301 24572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b5a7dedd094b9888dd41572e1d6b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:21.606434 24751 tablet_service.cc:1511] Processing CreateTablet for tablet 51180d8d91ad4e7ca4deee717d7da8d9 (DEFAULT_TABLE table=rebalance_test_table_3 [id=0a3db85288a64c36a9cb13f994950dee]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:21.606860 24751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51180d8d91ad4e7ca4deee717d7da8d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:21.607705 24211 tablet_service.cc:1511] Processing CreateTablet for tablet d8b5a7dedd094b9888dd41572e1d6b74 (DEFAULT_TABLE table=rebalance_test_table_3 [id=0a3db85288a64c36a9cb13f994950dee]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:21.608175 24211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b5a7dedd094b9888dd41572e1d6b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:21.609833 24750 tablet_service.cc:1511] Processing CreateTablet for tablet 14836b0dd1a94ebb9420571ad1a6b3a4 (DEFAULT_TABLE table=rebalance_test_table_3 [id=0a3db85288a64c36a9cb13f994950dee]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:21.610229 24750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14836b0dd1a94ebb9420571ad1a6b3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:21.610307 24926 tablet_service.cc:1511] Processing CreateTablet for tablet d8b5a7dedd094b9888dd41572e1d6b74 (DEFAULT_TABLE table=rebalance_test_table_3 [id=0a3db85288a64c36a9cb13f994950dee]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:21.610757 24926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b5a7dedd094b9888dd41572e1d6b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:21.614099 25106 tablet_service.cc:1511] Processing CreateTablet for tablet 14836b0dd1a94ebb9420571ad1a6b3a4 (DEFAULT_TABLE table=rebalance_test_table_3 [id=0a3db85288a64c36a9cb13f994950dee]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:21.614535 25106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14836b0dd1a94ebb9420571ad1a6b3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:21.618212 24396 tablet_service.cc:1511] Processing CreateTablet for tablet 14836b0dd1a94ebb9420571ad1a6b3a4 (DEFAULT_TABLE table=rebalance_test_table_3 [id=0a3db85288a64c36a9cb13f994950dee]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:21.618306 25608 tablet_bootstrap.cc:492] T d8b5a7dedd094b9888dd41572e1d6b74 P c8d4866795004103a4b0243906fe4d60: Bootstrap starting.
I20260807 13:50:21.618705 24396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14836b0dd1a94ebb9420571ad1a6b3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:21.619174 25607 tablet_bootstrap.cc:492] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11: Bootstrap starting.
I20260807 13:50:21.621429 25607 tablet_bootstrap.cc:654] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:21.622991 25608 tablet_bootstrap.cc:654] T d8b5a7dedd094b9888dd41572e1d6b74 P c8d4866795004103a4b0243906fe4d60: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:21.629518 25608 tablet_bootstrap.cc:492] T d8b5a7dedd094b9888dd41572e1d6b74 P c8d4866795004103a4b0243906fe4d60: No bootstrap required, opened a new log
I20260807 13:50:21.630409 25608 ts_tablet_manager.cc:1403] T d8b5a7dedd094b9888dd41572e1d6b74 P c8d4866795004103a4b0243906fe4d60: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.000s
I20260807 13:50:21.631757 25608 raft_consensus.cc:359] T d8b5a7dedd094b9888dd41572e1d6b74 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:21.633968 25608 raft_consensus.cc:385] T d8b5a7dedd094b9888dd41572e1d6b74 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:21.634305 25608 raft_consensus.cc:740] T d8b5a7dedd094b9888dd41572e1d6b74 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8d4866795004103a4b0243906fe4d60, State: Initialized, Role: FOLLOWER
I20260807 13:50:21.635762 25611 tablet_bootstrap.cc:492] T d8b5a7dedd094b9888dd41572e1d6b74 P d6d3ef3a235844cbbce1370e3aeb809f: Bootstrap starting.
I20260807 13:50:21.635613 25608 consensus_queue.cc:260] T d8b5a7dedd094b9888dd41572e1d6b74 P c8d4866795004103a4b0243906fe4d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:21.637044 25617 tablet_bootstrap.cc:492] T 14836b0dd1a94ebb9420571ad1a6b3a4 P fe8f3cec39fb4964a4fccfd5baa4077b: Bootstrap starting.
I20260807 13:50:21.637871 25608 ts_tablet_manager.cc:1434] T d8b5a7dedd094b9888dd41572e1d6b74 P c8d4866795004103a4b0243906fe4d60: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260807 13:50:21.638273 25621 tablet_bootstrap.cc:492] T 14836b0dd1a94ebb9420571ad1a6b3a4 P b890fcdb46dc4597bd9991906433c391: Bootstrap starting.
I20260807 13:50:21.640473 25621 tablet_bootstrap.cc:654] T 14836b0dd1a94ebb9420571ad1a6b3a4 P b890fcdb46dc4597bd9991906433c391: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:21.641667 25611 tablet_bootstrap.cc:654] T d8b5a7dedd094b9888dd41572e1d6b74 P d6d3ef3a235844cbbce1370e3aeb809f: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:21.642031 25609 tablet_bootstrap.cc:492] T d8b5a7dedd094b9888dd41572e1d6b74 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Bootstrap starting.
I20260807 13:50:21.642602 25617 tablet_bootstrap.cc:654] T 14836b0dd1a94ebb9420571ad1a6b3a4 P fe8f3cec39fb4964a4fccfd5baa4077b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:21.644210 25609 tablet_bootstrap.cc:654] T d8b5a7dedd094b9888dd41572e1d6b74 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:21.646823 25607 tablet_bootstrap.cc:492] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11: No bootstrap required, opened a new log
I20260807 13:50:21.647042 25607 ts_tablet_manager.cc:1403] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.013s
I20260807 13:50:21.647712 25609 tablet_bootstrap.cc:492] T d8b5a7dedd094b9888dd41572e1d6b74 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: No bootstrap required, opened a new log
I20260807 13:50:21.647912 25609 ts_tablet_manager.cc:1403] T d8b5a7dedd094b9888dd41572e1d6b74 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 13:50:21.648113 25607 raft_consensus.cc:359] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:21.648406 25607 raft_consensus.cc:385] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:21.648554 25607 raft_consensus.cc:740] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Initialized, Role: FOLLOWER
I20260807 13:50:21.648947 25621 tablet_bootstrap.cc:492] T 14836b0dd1a94ebb9420571ad1a6b3a4 P b890fcdb46dc4597bd9991906433c391: No bootstrap required, opened a new log
I20260807 13:50:21.648901 25607 consensus_queue.cc:260] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:21.649145 25621 ts_tablet_manager.cc:1403] T 14836b0dd1a94ebb9420571ad1a6b3a4 P b890fcdb46dc4597bd9991906433c391: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260807 13:50:21.649430 25609 raft_consensus.cc:359] T d8b5a7dedd094b9888dd41572e1d6b74 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:21.649690 25609 raft_consensus.cc:385] T d8b5a7dedd094b9888dd41572e1d6b74 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:21.650190 25609 raft_consensus.cc:740] T d8b5a7dedd094b9888dd41572e1d6b74 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Initialized, Role: FOLLOWER
I20260807 13:50:21.650151 25621 raft_consensus.cc:359] T 14836b0dd1a94ebb9420571ad1a6b3a4 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:21.650520 25621 raft_consensus.cc:385] T 14836b0dd1a94ebb9420571ad1a6b3a4 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:21.650496 25609 consensus_queue.cc:260] T d8b5a7dedd094b9888dd41572e1d6b74 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:21.650655 25621 raft_consensus.cc:740] T 14836b0dd1a94ebb9420571ad1a6b3a4 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b890fcdb46dc4597bd9991906433c391, State: Initialized, Role: FOLLOWER
I20260807 13:50:21.650992 25621 consensus_queue.cc:260] T 14836b0dd1a94ebb9420571ad1a6b3a4 P b890fcdb46dc4597bd9991906433c391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:21.651140 25609 ts_tablet_manager.cc:1434] T d8b5a7dedd094b9888dd41572e1d6b74 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:50:21.651878 25621 ts_tablet_manager.cc:1434] T 14836b0dd1a94ebb9420571ad1a6b3a4 P b890fcdb46dc4597bd9991906433c391: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 13:50:21.652534 25621 tablet_bootstrap.cc:492] T 51180d8d91ad4e7ca4deee717d7da8d9 P b890fcdb46dc4597bd9991906433c391: Bootstrap starting.
I20260807 13:50:21.654567 25607 ts_tablet_manager.cc:1434] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260807 13:50:21.654917 25607 tablet_bootstrap.cc:492] T 14836b0dd1a94ebb9420571ad1a6b3a4 P d1d858e0ace34c39a641ede1db85be11: Bootstrap starting.
I20260807 13:50:21.655038 25617 tablet_bootstrap.cc:492] T 14836b0dd1a94ebb9420571ad1a6b3a4 P fe8f3cec39fb4964a4fccfd5baa4077b: No bootstrap required, opened a new log
I20260807 13:50:21.655226 25617 ts_tablet_manager.cc:1403] T 14836b0dd1a94ebb9420571ad1a6b3a4 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.005s
I20260807 13:50:21.656172 25617 raft_consensus.cc:359] T 14836b0dd1a94ebb9420571ad1a6b3a4 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:21.656767 25617 raft_consensus.cc:385] T 14836b0dd1a94ebb9420571ad1a6b3a4 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:21.656932 25617 raft_consensus.cc:740] T 14836b0dd1a94ebb9420571ad1a6b3a4 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8f3cec39fb4964a4fccfd5baa4077b, State: Initialized, Role: FOLLOWER
I20260807 13:50:21.657298 25617 consensus_queue.cc:260] T 14836b0dd1a94ebb9420571ad1a6b3a4 P fe8f3cec39fb4964a4fccfd5baa4077b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:21.658133 25617 ts_tablet_manager.cc:1434] T 14836b0dd1a94ebb9420571ad1a6b3a4 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260807 13:50:21.659641 25611 tablet_bootstrap.cc:492] T d8b5a7dedd094b9888dd41572e1d6b74 P d6d3ef3a235844cbbce1370e3aeb809f: No bootstrap required, opened a new log
I20260807 13:50:21.659828 25621 tablet_bootstrap.cc:654] T 51180d8d91ad4e7ca4deee717d7da8d9 P b890fcdb46dc4597bd9991906433c391: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:21.659935 25611 ts_tablet_manager.cc:1403] T d8b5a7dedd094b9888dd41572e1d6b74 P d6d3ef3a235844cbbce1370e3aeb809f: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.004s
I20260807 13:50:21.660982 25611 raft_consensus.cc:359] T d8b5a7dedd094b9888dd41572e1d6b74 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:21.661221 25611 raft_consensus.cc:385] T d8b5a7dedd094b9888dd41572e1d6b74 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:21.661329 25611 raft_consensus.cc:740] T d8b5a7dedd094b9888dd41572e1d6b74 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d3ef3a235844cbbce1370e3aeb809f, State: Initialized, Role: FOLLOWER
I20260807 13:50:21.661469 25607 tablet_bootstrap.cc:654] T 14836b0dd1a94ebb9420571ad1a6b3a4 P d1d858e0ace34c39a641ede1db85be11: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:21.661732 25611 consensus_queue.cc:260] T d8b5a7dedd094b9888dd41572e1d6b74 P d6d3ef3a235844cbbce1370e3aeb809f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:21.662740 25621 tablet_bootstrap.cc:492] T 51180d8d91ad4e7ca4deee717d7da8d9 P b890fcdb46dc4597bd9991906433c391: No bootstrap required, opened a new log
I20260807 13:50:21.662917 25621 ts_tablet_manager.cc:1403] T 51180d8d91ad4e7ca4deee717d7da8d9 P b890fcdb46dc4597bd9991906433c391: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.003s
I20260807 13:50:21.663450 25611 ts_tablet_manager.cc:1434] T d8b5a7dedd094b9888dd41572e1d6b74 P d6d3ef3a235844cbbce1370e3aeb809f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:50:21.663797 25621 raft_consensus.cc:359] T 51180d8d91ad4e7ca4deee717d7da8d9 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:21.664325 25617 tablet_bootstrap.cc:492] T 51180d8d91ad4e7ca4deee717d7da8d9 P fe8f3cec39fb4964a4fccfd5baa4077b: Bootstrap starting.
I20260807 13:50:21.665424 25621 raft_consensus.cc:385] T 51180d8d91ad4e7ca4deee717d7da8d9 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:21.665596 25621 raft_consensus.cc:740] T 51180d8d91ad4e7ca4deee717d7da8d9 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b890fcdb46dc4597bd9991906433c391, State: Initialized, Role: FOLLOWER
I20260807 13:50:21.665934 25621 consensus_queue.cc:260] T 51180d8d91ad4e7ca4deee717d7da8d9 P b890fcdb46dc4597bd9991906433c391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:21.666164 25617 tablet_bootstrap.cc:654] T 51180d8d91ad4e7ca4deee717d7da8d9 P fe8f3cec39fb4964a4fccfd5baa4077b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:21.666584 25621 ts_tablet_manager.cc:1434] T 51180d8d91ad4e7ca4deee717d7da8d9 P b890fcdb46dc4597bd9991906433c391: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260807 13:50:21.669742 25341 raft_consensus.cc:493] T d8b5a7dedd094b9888dd41572e1d6b74 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:21.669929 25341 raft_consensus.cc:515] T d8b5a7dedd094b9888dd41572e1d6b74 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:21.670862 25341 leader_election.cc:290] T d8b5a7dedd094b9888dd41572e1d6b74 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641), d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131)
I20260807 13:50:21.671804 24956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b5a7dedd094b9888dd41572e1d6b74" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" is_pre_election: true
I20260807 13:50:21.672065 24956 raft_consensus.cc:2468] T d8b5a7dedd094b9888dd41572e1d6b74 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 0.
I20260807 13:50:21.672137 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b5a7dedd094b9888dd41572e1d6b74" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60" is_pre_election: true
I20260807 13:50:21.672348 24601 raft_consensus.cc:2468] T d8b5a7dedd094b9888dd41572e1d6b74 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 0.
I20260807 13:50:21.672766 24152 leader_election.cc:304] T d8b5a7dedd094b9888dd41572e1d6b74 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, d6d3ef3a235844cbbce1370e3aeb809f; no voters:
I20260807 13:50:21.673118 25341 raft_consensus.cc:2804] T d8b5a7dedd094b9888dd41572e1d6b74 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:21.673281 25341 raft_consensus.cc:493] T d8b5a7dedd094b9888dd41572e1d6b74 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:21.673416 25341 raft_consensus.cc:3060] T d8b5a7dedd094b9888dd41572e1d6b74 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:21.674077 25607 tablet_bootstrap.cc:492] T 14836b0dd1a94ebb9420571ad1a6b3a4 P d1d858e0ace34c39a641ede1db85be11: No bootstrap required, opened a new log
I20260807 13:50:21.674273 25607 ts_tablet_manager.cc:1403] T 14836b0dd1a94ebb9420571ad1a6b3a4 P d1d858e0ace34c39a641ede1db85be11: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.010s
I20260807 13:50:21.675185 25607 raft_consensus.cc:359] T 14836b0dd1a94ebb9420571ad1a6b3a4 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:21.675398 25607 raft_consensus.cc:385] T 14836b0dd1a94ebb9420571ad1a6b3a4 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:21.675474 25607 raft_consensus.cc:740] T 14836b0dd1a94ebb9420571ad1a6b3a4 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Initialized, Role: FOLLOWER
I20260807 13:50:21.675735 25607 consensus_queue.cc:260] T 14836b0dd1a94ebb9420571ad1a6b3a4 P d1d858e0ace34c39a641ede1db85be11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:21.676142 25617 tablet_bootstrap.cc:492] T 51180d8d91ad4e7ca4deee717d7da8d9 P fe8f3cec39fb4964a4fccfd5baa4077b: No bootstrap required, opened a new log
I20260807 13:50:21.676208 25607 ts_tablet_manager.cc:1434] T 14836b0dd1a94ebb9420571ad1a6b3a4 P d1d858e0ace34c39a641ede1db85be11: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 13:50:21.676302 25617 ts_tablet_manager.cc:1403] T 51180d8d91ad4e7ca4deee717d7da8d9 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.009s
I20260807 13:50:21.676735 25341 raft_consensus.cc:515] T d8b5a7dedd094b9888dd41572e1d6b74 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:21.677168 25617 raft_consensus.cc:359] T 51180d8d91ad4e7ca4deee717d7da8d9 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:21.677390 25617 raft_consensus.cc:385] T 51180d8d91ad4e7ca4deee717d7da8d9 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:21.677469 25617 raft_consensus.cc:740] T 51180d8d91ad4e7ca4deee717d7da8d9 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8f3cec39fb4964a4fccfd5baa4077b, State: Initialized, Role: FOLLOWER
I20260807 13:50:21.677485 25341 leader_election.cc:290] T d8b5a7dedd094b9888dd41572e1d6b74 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 election: Requested vote from peers c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641), d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131)
I20260807 13:50:21.677788 25617 consensus_queue.cc:260] T 51180d8d91ad4e7ca4deee717d7da8d9 P fe8f3cec39fb4964a4fccfd5baa4077b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:21.678093 24956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b5a7dedd094b9888dd41572e1d6b74" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d3ef3a235844cbbce1370e3aeb809f"
I20260807 13:50:21.678329 24956 raft_consensus.cc:3060] T d8b5a7dedd094b9888dd41572e1d6b74 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:21.678570 25617 ts_tablet_manager.cc:1434] T 51180d8d91ad4e7ca4deee717d7da8d9 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 13:50:21.680393 24956 raft_consensus.cc:2468] T d8b5a7dedd094b9888dd41572e1d6b74 P d6d3ef3a235844cbbce1370e3aeb809f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 1.
I20260807 13:50:21.680873 24152 leader_election.cc:304] T d8b5a7dedd094b9888dd41572e1d6b74 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, d6d3ef3a235844cbbce1370e3aeb809f; no voters:
I20260807 13:50:21.681226 25341 raft_consensus.cc:2804] T d8b5a7dedd094b9888dd41572e1d6b74 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:21.681408 25341 raft_consensus.cc:697] T d8b5a7dedd094b9888dd41572e1d6b74 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 LEADER]: Becoming Leader. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Running, Role: LEADER
I20260807 13:50:21.681377 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b5a7dedd094b9888dd41572e1d6b74" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60"
I20260807 13:50:21.681600 24601 raft_consensus.cc:3060] T d8b5a7dedd094b9888dd41572e1d6b74 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:21.681926 25341 consensus_queue.cc:237] T d8b5a7dedd094b9888dd41572e1d6b74 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:21.684369 24601 raft_consensus.cc:2468] T d8b5a7dedd094b9888dd41572e1d6b74 P c8d4866795004103a4b0243906fe4d60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 1.
I20260807 13:50:21.685252 24034 catalog_manager.cc:5697] T d8b5a7dedd094b9888dd41572e1d6b74 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129). New cstate: current_term: 1 leader_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } health_report { overall_health: UNKNOWN } } }
I20260807 13:50:21.982368 25591 raft_consensus.cc:493] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:21.982583 25591 raft_consensus.cc:515] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:21.983423 25591 leader_election.cc:290] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619), b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189)
I20260807 13:50:21.984094 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51180d8d91ad4e7ca4deee717d7da8d9" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" is_pre_election: true
I20260807 13:50:21.984113 24777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51180d8d91ad4e7ca4deee717d7da8d9" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b890fcdb46dc4597bd9991906433c391" is_pre_election: true
I20260807 13:50:21.984382 24425 raft_consensus.cc:2468] T 51180d8d91ad4e7ca4deee717d7da8d9 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 0.
I20260807 13:50:21.984401 24777 raft_consensus.cc:2468] T 51180d8d91ad4e7ca4deee717d7da8d9 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 0.
I20260807 13:50:21.985044 25047 leader_election.cc:304] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b890fcdb46dc4597bd9991906433c391, d1d858e0ace34c39a641ede1db85be11; no voters:
I20260807 13:50:21.985392 25591 raft_consensus.cc:2804] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:21.985551 25591 raft_consensus.cc:493] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:21.985698 25591 raft_consensus.cc:3060] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:21.987691 25591 raft_consensus.cc:515] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:21.988346 25591 leader_election.cc:290] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 election: Requested vote from peers fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619), b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189)
I20260807 13:50:21.988902 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51180d8d91ad4e7ca4deee717d7da8d9" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b"
I20260807 13:50:21.988925 24777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51180d8d91ad4e7ca4deee717d7da8d9" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b890fcdb46dc4597bd9991906433c391"
I20260807 13:50:21.989136 24425 raft_consensus.cc:3060] T 51180d8d91ad4e7ca4deee717d7da8d9 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:21.989161 24777 raft_consensus.cc:3060] T 51180d8d91ad4e7ca4deee717d7da8d9 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:21.991305 24777 raft_consensus.cc:2468] T 51180d8d91ad4e7ca4deee717d7da8d9 P b890fcdb46dc4597bd9991906433c391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 1.
I20260807 13:50:21.991791 25047 leader_election.cc:304] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b890fcdb46dc4597bd9991906433c391, d1d858e0ace34c39a641ede1db85be11; no voters:
I20260807 13:50:21.992098 25591 raft_consensus.cc:2804] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:21.992225 24425 raft_consensus.cc:2468] T 51180d8d91ad4e7ca4deee717d7da8d9 P fe8f3cec39fb4964a4fccfd5baa4077b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 1.
I20260807 13:50:21.992631 25591 raft_consensus.cc:697] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11 [term 1 LEADER]: Becoming Leader. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Running, Role: LEADER
I20260807 13:50:21.992985 25591 consensus_queue.cc:237] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:21.996381 24034 catalog_manager.cc:5697] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1d858e0ace34c39a641ede1db85be11 (127.23.107.134). New cstate: current_term: 1 leader_uuid: "d1d858e0ace34c39a641ede1db85be11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } health_report { overall_health: UNKNOWN } } }
I20260807 13:50:22.003671 25470 raft_consensus.cc:493] T 14836b0dd1a94ebb9420571ad1a6b3a4 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:22.003901 25470 raft_consensus.cc:515] T 14836b0dd1a94ebb9420571ad1a6b3a4 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:22.004726 25470 leader_election.cc:290] T 14836b0dd1a94ebb9420571ad1a6b3a4 P b890fcdb46dc4597bd9991906433c391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619), d1d858e0ace34c39a641ede1db85be11 (127.23.107.134:46341)
I20260807 13:50:22.005231 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14836b0dd1a94ebb9420571ad1a6b3a4" candidate_uuid: "b890fcdb46dc4597bd9991906433c391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" is_pre_election: true
I20260807 13:50:22.005468 25131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14836b0dd1a94ebb9420571ad1a6b3a4" candidate_uuid: "b890fcdb46dc4597bd9991906433c391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1d858e0ace34c39a641ede1db85be11" is_pre_election: true
I20260807 13:50:22.005517 24425 raft_consensus.cc:2468] T 14836b0dd1a94ebb9420571ad1a6b3a4 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b890fcdb46dc4597bd9991906433c391 in term 0.
I20260807 13:50:22.005640 25131 raft_consensus.cc:2468] T 14836b0dd1a94ebb9420571ad1a6b3a4 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b890fcdb46dc4597bd9991906433c391 in term 0.
I20260807 13:50:22.005990 24692 leader_election.cc:304] T 14836b0dd1a94ebb9420571ad1a6b3a4 P b890fcdb46dc4597bd9991906433c391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b890fcdb46dc4597bd9991906433c391, fe8f3cec39fb4964a4fccfd5baa4077b; no voters:
I20260807 13:50:22.006254 25470 raft_consensus.cc:2804] T 14836b0dd1a94ebb9420571ad1a6b3a4 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:22.006402 25470 raft_consensus.cc:493] T 14836b0dd1a94ebb9420571ad1a6b3a4 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:22.006570 25470 raft_consensus.cc:3060] T 14836b0dd1a94ebb9420571ad1a6b3a4 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:22.008579 25470 raft_consensus.cc:515] T 14836b0dd1a94ebb9420571ad1a6b3a4 P b890fcdb46dc4597bd9991906433c391 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:22.009212 25470 leader_election.cc:290] T 14836b0dd1a94ebb9420571ad1a6b3a4 P b890fcdb46dc4597bd9991906433c391 [CANDIDATE]: Term 1 election: Requested vote from peers fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619), d1d858e0ace34c39a641ede1db85be11 (127.23.107.134:46341)
I20260807 13:50:22.009774 25131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14836b0dd1a94ebb9420571ad1a6b3a4" candidate_uuid: "b890fcdb46dc4597bd9991906433c391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1d858e0ace34c39a641ede1db85be11"
I20260807 13:50:22.009827 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14836b0dd1a94ebb9420571ad1a6b3a4" candidate_uuid: "b890fcdb46dc4597bd9991906433c391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b"
I20260807 13:50:22.009971 25131 raft_consensus.cc:3060] T 14836b0dd1a94ebb9420571ad1a6b3a4 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:22.010052 24425 raft_consensus.cc:3060] T 14836b0dd1a94ebb9420571ad1a6b3a4 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:22.012331 25131 raft_consensus.cc:2468] T 14836b0dd1a94ebb9420571ad1a6b3a4 P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b890fcdb46dc4597bd9991906433c391 in term 1.
I20260807 13:50:22.012456 24425 raft_consensus.cc:2468] T 14836b0dd1a94ebb9420571ad1a6b3a4 P fe8f3cec39fb4964a4fccfd5baa4077b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b890fcdb46dc4597bd9991906433c391 in term 1.
I20260807 13:50:22.012959 24688 leader_election.cc:304] T 14836b0dd1a94ebb9420571ad1a6b3a4 P b890fcdb46dc4597bd9991906433c391 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: b890fcdb46dc4597bd9991906433c391, d1d858e0ace34c39a641ede1db85be11, fe8f3cec39fb4964a4fccfd5baa4077b; no voters:
I20260807 13:50:22.013324 25470 raft_consensus.cc:2804] T 14836b0dd1a94ebb9420571ad1a6b3a4 P b890fcdb46dc4597bd9991906433c391 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:22.013760 25470 raft_consensus.cc:697] T 14836b0dd1a94ebb9420571ad1a6b3a4 P b890fcdb46dc4597bd9991906433c391 [term 1 LEADER]: Becoming Leader. State: Replica: b890fcdb46dc4597bd9991906433c391, State: Running, Role: LEADER
I20260807 13:50:22.014081 25470 consensus_queue.cc:237] T 14836b0dd1a94ebb9420571ad1a6b3a4 P b890fcdb46dc4597bd9991906433c391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:22.017134 24034 catalog_manager.cc:5697] T 14836b0dd1a94ebb9420571ad1a6b3a4 P b890fcdb46dc4597bd9991906433c391 reported cstate change: term changed from 0 to 1, leader changed from <none> to b890fcdb46dc4597bd9991906433c391 (127.23.107.132). New cstate: current_term: 1 leader_uuid: "b890fcdb46dc4597bd9991906433c391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } health_report { overall_health: HEALTHY } } }
I20260807 13:50:22.264348 25440 consensus_queue.cc:1048] T d8b5a7dedd094b9888dd41572e1d6b74 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:22.274591 25645 consensus_queue.cc:1048] T d8b5a7dedd094b9888dd41572e1d6b74 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:22.403141 25591 consensus_queue.cc:1048] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:22.426246 25659 consensus_queue.cc:1048] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:50:22.480487 25638 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:22.480980 25638 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_3'
I20260807 13:50:22.540256 25470 consensus_queue.cc:1048] T 14836b0dd1a94ebb9420571ad1a6b3a4 P b890fcdb46dc4597bd9991906433c391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:22.546092 25696 consensus_queue.cc:1048] T 14836b0dd1a94ebb9420571ad1a6b3a4 P b890fcdb46dc4597bd9991906433c391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 269.963 ms
time per row: 0.134981 ms
I20260807 13:50:22.933296 24034 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43984:
name: "rebalance_test_table_4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:50:22.943159 24211 tablet_service.cc:1511] Processing CreateTablet for tablet faaa7f569d5e4da78d315dc7ace6e8fc (DEFAULT_TABLE table=rebalance_test_table_4 [id=12f86ab3990c422ea29dfced90afaf3f]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:22.943722 24211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faaa7f569d5e4da78d315dc7ace6e8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:22.943779 24572 tablet_service.cc:1511] Processing CreateTablet for tablet faaa7f569d5e4da78d315dc7ace6e8fc (DEFAULT_TABLE table=rebalance_test_table_4 [id=12f86ab3990c422ea29dfced90afaf3f]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:22.944058 24926 tablet_service.cc:1511] Processing CreateTablet for tablet faaa7f569d5e4da78d315dc7ace6e8fc (DEFAULT_TABLE table=rebalance_test_table_4 [id=12f86ab3990c422ea29dfced90afaf3f]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:22.944257 24572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faaa7f569d5e4da78d315dc7ace6e8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:22.944527 24926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faaa7f569d5e4da78d315dc7ace6e8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:22.946523 24210 tablet_service.cc:1511] Processing CreateTablet for tablet 5bee0994b83f4c8486fa4fa7154787e4 (DEFAULT_TABLE table=rebalance_test_table_4 [id=12f86ab3990c422ea29dfced90afaf3f]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:22.946923 24210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bee0994b83f4c8486fa4fa7154787e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:22.950404 24396 tablet_service.cc:1511] Processing CreateTablet for tablet f8a72430e5c948d09418a4ff39bd4db5 (DEFAULT_TABLE table=rebalance_test_table_4 [id=12f86ab3990c422ea29dfced90afaf3f]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:22.950850 24396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8a72430e5c948d09418a4ff39bd4db5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:22.950917 25106 tablet_service.cc:1511] Processing CreateTablet for tablet f8a72430e5c948d09418a4ff39bd4db5 (DEFAULT_TABLE table=rebalance_test_table_4 [id=12f86ab3990c422ea29dfced90afaf3f]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:22.951330 25106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8a72430e5c948d09418a4ff39bd4db5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:22.953994 24573 tablet_service.cc:1511] Processing CreateTablet for tablet 5bee0994b83f4c8486fa4fa7154787e4 (DEFAULT_TABLE table=rebalance_test_table_4 [id=12f86ab3990c422ea29dfced90afaf3f]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:22.954229 24927 tablet_service.cc:1511] Processing CreateTablet for tablet 5bee0994b83f4c8486fa4fa7154787e4 (DEFAULT_TABLE table=rebalance_test_table_4 [id=12f86ab3990c422ea29dfced90afaf3f]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:22.954424 24573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bee0994b83f4c8486fa4fa7154787e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:22.954623 24927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bee0994b83f4c8486fa4fa7154787e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:22.957831 24750 tablet_service.cc:1511] Processing CreateTablet for tablet f8a72430e5c948d09418a4ff39bd4db5 (DEFAULT_TABLE table=rebalance_test_table_4 [id=12f86ab3990c422ea29dfced90afaf3f]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:22.958302 24750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8a72430e5c948d09418a4ff39bd4db5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:22.979180 25752 tablet_bootstrap.cc:492] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11: Bootstrap starting.
I20260807 13:50:22.980706 25753 tablet_bootstrap.cc:492] T faaa7f569d5e4da78d315dc7ace6e8fc P d6d3ef3a235844cbbce1370e3aeb809f: Bootstrap starting.
I20260807 13:50:22.983317 25753 tablet_bootstrap.cc:654] T faaa7f569d5e4da78d315dc7ace6e8fc P d6d3ef3a235844cbbce1370e3aeb809f: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:22.985795 25746 tablet_bootstrap.cc:492] T faaa7f569d5e4da78d315dc7ace6e8fc P c8d4866795004103a4b0243906fe4d60: Bootstrap starting.
I20260807 13:50:22.986517 25750 tablet_bootstrap.cc:492] T f8a72430e5c948d09418a4ff39bd4db5 P fe8f3cec39fb4964a4fccfd5baa4077b: Bootstrap starting.
I20260807 13:50:22.987639 25748 tablet_bootstrap.cc:492] T f8a72430e5c948d09418a4ff39bd4db5 P b890fcdb46dc4597bd9991906433c391: Bootstrap starting.
I20260807 13:50:22.988832 25744 tablet_bootstrap.cc:492] T faaa7f569d5e4da78d315dc7ace6e8fc P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Bootstrap starting.
I20260807 13:50:22.989885 25746 tablet_bootstrap.cc:654] T faaa7f569d5e4da78d315dc7ace6e8fc P c8d4866795004103a4b0243906fe4d60: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:22.989915 25750 tablet_bootstrap.cc:654] T f8a72430e5c948d09418a4ff39bd4db5 P fe8f3cec39fb4964a4fccfd5baa4077b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:22.993530 25748 tablet_bootstrap.cc:654] T f8a72430e5c948d09418a4ff39bd4db5 P b890fcdb46dc4597bd9991906433c391: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:22.995816 25744 tablet_bootstrap.cc:654] T faaa7f569d5e4da78d315dc7ace6e8fc P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:23.002558 25746 tablet_bootstrap.cc:492] T faaa7f569d5e4da78d315dc7ace6e8fc P c8d4866795004103a4b0243906fe4d60: No bootstrap required, opened a new log
I20260807 13:50:23.002753 25746 ts_tablet_manager.cc:1403] T faaa7f569d5e4da78d315dc7ace6e8fc P c8d4866795004103a4b0243906fe4d60: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.003s
I20260807 13:50:23.003027 25752 tablet_bootstrap.cc:654] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:23.003221 25750 tablet_bootstrap.cc:492] T f8a72430e5c948d09418a4ff39bd4db5 P fe8f3cec39fb4964a4fccfd5baa4077b: No bootstrap required, opened a new log
I20260807 13:50:23.003382 25750 ts_tablet_manager.cc:1403] T f8a72430e5c948d09418a4ff39bd4db5 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.000s
I20260807 13:50:23.003789 25746 raft_consensus.cc:359] T faaa7f569d5e4da78d315dc7ace6e8fc P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:23.004016 25746 raft_consensus.cc:385] T faaa7f569d5e4da78d315dc7ace6e8fc P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:23.004113 25746 raft_consensus.cc:740] T faaa7f569d5e4da78d315dc7ace6e8fc P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8d4866795004103a4b0243906fe4d60, State: Initialized, Role: FOLLOWER
I20260807 13:50:23.004385 25750 raft_consensus.cc:359] T f8a72430e5c948d09418a4ff39bd4db5 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } }
I20260807 13:50:23.004602 25750 raft_consensus.cc:385] T f8a72430e5c948d09418a4ff39bd4db5 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:23.004510 25746 consensus_queue.cc:260] T faaa7f569d5e4da78d315dc7ace6e8fc P c8d4866795004103a4b0243906fe4d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:23.004705 25750 raft_consensus.cc:740] T f8a72430e5c948d09418a4ff39bd4db5 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8f3cec39fb4964a4fccfd5baa4077b, State: Initialized, Role: FOLLOWER
I20260807 13:50:23.006776 25753 tablet_bootstrap.cc:492] T faaa7f569d5e4da78d315dc7ace6e8fc P d6d3ef3a235844cbbce1370e3aeb809f: No bootstrap required, opened a new log
I20260807 13:50:23.007004 25753 ts_tablet_manager.cc:1403] T faaa7f569d5e4da78d315dc7ace6e8fc P d6d3ef3a235844cbbce1370e3aeb809f: Time spent bootstrapping tablet: real 0.026s user 0.008s sys 0.000s
I20260807 13:50:23.007398 25750 consensus_queue.cc:260] T f8a72430e5c948d09418a4ff39bd4db5 P fe8f3cec39fb4964a4fccfd5baa4077b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } }
I20260807 13:50:23.008040 25753 raft_consensus.cc:359] T faaa7f569d5e4da78d315dc7ace6e8fc P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:23.008307 25753 raft_consensus.cc:385] T faaa7f569d5e4da78d315dc7ace6e8fc P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:23.008455 25753 raft_consensus.cc:740] T faaa7f569d5e4da78d315dc7ace6e8fc P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d3ef3a235844cbbce1370e3aeb809f, State: Initialized, Role: FOLLOWER
I20260807 13:50:23.009111 25750 ts_tablet_manager.cc:1434] T f8a72430e5c948d09418a4ff39bd4db5 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260807 13:50:23.009627 25753 consensus_queue.cc:260] T faaa7f569d5e4da78d315dc7ace6e8fc P d6d3ef3a235844cbbce1370e3aeb809f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:23.010392 25746 ts_tablet_manager.cc:1434] T faaa7f569d5e4da78d315dc7ace6e8fc P c8d4866795004103a4b0243906fe4d60: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260807 13:50:23.012394 25752 tablet_bootstrap.cc:492] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11: No bootstrap required, opened a new log
I20260807 13:50:23.012588 25752 ts_tablet_manager.cc:1403] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.002s
I20260807 13:50:23.013477 25746 tablet_bootstrap.cc:492] T 5bee0994b83f4c8486fa4fa7154787e4 P c8d4866795004103a4b0243906fe4d60: Bootstrap starting.
I20260807 13:50:23.013595 25752 raft_consensus.cc:359] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } }
I20260807 13:50:23.013809 25752 raft_consensus.cc:385] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:23.013877 25748 tablet_bootstrap.cc:492] T f8a72430e5c948d09418a4ff39bd4db5 P b890fcdb46dc4597bd9991906433c391: No bootstrap required, opened a new log
I20260807 13:50:23.013908 25752 raft_consensus.cc:740] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Initialized, Role: FOLLOWER
I20260807 13:50:23.014046 25748 ts_tablet_manager.cc:1403] T f8a72430e5c948d09418a4ff39bd4db5 P b890fcdb46dc4597bd9991906433c391: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.004s
I20260807 13:50:23.014191 25752 consensus_queue.cc:260] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } }
I20260807 13:50:23.014895 25748 raft_consensus.cc:359] T f8a72430e5c948d09418a4ff39bd4db5 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } }
I20260807 13:50:23.015136 25748 raft_consensus.cc:385] T f8a72430e5c948d09418a4ff39bd4db5 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:23.015421 25748 raft_consensus.cc:740] T f8a72430e5c948d09418a4ff39bd4db5 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b890fcdb46dc4597bd9991906433c391, State: Initialized, Role: FOLLOWER
I20260807 13:50:23.015816 25752 ts_tablet_manager.cc:1434] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260807 13:50:23.015726 25748 consensus_queue.cc:260] T f8a72430e5c948d09418a4ff39bd4db5 P b890fcdb46dc4597bd9991906433c391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } }
I20260807 13:50:23.016446 25748 ts_tablet_manager.cc:1434] T f8a72430e5c948d09418a4ff39bd4db5 P b890fcdb46dc4597bd9991906433c391: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 13:50:23.017980 25744 tablet_bootstrap.cc:492] T faaa7f569d5e4da78d315dc7ace6e8fc P 4d09f7af7d9d4d07bfb2114f45e9e8a4: No bootstrap required, opened a new log
I20260807 13:50:23.018217 25744 ts_tablet_manager.cc:1403] T faaa7f569d5e4da78d315dc7ace6e8fc P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent bootstrapping tablet: real 0.030s user 0.006s sys 0.000s
I20260807 13:50:23.018723 25746 tablet_bootstrap.cc:654] T 5bee0994b83f4c8486fa4fa7154787e4 P c8d4866795004103a4b0243906fe4d60: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:23.022538 25744 raft_consensus.cc:359] T faaa7f569d5e4da78d315dc7ace6e8fc P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:23.022827 25744 raft_consensus.cc:385] T faaa7f569d5e4da78d315dc7ace6e8fc P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:23.022955 25744 raft_consensus.cc:740] T faaa7f569d5e4da78d315dc7ace6e8fc P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Initialized, Role: FOLLOWER
I20260807 13:50:23.023255 25744 consensus_queue.cc:260] T faaa7f569d5e4da78d315dc7ace6e8fc P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:23.023927 25744 ts_tablet_manager.cc:1434] T faaa7f569d5e4da78d315dc7ace6e8fc P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:50:23.024279 25744 tablet_bootstrap.cc:492] T 5bee0994b83f4c8486fa4fa7154787e4 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Bootstrap starting.
I20260807 13:50:23.026264 25744 tablet_bootstrap.cc:654] T 5bee0994b83f4c8486fa4fa7154787e4 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:23.027122 25753 ts_tablet_manager.cc:1434] T faaa7f569d5e4da78d315dc7ace6e8fc P d6d3ef3a235844cbbce1370e3aeb809f: Time spent starting tablet: real 0.020s user 0.002s sys 0.005s
I20260807 13:50:23.028119 25753 tablet_bootstrap.cc:492] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f: Bootstrap starting.
I20260807 13:50:23.029886 25753 tablet_bootstrap.cc:654] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:23.039214 25746 tablet_bootstrap.cc:492] T 5bee0994b83f4c8486fa4fa7154787e4 P c8d4866795004103a4b0243906fe4d60: No bootstrap required, opened a new log
I20260807 13:50:23.039418 25746 ts_tablet_manager.cc:1403] T 5bee0994b83f4c8486fa4fa7154787e4 P c8d4866795004103a4b0243906fe4d60: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.004s
I20260807 13:50:23.040320 25746 raft_consensus.cc:359] T 5bee0994b83f4c8486fa4fa7154787e4 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:23.040597 25746 raft_consensus.cc:385] T 5bee0994b83f4c8486fa4fa7154787e4 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:23.040689 25746 raft_consensus.cc:740] T 5bee0994b83f4c8486fa4fa7154787e4 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8d4866795004103a4b0243906fe4d60, State: Initialized, Role: FOLLOWER
I20260807 13:50:23.040983 25753 tablet_bootstrap.cc:492] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f: No bootstrap required, opened a new log
I20260807 13:50:23.041011 25746 consensus_queue.cc:260] T 5bee0994b83f4c8486fa4fa7154787e4 P c8d4866795004103a4b0243906fe4d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:23.041203 25753 ts_tablet_manager.cc:1403] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.006s
I20260807 13:50:23.042112 25753 raft_consensus.cc:359] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:23.042361 25753 raft_consensus.cc:385] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:23.042515 25746 ts_tablet_manager.cc:1434] T 5bee0994b83f4c8486fa4fa7154787e4 P c8d4866795004103a4b0243906fe4d60: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260807 13:50:23.042541 25753 raft_consensus.cc:740] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d3ef3a235844cbbce1370e3aeb809f, State: Initialized, Role: FOLLOWER
I20260807 13:50:23.042867 25753 consensus_queue.cc:260] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:23.043401 25753 ts_tablet_manager.cc:1434] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 13:50:23.045570 25744 tablet_bootstrap.cc:492] T 5bee0994b83f4c8486fa4fa7154787e4 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: No bootstrap required, opened a new log
I20260807 13:50:23.045774 25744 ts_tablet_manager.cc:1403] T 5bee0994b83f4c8486fa4fa7154787e4 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent bootstrapping tablet: real 0.022s user 0.008s sys 0.000s
I20260807 13:50:23.046682 25744 raft_consensus.cc:359] T 5bee0994b83f4c8486fa4fa7154787e4 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:23.046934 25744 raft_consensus.cc:385] T 5bee0994b83f4c8486fa4fa7154787e4 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:23.047015 25744 raft_consensus.cc:740] T 5bee0994b83f4c8486fa4fa7154787e4 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Initialized, Role: FOLLOWER
I20260807 13:50:23.047297 25744 consensus_queue.cc:260] T 5bee0994b83f4c8486fa4fa7154787e4 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:23.047849 25744 ts_tablet_manager.cc:1434] T 5bee0994b83f4c8486fa4fa7154787e4 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 13:50:23.111629 25717 raft_consensus.cc:493] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:23.111883 25717 raft_consensus.cc:515] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } }
I20260807 13:50:23.112862 25717 leader_election.cc:290] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189), fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619)
I20260807 13:50:23.113593 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a72430e5c948d09418a4ff39bd4db5" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" is_pre_election: true
I20260807 13:50:23.113612 24775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a72430e5c948d09418a4ff39bd4db5" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b890fcdb46dc4597bd9991906433c391" is_pre_election: true
I20260807 13:50:23.113893 24775 raft_consensus.cc:2468] T f8a72430e5c948d09418a4ff39bd4db5 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 0.
I20260807 13:50:23.113893 24425 raft_consensus.cc:2468] T f8a72430e5c948d09418a4ff39bd4db5 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 0.
I20260807 13:50:23.114502 25047 leader_election.cc:304] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b890fcdb46dc4597bd9991906433c391, d1d858e0ace34c39a641ede1db85be11; no voters:
I20260807 13:50:23.114816 25717 raft_consensus.cc:2804] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:23.114943 25717 raft_consensus.cc:493] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:23.115036 25717 raft_consensus.cc:3060] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:23.117162 25717 raft_consensus.cc:515] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } }
I20260807 13:50:23.117897 25717 leader_election.cc:290] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 election: Requested vote from peers b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189), fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619)
I20260807 13:50:23.118487 24775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a72430e5c948d09418a4ff39bd4db5" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b890fcdb46dc4597bd9991906433c391"
I20260807 13:50:23.118549 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a72430e5c948d09418a4ff39bd4db5" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b"
I20260807 13:50:23.118741 24775 raft_consensus.cc:3060] T f8a72430e5c948d09418a4ff39bd4db5 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:23.118763 24425 raft_consensus.cc:3060] T f8a72430e5c948d09418a4ff39bd4db5 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:23.122089 24775 raft_consensus.cc:2468] T f8a72430e5c948d09418a4ff39bd4db5 P b890fcdb46dc4597bd9991906433c391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 1.
I20260807 13:50:23.122071 24425 raft_consensus.cc:2468] T f8a72430e5c948d09418a4ff39bd4db5 P fe8f3cec39fb4964a4fccfd5baa4077b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 1.
I20260807 13:50:23.122622 25049 leader_election.cc:304] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1d858e0ace34c39a641ede1db85be11, fe8f3cec39fb4964a4fccfd5baa4077b; no voters:
I20260807 13:50:23.122946 25717 raft_consensus.cc:2804] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:23.123134 25717 raft_consensus.cc:697] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11 [term 1 LEADER]: Becoming Leader. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Running, Role: LEADER
I20260807 13:50:23.123462 25717 consensus_queue.cc:237] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } }
I20260807 13:50:23.127035 24031 catalog_manager.cc:5697] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1d858e0ace34c39a641ede1db85be11 (127.23.107.134). New cstate: current_term: 1 leader_uuid: "d1d858e0ace34c39a641ede1db85be11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } health_report { overall_health: UNKNOWN } } }
I20260807 13:50:23.168265 25764 raft_consensus.cc:493] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:23.168527 25764 raft_consensus.cc:515] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:23.169564 25764 leader_election.cc:290] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973), c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641)
I20260807 13:50:23.170311 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bee0994b83f4c8486fa4fa7154787e4" candidate_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60" is_pre_election: true
I20260807 13:50:23.170311 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bee0994b83f4c8486fa4fa7154787e4" candidate_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" is_pre_election: true
I20260807 13:50:23.170627 24240 raft_consensus.cc:2468] T 5bee0994b83f4c8486fa4fa7154787e4 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6d3ef3a235844cbbce1370e3aeb809f in term 0.
I20260807 13:50:23.170627 24601 raft_consensus.cc:2468] T 5bee0994b83f4c8486fa4fa7154787e4 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6d3ef3a235844cbbce1370e3aeb809f in term 0.
I20260807 13:50:23.171263 24864 leader_election.cc:304] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, d6d3ef3a235844cbbce1370e3aeb809f; no voters:
I20260807 13:50:23.171603 25764 raft_consensus.cc:2804] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:23.171747 25764 raft_consensus.cc:493] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:23.171864 25764 raft_consensus.cc:3060] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:23.174268 25764 raft_consensus.cc:515] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:23.174901 25764 leader_election.cc:290] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f [CANDIDATE]: Term 1 election: Requested vote from peers 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973), c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641)
I20260807 13:50:23.175442 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bee0994b83f4c8486fa4fa7154787e4" candidate_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4"
I20260807 13:50:23.175479 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bee0994b83f4c8486fa4fa7154787e4" candidate_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60"
I20260807 13:50:23.175681 24240 raft_consensus.cc:3060] T 5bee0994b83f4c8486fa4fa7154787e4 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:23.175734 24601 raft_consensus.cc:3060] T 5bee0994b83f4c8486fa4fa7154787e4 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:23.177989 24240 raft_consensus.cc:2468] T 5bee0994b83f4c8486fa4fa7154787e4 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6d3ef3a235844cbbce1370e3aeb809f in term 1.
I20260807 13:50:23.178027 24601 raft_consensus.cc:2468] T 5bee0994b83f4c8486fa4fa7154787e4 P c8d4866795004103a4b0243906fe4d60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6d3ef3a235844cbbce1370e3aeb809f in term 1.
I20260807 13:50:23.178532 24864 leader_election.cc:304] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, d6d3ef3a235844cbbce1370e3aeb809f; no voters:
I20260807 13:50:23.178716 25646 raft_consensus.cc:493] T faaa7f569d5e4da78d315dc7ace6e8fc P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:23.178905 25764 raft_consensus.cc:2804] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:23.178890 25646 raft_consensus.cc:515] T faaa7f569d5e4da78d315dc7ace6e8fc P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:23.179452 25764 raft_consensus.cc:697] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f [term 1 LEADER]: Becoming Leader. State: Replica: d6d3ef3a235844cbbce1370e3aeb809f, State: Running, Role: LEADER
I20260807 13:50:23.179647 25646 leader_election.cc:290] T faaa7f569d5e4da78d315dc7ace6e8fc P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641), d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131)
I20260807 13:50:23.180115 25764 consensus_queue.cc:237] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:23.180239 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faaa7f569d5e4da78d315dc7ace6e8fc" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60" is_pre_election: true
I20260807 13:50:23.180438 24601 raft_consensus.cc:2468] T faaa7f569d5e4da78d315dc7ace6e8fc P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 0.
I20260807 13:50:23.180790 24956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faaa7f569d5e4da78d315dc7ace6e8fc" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" is_pre_election: true
I20260807 13:50:23.180891 24152 leader_election.cc:304] T faaa7f569d5e4da78d315dc7ace6e8fc P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, c8d4866795004103a4b0243906fe4d60; no voters:
I20260807 13:50:23.181043 24956 raft_consensus.cc:2468] T faaa7f569d5e4da78d315dc7ace6e8fc P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 0.
I20260807 13:50:23.181254 25646 raft_consensus.cc:2804] T faaa7f569d5e4da78d315dc7ace6e8fc P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:23.181407 25646 raft_consensus.cc:493] T faaa7f569d5e4da78d315dc7ace6e8fc P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:23.181561 25646 raft_consensus.cc:3060] T faaa7f569d5e4da78d315dc7ace6e8fc P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:23.184347 25646 raft_consensus.cc:515] T faaa7f569d5e4da78d315dc7ace6e8fc P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:23.184978 25646 leader_election.cc:290] T faaa7f569d5e4da78d315dc7ace6e8fc P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 election: Requested vote from peers c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641), d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131)
I20260807 13:50:23.185547 24956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faaa7f569d5e4da78d315dc7ace6e8fc" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d3ef3a235844cbbce1370e3aeb809f"
I20260807 13:50:23.185562 24601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faaa7f569d5e4da78d315dc7ace6e8fc" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60"
I20260807 13:50:23.185706 24956 raft_consensus.cc:3060] T faaa7f569d5e4da78d315dc7ace6e8fc P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:23.185817 24601 raft_consensus.cc:3060] T faaa7f569d5e4da78d315dc7ace6e8fc P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:23.188086 24956 raft_consensus.cc:2468] T faaa7f569d5e4da78d315dc7ace6e8fc P d6d3ef3a235844cbbce1370e3aeb809f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 1.
I20260807 13:50:23.188565 24152 leader_election.cc:304] T faaa7f569d5e4da78d315dc7ace6e8fc P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, d6d3ef3a235844cbbce1370e3aeb809f; no voters:
I20260807 13:50:23.188732 24601 raft_consensus.cc:2468] T faaa7f569d5e4da78d315dc7ace6e8fc P c8d4866795004103a4b0243906fe4d60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 1.
I20260807 13:50:23.188508 24031 catalog_manager.cc:5697] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f reported cstate change: term changed from 0 to 1, leader changed from <none> to d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133). New cstate: current_term: 1 leader_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } health_report { overall_health: UNKNOWN } } }
I20260807 13:50:23.188961 25646 raft_consensus.cc:2804] T faaa7f569d5e4da78d315dc7ace6e8fc P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:23.189682 25646 raft_consensus.cc:697] T faaa7f569d5e4da78d315dc7ace6e8fc P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 LEADER]: Becoming Leader. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Running, Role: LEADER
I20260807 13:50:23.190002 25646 consensus_queue.cc:237] T faaa7f569d5e4da78d315dc7ace6e8fc P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:23.193025 24034 catalog_manager.cc:5697] T faaa7f569d5e4da78d315dc7ace6e8fc P 4d09f7af7d9d4d07bfb2114f45e9e8a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129). New cstate: current_term: 1 leader_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } health_report { overall_health: UNKNOWN } } }
I20260807 13:50:23.568053 25764 consensus_queue.cc:1048] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:23.577003 25773 consensus_queue.cc:1048] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:23.588456 25717 consensus_queue.cc:1048] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:23.609032 25794 consensus_queue.cc:1048] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:50:23.613711 25776 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:23.614118 25776 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260807 13:50:23.626008 25646 consensus_queue.cc:1048] T faaa7f569d5e4da78d315dc7ace6e8fc P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:23.631743 25646 consensus_queue.cc:1048] T faaa7f569d5e4da78d315dc7ace6e8fc P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Using table 'rebalance_test_table_4'
INSERT report
rows total: 2000
time total: 322.568 ms
time per row: 0.161284 ms
I20260807 13:50:24.137286 24023 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43984:
name: "rebalance_test_table_5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:50:24.149487 24396 tablet_service.cc:1511] Processing CreateTablet for tablet 31e4357937f74ae9819d42fc0cdcfb71 (DEFAULT_TABLE table=rebalance_test_table_5 [id=77fbaa26f81e4e89b492c05e648ed58c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:24.149870 25106 tablet_service.cc:1511] Processing CreateTablet for tablet 31e4357937f74ae9819d42fc0cdcfb71 (DEFAULT_TABLE table=rebalance_test_table_5 [id=77fbaa26f81e4e89b492c05e648ed58c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:24.150029 24396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31e4357937f74ae9819d42fc0cdcfb71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:24.150362 25106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31e4357937f74ae9819d42fc0cdcfb71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:24.152084 24211 tablet_service.cc:1511] Processing CreateTablet for tablet 07b4c24b9efe45f2b6dd8ee4ac31579c (DEFAULT_TABLE table=rebalance_test_table_5 [id=77fbaa26f81e4e89b492c05e648ed58c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:24.152529 24211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07b4c24b9efe45f2b6dd8ee4ac31579c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:24.154460 24395 tablet_service.cc:1511] Processing CreateTablet for tablet 9263c12f7a8e4f0686a803069c498cd2 (DEFAULT_TABLE table=rebalance_test_table_5 [id=77fbaa26f81e4e89b492c05e648ed58c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:24.154485 24926 tablet_service.cc:1511] Processing CreateTablet for tablet 07b4c24b9efe45f2b6dd8ee4ac31579c (DEFAULT_TABLE table=rebalance_test_table_5 [id=77fbaa26f81e4e89b492c05e648ed58c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:24.154852 24395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9263c12f7a8e4f0686a803069c498cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:24.154871 24926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07b4c24b9efe45f2b6dd8ee4ac31579c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:24.160356 24572 tablet_service.cc:1511] Processing CreateTablet for tablet 07b4c24b9efe45f2b6dd8ee4ac31579c (DEFAULT_TABLE table=rebalance_test_table_5 [id=77fbaa26f81e4e89b492c05e648ed58c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:24.160907 24572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07b4c24b9efe45f2b6dd8ee4ac31579c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:24.165890 24750 tablet_service.cc:1511] Processing CreateTablet for tablet 31e4357937f74ae9819d42fc0cdcfb71 (DEFAULT_TABLE table=rebalance_test_table_5 [id=77fbaa26f81e4e89b492c05e648ed58c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:24.166433 24750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31e4357937f74ae9819d42fc0cdcfb71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:24.169838 24751 tablet_service.cc:1511] Processing CreateTablet for tablet 9263c12f7a8e4f0686a803069c498cd2 (DEFAULT_TABLE table=rebalance_test_table_5 [id=77fbaa26f81e4e89b492c05e648ed58c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:24.170306 24751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9263c12f7a8e4f0686a803069c498cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:24.172262 25873 tablet_bootstrap.cc:492] T 07b4c24b9efe45f2b6dd8ee4ac31579c P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Bootstrap starting.
I20260807 13:50:24.174355 25107 tablet_service.cc:1511] Processing CreateTablet for tablet 9263c12f7a8e4f0686a803069c498cd2 (DEFAULT_TABLE table=rebalance_test_table_5 [id=77fbaa26f81e4e89b492c05e648ed58c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:24.174791 25107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9263c12f7a8e4f0686a803069c498cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:24.175158 25873 tablet_bootstrap.cc:654] T 07b4c24b9efe45f2b6dd8ee4ac31579c P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:24.190171 25875 tablet_bootstrap.cc:492] T 07b4c24b9efe45f2b6dd8ee4ac31579c P d6d3ef3a235844cbbce1370e3aeb809f: Bootstrap starting.
I20260807 13:50:24.190994 25873 tablet_bootstrap.cc:492] T 07b4c24b9efe45f2b6dd8ee4ac31579c P 4d09f7af7d9d4d07bfb2114f45e9e8a4: No bootstrap required, opened a new log
I20260807 13:50:24.191236 25873 ts_tablet_manager.cc:1403] T 07b4c24b9efe45f2b6dd8ee4ac31579c P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.000s
I20260807 13:50:24.192375 25873 raft_consensus.cc:359] T 07b4c24b9efe45f2b6dd8ee4ac31579c P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:24.192664 25873 raft_consensus.cc:385] T 07b4c24b9efe45f2b6dd8ee4ac31579c P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:24.192790 25873 raft_consensus.cc:740] T 07b4c24b9efe45f2b6dd8ee4ac31579c P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Initialized, Role: FOLLOWER
I20260807 13:50:24.193096 25873 consensus_queue.cc:260] T 07b4c24b9efe45f2b6dd8ee4ac31579c P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:24.194053 25873 ts_tablet_manager.cc:1434] T 07b4c24b9efe45f2b6dd8ee4ac31579c P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260807 13:50:24.194161 25874 tablet_bootstrap.cc:492] T 31e4357937f74ae9819d42fc0cdcfb71 P fe8f3cec39fb4964a4fccfd5baa4077b: Bootstrap starting.
I20260807 13:50:24.196395 25875 tablet_bootstrap.cc:654] T 07b4c24b9efe45f2b6dd8ee4ac31579c P d6d3ef3a235844cbbce1370e3aeb809f: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:24.201277 25874 tablet_bootstrap.cc:654] T 31e4357937f74ae9819d42fc0cdcfb71 P fe8f3cec39fb4964a4fccfd5baa4077b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:24.202524 25878 tablet_bootstrap.cc:492] T 07b4c24b9efe45f2b6dd8ee4ac31579c P c8d4866795004103a4b0243906fe4d60: Bootstrap starting.
I20260807 13:50:24.205137 25878 tablet_bootstrap.cc:654] T 07b4c24b9efe45f2b6dd8ee4ac31579c P c8d4866795004103a4b0243906fe4d60: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:24.205844 25877 tablet_bootstrap.cc:492] T 31e4357937f74ae9819d42fc0cdcfb71 P b890fcdb46dc4597bd9991906433c391: Bootstrap starting.
I20260807 13:50:24.209296 25877 tablet_bootstrap.cc:654] T 31e4357937f74ae9819d42fc0cdcfb71 P b890fcdb46dc4597bd9991906433c391: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:24.217779 25875 tablet_bootstrap.cc:492] T 07b4c24b9efe45f2b6dd8ee4ac31579c P d6d3ef3a235844cbbce1370e3aeb809f: No bootstrap required, opened a new log
I20260807 13:50:24.218106 25875 ts_tablet_manager.cc:1403] T 07b4c24b9efe45f2b6dd8ee4ac31579c P d6d3ef3a235844cbbce1370e3aeb809f: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.006s
I20260807 13:50:24.219296 25875 raft_consensus.cc:359] T 07b4c24b9efe45f2b6dd8ee4ac31579c P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:24.219636 25875 raft_consensus.cc:385] T 07b4c24b9efe45f2b6dd8ee4ac31579c P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:24.219816 25875 raft_consensus.cc:740] T 07b4c24b9efe45f2b6dd8ee4ac31579c P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d3ef3a235844cbbce1370e3aeb809f, State: Initialized, Role: FOLLOWER
I20260807 13:50:24.220193 25875 consensus_queue.cc:260] T 07b4c24b9efe45f2b6dd8ee4ac31579c P d6d3ef3a235844cbbce1370e3aeb809f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:24.221092 25875 ts_tablet_manager.cc:1434] T 07b4c24b9efe45f2b6dd8ee4ac31579c P d6d3ef3a235844cbbce1370e3aeb809f: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260807 13:50:24.221606 25877 tablet_bootstrap.cc:492] T 31e4357937f74ae9819d42fc0cdcfb71 P b890fcdb46dc4597bd9991906433c391: No bootstrap required, opened a new log
I20260807 13:50:24.221841 25877 ts_tablet_manager.cc:1403] T 31e4357937f74ae9819d42fc0cdcfb71 P b890fcdb46dc4597bd9991906433c391: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.002s
I20260807 13:50:24.222599 25872 tablet_bootstrap.cc:492] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11: Bootstrap starting.
I20260807 13:50:24.225029 25877 raft_consensus.cc:359] T 31e4357937f74ae9819d42fc0cdcfb71 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:24.225350 25877 raft_consensus.cc:385] T 31e4357937f74ae9819d42fc0cdcfb71 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:24.225512 25877 raft_consensus.cc:740] T 31e4357937f74ae9819d42fc0cdcfb71 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b890fcdb46dc4597bd9991906433c391, State: Initialized, Role: FOLLOWER
I20260807 13:50:24.225863 25877 consensus_queue.cc:260] T 31e4357937f74ae9819d42fc0cdcfb71 P b890fcdb46dc4597bd9991906433c391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:24.226481 25874 tablet_bootstrap.cc:492] T 31e4357937f74ae9819d42fc0cdcfb71 P fe8f3cec39fb4964a4fccfd5baa4077b: No bootstrap required, opened a new log
I20260807 13:50:24.226713 25874 ts_tablet_manager.cc:1403] T 31e4357937f74ae9819d42fc0cdcfb71 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent bootstrapping tablet: real 0.033s user 0.008s sys 0.004s
I20260807 13:50:24.228926 25877 ts_tablet_manager.cc:1434] T 31e4357937f74ae9819d42fc0cdcfb71 P b890fcdb46dc4597bd9991906433c391: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260807 13:50:24.229341 25877 tablet_bootstrap.cc:492] T 9263c12f7a8e4f0686a803069c498cd2 P b890fcdb46dc4597bd9991906433c391: Bootstrap starting.
I20260807 13:50:24.229513 25874 raft_consensus.cc:359] T 31e4357937f74ae9819d42fc0cdcfb71 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:24.229835 25874 raft_consensus.cc:385] T 31e4357937f74ae9819d42fc0cdcfb71 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:24.229995 25874 raft_consensus.cc:740] T 31e4357937f74ae9819d42fc0cdcfb71 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8f3cec39fb4964a4fccfd5baa4077b, State: Initialized, Role: FOLLOWER
I20260807 13:50:24.230387 25874 consensus_queue.cc:260] T 31e4357937f74ae9819d42fc0cdcfb71 P fe8f3cec39fb4964a4fccfd5baa4077b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:24.230669 25878 tablet_bootstrap.cc:492] T 07b4c24b9efe45f2b6dd8ee4ac31579c P c8d4866795004103a4b0243906fe4d60: No bootstrap required, opened a new log
I20260807 13:50:24.230845 25878 ts_tablet_manager.cc:1403] T 07b4c24b9efe45f2b6dd8ee4ac31579c P c8d4866795004103a4b0243906fe4d60: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.000s
I20260807 13:50:24.232587 25877 tablet_bootstrap.cc:654] T 9263c12f7a8e4f0686a803069c498cd2 P b890fcdb46dc4597bd9991906433c391: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:24.233316 25878 raft_consensus.cc:359] T 07b4c24b9efe45f2b6dd8ee4ac31579c P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:24.233583 25878 raft_consensus.cc:385] T 07b4c24b9efe45f2b6dd8ee4ac31579c P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:24.233762 25878 raft_consensus.cc:740] T 07b4c24b9efe45f2b6dd8ee4ac31579c P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8d4866795004103a4b0243906fe4d60, State: Initialized, Role: FOLLOWER
I20260807 13:50:24.234531 25878 consensus_queue.cc:260] T 07b4c24b9efe45f2b6dd8ee4ac31579c P c8d4866795004103a4b0243906fe4d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:24.236229 25878 ts_tablet_manager.cc:1434] T 07b4c24b9efe45f2b6dd8ee4ac31579c P c8d4866795004103a4b0243906fe4d60: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260807 13:50:24.238236 25872 tablet_bootstrap.cc:654] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:24.244444 25874 ts_tablet_manager.cc:1434] T 31e4357937f74ae9819d42fc0cdcfb71 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent starting tablet: real 0.018s user 0.008s sys 0.000s
I20260807 13:50:24.246968 25877 tablet_bootstrap.cc:492] T 9263c12f7a8e4f0686a803069c498cd2 P b890fcdb46dc4597bd9991906433c391: No bootstrap required, opened a new log
I20260807 13:50:24.247310 25872 tablet_bootstrap.cc:492] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11: No bootstrap required, opened a new log
I20260807 13:50:24.247206 25877 ts_tablet_manager.cc:1403] T 9263c12f7a8e4f0686a803069c498cd2 P b890fcdb46dc4597bd9991906433c391: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.008s
I20260807 13:50:24.247555 25872 ts_tablet_manager.cc:1403] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.007s
I20260807 13:50:24.248394 25877 raft_consensus.cc:359] T 9263c12f7a8e4f0686a803069c498cd2 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:24.249171 25877 raft_consensus.cc:385] T 9263c12f7a8e4f0686a803069c498cd2 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:24.248899 25872 raft_consensus.cc:359] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:24.249362 25877 raft_consensus.cc:740] T 9263c12f7a8e4f0686a803069c498cd2 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b890fcdb46dc4597bd9991906433c391, State: Initialized, Role: FOLLOWER
I20260807 13:50:24.249611 25872 raft_consensus.cc:385] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:24.249766 25874 tablet_bootstrap.cc:492] T 9263c12f7a8e4f0686a803069c498cd2 P fe8f3cec39fb4964a4fccfd5baa4077b: Bootstrap starting.
I20260807 13:50:24.249778 25872 raft_consensus.cc:740] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Initialized, Role: FOLLOWER
I20260807 13:50:24.249713 25877 consensus_queue.cc:260] T 9263c12f7a8e4f0686a803069c498cd2 P b890fcdb46dc4597bd9991906433c391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:24.250156 25872 consensus_queue.cc:260] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:24.251317 25877 ts_tablet_manager.cc:1434] T 9263c12f7a8e4f0686a803069c498cd2 P b890fcdb46dc4597bd9991906433c391: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260807 13:50:24.251739 25874 tablet_bootstrap.cc:654] T 9263c12f7a8e4f0686a803069c498cd2 P fe8f3cec39fb4964a4fccfd5baa4077b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:24.252775 25872 ts_tablet_manager.cc:1434] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260807 13:50:24.253249 25872 tablet_bootstrap.cc:492] T 9263c12f7a8e4f0686a803069c498cd2 P d1d858e0ace34c39a641ede1db85be11: Bootstrap starting.
I20260807 13:50:24.255753 25872 tablet_bootstrap.cc:654] T 9263c12f7a8e4f0686a803069c498cd2 P d1d858e0ace34c39a641ede1db85be11: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:24.262864 25874 tablet_bootstrap.cc:492] T 9263c12f7a8e4f0686a803069c498cd2 P fe8f3cec39fb4964a4fccfd5baa4077b: No bootstrap required, opened a new log
I20260807 13:50:24.263198 25874 ts_tablet_manager.cc:1403] T 9263c12f7a8e4f0686a803069c498cd2 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.001s
I20260807 13:50:24.265214 25874 raft_consensus.cc:359] T 9263c12f7a8e4f0686a803069c498cd2 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:24.265604 25874 raft_consensus.cc:385] T 9263c12f7a8e4f0686a803069c498cd2 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:24.265861 25874 raft_consensus.cc:740] T 9263c12f7a8e4f0686a803069c498cd2 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8f3cec39fb4964a4fccfd5baa4077b, State: Initialized, Role: FOLLOWER
I20260807 13:50:24.266192 25874 consensus_queue.cc:260] T 9263c12f7a8e4f0686a803069c498cd2 P fe8f3cec39fb4964a4fccfd5baa4077b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:24.266798 25872 tablet_bootstrap.cc:492] T 9263c12f7a8e4f0686a803069c498cd2 P d1d858e0ace34c39a641ede1db85be11: No bootstrap required, opened a new log
I20260807 13:50:24.266992 25872 ts_tablet_manager.cc:1403] T 9263c12f7a8e4f0686a803069c498cd2 P d1d858e0ace34c39a641ede1db85be11: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.006s
I20260807 13:50:24.267750 25874 ts_tablet_manager.cc:1434] T 9263c12f7a8e4f0686a803069c498cd2 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260807 13:50:24.267825 25872 raft_consensus.cc:359] T 9263c12f7a8e4f0686a803069c498cd2 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:24.268050 25872 raft_consensus.cc:385] T 9263c12f7a8e4f0686a803069c498cd2 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:24.268169 25872 raft_consensus.cc:740] T 9263c12f7a8e4f0686a803069c498cd2 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Initialized, Role: FOLLOWER
I20260807 13:50:24.268453 25872 consensus_queue.cc:260] T 9263c12f7a8e4f0686a803069c498cd2 P d1d858e0ace34c39a641ede1db85be11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:24.268975 25872 ts_tablet_manager.cc:1434] T 9263c12f7a8e4f0686a803069c498cd2 P d1d858e0ace34c39a641ede1db85be11: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260807 13:50:24.344435 25516 raft_consensus.cc:493] T 07b4c24b9efe45f2b6dd8ee4ac31579c P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:24.344702 25516 raft_consensus.cc:515] T 07b4c24b9efe45f2b6dd8ee4ac31579c P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:24.345777 25516 leader_election.cc:290] T 07b4c24b9efe45f2b6dd8ee4ac31579c P c8d4866795004103a4b0243906fe4d60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973), d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131)
I20260807 13:50:24.346405 24956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b4c24b9efe45f2b6dd8ee4ac31579c" candidate_uuid: "c8d4866795004103a4b0243906fe4d60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" is_pre_election: true
I20260807 13:50:24.346410 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b4c24b9efe45f2b6dd8ee4ac31579c" candidate_uuid: "c8d4866795004103a4b0243906fe4d60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" is_pre_election: true
I20260807 13:50:24.346696 24239 raft_consensus.cc:2468] T 07b4c24b9efe45f2b6dd8ee4ac31579c P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8d4866795004103a4b0243906fe4d60 in term 0.
I20260807 13:50:24.346710 24956 raft_consensus.cc:2468] T 07b4c24b9efe45f2b6dd8ee4ac31579c P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8d4866795004103a4b0243906fe4d60 in term 0.
I20260807 13:50:24.347352 24513 leader_election.cc:304] T 07b4c24b9efe45f2b6dd8ee4ac31579c P c8d4866795004103a4b0243906fe4d60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, c8d4866795004103a4b0243906fe4d60; no voters:
I20260807 13:50:24.347703 25516 raft_consensus.cc:2804] T 07b4c24b9efe45f2b6dd8ee4ac31579c P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:24.347856 25516 raft_consensus.cc:493] T 07b4c24b9efe45f2b6dd8ee4ac31579c P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:24.347988 25516 raft_consensus.cc:3060] T 07b4c24b9efe45f2b6dd8ee4ac31579c P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:24.350293 25516 raft_consensus.cc:515] T 07b4c24b9efe45f2b6dd8ee4ac31579c P c8d4866795004103a4b0243906fe4d60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:24.351008 25516 leader_election.cc:290] T 07b4c24b9efe45f2b6dd8ee4ac31579c P c8d4866795004103a4b0243906fe4d60 [CANDIDATE]: Term 1 election: Requested vote from peers 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973), d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131)
I20260807 13:50:24.351545 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b4c24b9efe45f2b6dd8ee4ac31579c" candidate_uuid: "c8d4866795004103a4b0243906fe4d60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4"
I20260807 13:50:24.351621 24956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b4c24b9efe45f2b6dd8ee4ac31579c" candidate_uuid: "c8d4866795004103a4b0243906fe4d60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d3ef3a235844cbbce1370e3aeb809f"
I20260807 13:50:24.351778 24239 raft_consensus.cc:3060] T 07b4c24b9efe45f2b6dd8ee4ac31579c P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:24.351891 24956 raft_consensus.cc:3060] T 07b4c24b9efe45f2b6dd8ee4ac31579c P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:24.354089 24239 raft_consensus.cc:2468] T 07b4c24b9efe45f2b6dd8ee4ac31579c P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d4866795004103a4b0243906fe4d60 in term 1.
I20260807 13:50:24.354619 24513 leader_election.cc:304] T 07b4c24b9efe45f2b6dd8ee4ac31579c P c8d4866795004103a4b0243906fe4d60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, c8d4866795004103a4b0243906fe4d60; no voters:
I20260807 13:50:24.354950 25516 raft_consensus.cc:2804] T 07b4c24b9efe45f2b6dd8ee4ac31579c P c8d4866795004103a4b0243906fe4d60 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:24.355463 25516 raft_consensus.cc:697] T 07b4c24b9efe45f2b6dd8ee4ac31579c P c8d4866795004103a4b0243906fe4d60 [term 1 LEADER]: Becoming Leader. State: Replica: c8d4866795004103a4b0243906fe4d60, State: Running, Role: LEADER
I20260807 13:50:24.355659 24956 raft_consensus.cc:2468] T 07b4c24b9efe45f2b6dd8ee4ac31579c P d6d3ef3a235844cbbce1370e3aeb809f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d4866795004103a4b0243906fe4d60 in term 1.
I20260807 13:50:24.356173 25516 consensus_queue.cc:237] T 07b4c24b9efe45f2b6dd8ee4ac31579c P c8d4866795004103a4b0243906fe4d60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } }
I20260807 13:50:24.367955 24031 catalog_manager.cc:5697] T 07b4c24b9efe45f2b6dd8ee4ac31579c P c8d4866795004103a4b0243906fe4d60 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8d4866795004103a4b0243906fe4d60 (127.23.107.131). New cstate: current_term: 1 leader_uuid: "c8d4866795004103a4b0243906fe4d60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } health_report { overall_health: UNKNOWN } } }
I20260807 13:50:24.413765 25717 raft_consensus.cc:493] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:24.413985 25717 raft_consensus.cc:515] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:24.414726 25717 leader_election.cc:290] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619), b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189)
I20260807 13:50:24.415334 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e4357937f74ae9819d42fc0cdcfb71" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" is_pre_election: true
I20260807 13:50:24.415401 24775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e4357937f74ae9819d42fc0cdcfb71" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b890fcdb46dc4597bd9991906433c391" is_pre_election: true
I20260807 13:50:24.415613 24425 raft_consensus.cc:2468] T 31e4357937f74ae9819d42fc0cdcfb71 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 0.
I20260807 13:50:24.415730 24775 raft_consensus.cc:2468] T 31e4357937f74ae9819d42fc0cdcfb71 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 0.
I20260807 13:50:24.416272 25049 leader_election.cc:304] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1d858e0ace34c39a641ede1db85be11, fe8f3cec39fb4964a4fccfd5baa4077b; no voters:
I20260807 13:50:24.416640 25717 raft_consensus.cc:2804] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:24.416790 25717 raft_consensus.cc:493] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:24.416899 25717 raft_consensus.cc:3060] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:24.419400 25717 raft_consensus.cc:515] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:24.420094 25717 leader_election.cc:290] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 election: Requested vote from peers fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619), b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189)
I20260807 13:50:24.420697 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e4357937f74ae9819d42fc0cdcfb71" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b"
I20260807 13:50:24.420760 24775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e4357937f74ae9819d42fc0cdcfb71" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b890fcdb46dc4597bd9991906433c391"
I20260807 13:50:24.420948 24425 raft_consensus.cc:3060] T 31e4357937f74ae9819d42fc0cdcfb71 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:24.421031 24775 raft_consensus.cc:3060] T 31e4357937f74ae9819d42fc0cdcfb71 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:24.423609 24425 raft_consensus.cc:2468] T 31e4357937f74ae9819d42fc0cdcfb71 P fe8f3cec39fb4964a4fccfd5baa4077b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 1.
I20260807 13:50:24.425168 24775 raft_consensus.cc:2468] T 31e4357937f74ae9819d42fc0cdcfb71 P b890fcdb46dc4597bd9991906433c391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 1.
I20260807 13:50:24.425750 25047 leader_election.cc:304] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b890fcdb46dc4597bd9991906433c391, d1d858e0ace34c39a641ede1db85be11; no voters:
I20260807 13:50:24.426343 25717 raft_consensus.cc:2804] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:24.426558 25717 raft_consensus.cc:697] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11 [term 1 LEADER]: Becoming Leader. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Running, Role: LEADER
I20260807 13:50:24.426889 25717 consensus_queue.cc:237] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:24.430451 24031 catalog_manager.cc:5697] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1d858e0ace34c39a641ede1db85be11 (127.23.107.134). New cstate: current_term: 1 leader_uuid: "d1d858e0ace34c39a641ede1db85be11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } health_report { overall_health: UNKNOWN } } }
I20260807 13:50:24.562268 25470 raft_consensus.cc:493] T 9263c12f7a8e4f0686a803069c498cd2 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:24.562487 25470 raft_consensus.cc:515] T 9263c12f7a8e4f0686a803069c498cd2 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:24.563153 25470 leader_election.cc:290] T 9263c12f7a8e4f0686a803069c498cd2 P b890fcdb46dc4597bd9991906433c391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1d858e0ace34c39a641ede1db85be11 (127.23.107.134:46341), fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619)
I20260807 13:50:24.563853 25131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9263c12f7a8e4f0686a803069c498cd2" candidate_uuid: "b890fcdb46dc4597bd9991906433c391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1d858e0ace34c39a641ede1db85be11" is_pre_election: true
I20260807 13:50:24.563853 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9263c12f7a8e4f0686a803069c498cd2" candidate_uuid: "b890fcdb46dc4597bd9991906433c391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" is_pre_election: true
I20260807 13:50:24.564127 24425 raft_consensus.cc:2468] T 9263c12f7a8e4f0686a803069c498cd2 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b890fcdb46dc4597bd9991906433c391 in term 0.
I20260807 13:50:24.564133 25131 raft_consensus.cc:2468] T 9263c12f7a8e4f0686a803069c498cd2 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b890fcdb46dc4597bd9991906433c391 in term 0.
I20260807 13:50:24.564641 24692 leader_election.cc:304] T 9263c12f7a8e4f0686a803069c498cd2 P b890fcdb46dc4597bd9991906433c391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b890fcdb46dc4597bd9991906433c391, fe8f3cec39fb4964a4fccfd5baa4077b; no voters:
I20260807 13:50:24.565001 25470 raft_consensus.cc:2804] T 9263c12f7a8e4f0686a803069c498cd2 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:24.565138 25470 raft_consensus.cc:493] T 9263c12f7a8e4f0686a803069c498cd2 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:24.565263 25470 raft_consensus.cc:3060] T 9263c12f7a8e4f0686a803069c498cd2 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:24.567289 25470 raft_consensus.cc:515] T 9263c12f7a8e4f0686a803069c498cd2 P b890fcdb46dc4597bd9991906433c391 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:24.567993 25470 leader_election.cc:290] T 9263c12f7a8e4f0686a803069c498cd2 P b890fcdb46dc4597bd9991906433c391 [CANDIDATE]: Term 1 election: Requested vote from peers d1d858e0ace34c39a641ede1db85be11 (127.23.107.134:46341), fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619)
I20260807 13:50:24.568418 25131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9263c12f7a8e4f0686a803069c498cd2" candidate_uuid: "b890fcdb46dc4597bd9991906433c391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1d858e0ace34c39a641ede1db85be11"
I20260807 13:50:24.568501 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9263c12f7a8e4f0686a803069c498cd2" candidate_uuid: "b890fcdb46dc4597bd9991906433c391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b"
I20260807 13:50:24.568678 25131 raft_consensus.cc:3060] T 9263c12f7a8e4f0686a803069c498cd2 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:24.568801 24425 raft_consensus.cc:3060] T 9263c12f7a8e4f0686a803069c498cd2 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:24.570752 25131 raft_consensus.cc:2468] T 9263c12f7a8e4f0686a803069c498cd2 P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b890fcdb46dc4597bd9991906433c391 in term 1.
I20260807 13:50:24.571048 24425 raft_consensus.cc:2468] T 9263c12f7a8e4f0686a803069c498cd2 P fe8f3cec39fb4964a4fccfd5baa4077b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b890fcdb46dc4597bd9991906433c391 in term 1.
I20260807 13:50:24.571269 24688 leader_election.cc:304] T 9263c12f7a8e4f0686a803069c498cd2 P b890fcdb46dc4597bd9991906433c391 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b890fcdb46dc4597bd9991906433c391, d1d858e0ace34c39a641ede1db85be11; no voters:
I20260807 13:50:24.571623 25470 raft_consensus.cc:2804] T 9263c12f7a8e4f0686a803069c498cd2 P b890fcdb46dc4597bd9991906433c391 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:24.572034 25470 raft_consensus.cc:697] T 9263c12f7a8e4f0686a803069c498cd2 P b890fcdb46dc4597bd9991906433c391 [term 1 LEADER]: Becoming Leader. State: Replica: b890fcdb46dc4597bd9991906433c391, State: Running, Role: LEADER
I20260807 13:50:24.572343 25470 consensus_queue.cc:237] T 9263c12f7a8e4f0686a803069c498cd2 P b890fcdb46dc4597bd9991906433c391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:24.575333 24031 catalog_manager.cc:5697] T 9263c12f7a8e4f0686a803069c498cd2 P b890fcdb46dc4597bd9991906433c391 reported cstate change: term changed from 0 to 1, leader changed from <none> to b890fcdb46dc4597bd9991906433c391 (127.23.107.132). New cstate: current_term: 1 leader_uuid: "b890fcdb46dc4597bd9991906433c391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } health_report { overall_health: HEALTHY } } }
I20260807 13:50:24.899904 25516 consensus_queue.cc:1048] T 07b4c24b9efe45f2b6dd8ee4ac31579c P c8d4866795004103a4b0243906fe4d60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:24.902979 25516 consensus_queue.cc:1048] T 07b4c24b9efe45f2b6dd8ee4ac31579c P c8d4866795004103a4b0243906fe4d60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:24.952700 25717 consensus_queue.cc:1048] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:24.966048 25717 consensus_queue.cc:1048] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:24.977960 25470 consensus_queue.cc:1048] T 9263c12f7a8e4f0686a803069c498cd2 P b890fcdb46dc4597bd9991906433c391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:25.023386 25470 consensus_queue.cc:1048] T 9263c12f7a8e4f0686a803069c498cd2 P b890fcdb46dc4597bd9991906433c391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:50:25.071710 25901 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:25.072064 25901 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_5'
INSERT report
rows total: 2000
time total: 272.066 ms
time per row: 0.136033 ms
I20260807 13:50:25.595000 24025 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43984:
name: "rebalance_test_table_6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:50:25.607307 24211 tablet_service.cc:1511] Processing CreateTablet for tablet d768072cffca4b74a9b790659eec7a24 (DEFAULT_TABLE table=rebalance_test_table_6 [id=b7dc5ec0d5a4471eb4926dbfc37be93e]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:25.607862 24211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d768072cffca4b74a9b790659eec7a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:25.607752 24926 tablet_service.cc:1511] Processing CreateTablet for tablet d768072cffca4b74a9b790659eec7a24 (DEFAULT_TABLE table=rebalance_test_table_6 [id=b7dc5ec0d5a4471eb4926dbfc37be93e]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:25.608307 24926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d768072cffca4b74a9b790659eec7a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:25.609174 24210 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec480f94022407f8915e21468a4ad30 (DEFAULT_TABLE table=rebalance_test_table_6 [id=b7dc5ec0d5a4471eb4926dbfc37be93e]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:25.609614 24210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec480f94022407f8915e21468a4ad30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:25.612638 24572 tablet_service.cc:1511] Processing CreateTablet for tablet d768072cffca4b74a9b790659eec7a24 (DEFAULT_TABLE table=rebalance_test_table_6 [id=b7dc5ec0d5a4471eb4926dbfc37be93e]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:25.612659 24396 tablet_service.cc:1511] Processing CreateTablet for tablet d356987d307c4d9da967d8141d92c169 (DEFAULT_TABLE table=rebalance_test_table_6 [id=b7dc5ec0d5a4471eb4926dbfc37be93e]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:25.613093 24396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d356987d307c4d9da967d8141d92c169. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:25.613101 24572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d768072cffca4b74a9b790659eec7a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:25.613624 25106 tablet_service.cc:1511] Processing CreateTablet for tablet d356987d307c4d9da967d8141d92c169 (DEFAULT_TABLE table=rebalance_test_table_6 [id=b7dc5ec0d5a4471eb4926dbfc37be93e]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:25.614065 25106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d356987d307c4d9da967d8141d92c169. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:25.617935 24750 tablet_service.cc:1511] Processing CreateTablet for tablet d356987d307c4d9da967d8141d92c169 (DEFAULT_TABLE table=rebalance_test_table_6 [id=b7dc5ec0d5a4471eb4926dbfc37be93e]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:25.618428 24750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d356987d307c4d9da967d8141d92c169. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:25.626278 24927 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec480f94022407f8915e21468a4ad30 (DEFAULT_TABLE table=rebalance_test_table_6 [id=b7dc5ec0d5a4471eb4926dbfc37be93e]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:25.626569 24573 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec480f94022407f8915e21468a4ad30 (DEFAULT_TABLE table=rebalance_test_table_6 [id=b7dc5ec0d5a4471eb4926dbfc37be93e]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:25.626781 24927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec480f94022407f8915e21468a4ad30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:25.626977 24573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec480f94022407f8915e21468a4ad30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:25.630072 25994 tablet_bootstrap.cc:492] T d356987d307c4d9da967d8141d92c169 P d1d858e0ace34c39a641ede1db85be11: Bootstrap starting.
I20260807 13:50:25.633394 25994 tablet_bootstrap.cc:654] T d356987d307c4d9da967d8141d92c169 P d1d858e0ace34c39a641ede1db85be11: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:25.635139 25991 tablet_bootstrap.cc:492] T d768072cffca4b74a9b790659eec7a24 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Bootstrap starting.
I20260807 13:50:25.638211 25994 tablet_bootstrap.cc:492] T d356987d307c4d9da967d8141d92c169 P d1d858e0ace34c39a641ede1db85be11: No bootstrap required, opened a new log
I20260807 13:50:25.638454 25994 ts_tablet_manager.cc:1403] T d356987d307c4d9da967d8141d92c169 P d1d858e0ace34c39a641ede1db85be11: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.001s
I20260807 13:50:25.639393 25994 raft_consensus.cc:359] T d356987d307c4d9da967d8141d92c169 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:25.639730 25994 raft_consensus.cc:385] T d356987d307c4d9da967d8141d92c169 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:25.639894 25994 raft_consensus.cc:740] T d356987d307c4d9da967d8141d92c169 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Initialized, Role: FOLLOWER
I20260807 13:50:25.640264 25991 tablet_bootstrap.cc:654] T d768072cffca4b74a9b790659eec7a24 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:25.640286 25994 consensus_queue.cc:260] T d356987d307c4d9da967d8141d92c169 P d1d858e0ace34c39a641ede1db85be11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:25.641105 25994 ts_tablet_manager.cc:1434] T d356987d307c4d9da967d8141d92c169 P d1d858e0ace34c39a641ede1db85be11: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 13:50:25.642081 25995 tablet_bootstrap.cc:492] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f: Bootstrap starting.
I20260807 13:50:25.651067 25995 tablet_bootstrap.cc:654] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:25.653285 25991 tablet_bootstrap.cc:492] T d768072cffca4b74a9b790659eec7a24 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: No bootstrap required, opened a new log
I20260807 13:50:25.653956 25991 ts_tablet_manager.cc:1403] T d768072cffca4b74a9b790659eec7a24 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.007s
I20260807 13:50:25.655097 25991 raft_consensus.cc:359] T d768072cffca4b74a9b790659eec7a24 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:25.655427 25991 raft_consensus.cc:385] T d768072cffca4b74a9b790659eec7a24 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:25.655598 25991 raft_consensus.cc:740] T d768072cffca4b74a9b790659eec7a24 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Initialized, Role: FOLLOWER
I20260807 13:50:25.655999 25991 consensus_queue.cc:260] T d768072cffca4b74a9b790659eec7a24 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:25.657613 25991 ts_tablet_manager.cc:1434] T d768072cffca4b74a9b790659eec7a24 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260807 13:50:25.657977 25991 tablet_bootstrap.cc:492] T 2ec480f94022407f8915e21468a4ad30 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Bootstrap starting.
I20260807 13:50:25.661991 25991 tablet_bootstrap.cc:654] T 2ec480f94022407f8915e21468a4ad30 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:25.666239 26000 tablet_bootstrap.cc:492] T d356987d307c4d9da967d8141d92c169 P b890fcdb46dc4597bd9991906433c391: Bootstrap starting.
I20260807 13:50:25.668093 25996 tablet_bootstrap.cc:492] T 2ec480f94022407f8915e21468a4ad30 P c8d4866795004103a4b0243906fe4d60: Bootstrap starting.
I20260807 13:50:25.670063 26000 tablet_bootstrap.cc:654] T d356987d307c4d9da967d8141d92c169 P b890fcdb46dc4597bd9991906433c391: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:25.670890 25996 tablet_bootstrap.cc:654] T 2ec480f94022407f8915e21468a4ad30 P c8d4866795004103a4b0243906fe4d60: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:25.671051 25991 tablet_bootstrap.cc:492] T 2ec480f94022407f8915e21468a4ad30 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: No bootstrap required, opened a new log
I20260807 13:50:25.671293 25991 ts_tablet_manager.cc:1403] T 2ec480f94022407f8915e21468a4ad30 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.006s
I20260807 13:50:25.672369 25992 tablet_bootstrap.cc:492] T d356987d307c4d9da967d8141d92c169 P fe8f3cec39fb4964a4fccfd5baa4077b: Bootstrap starting.
I20260807 13:50:25.672421 25991 raft_consensus.cc:359] T 2ec480f94022407f8915e21468a4ad30 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:25.673420 25991 raft_consensus.cc:385] T 2ec480f94022407f8915e21468a4ad30 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:25.673593 25991 raft_consensus.cc:740] T 2ec480f94022407f8915e21468a4ad30 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Initialized, Role: FOLLOWER
I20260807 13:50:25.673980 25991 consensus_queue.cc:260] T 2ec480f94022407f8915e21468a4ad30 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:25.674969 25991 ts_tablet_manager.cc:1434] T 2ec480f94022407f8915e21468a4ad30 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:50:25.676082 25992 tablet_bootstrap.cc:654] T d356987d307c4d9da967d8141d92c169 P fe8f3cec39fb4964a4fccfd5baa4077b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:25.677367 25995 tablet_bootstrap.cc:492] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f: No bootstrap required, opened a new log
I20260807 13:50:25.677659 25995 ts_tablet_manager.cc:1403] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f: Time spent bootstrapping tablet: real 0.036s user 0.005s sys 0.021s
I20260807 13:50:25.677731 25996 tablet_bootstrap.cc:492] T 2ec480f94022407f8915e21468a4ad30 P c8d4866795004103a4b0243906fe4d60: No bootstrap required, opened a new log
I20260807 13:50:25.677901 25996 ts_tablet_manager.cc:1403] T 2ec480f94022407f8915e21468a4ad30 P c8d4866795004103a4b0243906fe4d60: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260807 13:50:25.678793 25996 raft_consensus.cc:359] T 2ec480f94022407f8915e21468a4ad30 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:25.679014 25996 raft_consensus.cc:385] T 2ec480f94022407f8915e21468a4ad30 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:25.678836 25995 raft_consensus.cc:359] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:25.679143 25996 raft_consensus.cc:740] T 2ec480f94022407f8915e21468a4ad30 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8d4866795004103a4b0243906fe4d60, State: Initialized, Role: FOLLOWER
I20260807 13:50:25.679281 25995 raft_consensus.cc:385] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:25.679455 25995 raft_consensus.cc:740] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d3ef3a235844cbbce1370e3aeb809f, State: Initialized, Role: FOLLOWER
I20260807 13:50:25.679394 25996 consensus_queue.cc:260] T 2ec480f94022407f8915e21468a4ad30 P c8d4866795004103a4b0243906fe4d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:25.679914 25995 consensus_queue.cc:260] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:25.680011 25996 ts_tablet_manager.cc:1434] T 2ec480f94022407f8915e21468a4ad30 P c8d4866795004103a4b0243906fe4d60: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:50:25.680347 25996 tablet_bootstrap.cc:492] T d768072cffca4b74a9b790659eec7a24 P c8d4866795004103a4b0243906fe4d60: Bootstrap starting.
I20260807 13:50:25.680748 26000 tablet_bootstrap.cc:492] T d356987d307c4d9da967d8141d92c169 P b890fcdb46dc4597bd9991906433c391: No bootstrap required, opened a new log
I20260807 13:50:25.680914 26000 ts_tablet_manager.cc:1403] T d356987d307c4d9da967d8141d92c169 P b890fcdb46dc4597bd9991906433c391: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.000s
I20260807 13:50:25.681864 26000 raft_consensus.cc:359] T d356987d307c4d9da967d8141d92c169 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:25.682121 26000 raft_consensus.cc:385] T d356987d307c4d9da967d8141d92c169 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:25.682209 25996 tablet_bootstrap.cc:654] T d768072cffca4b74a9b790659eec7a24 P c8d4866795004103a4b0243906fe4d60: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:25.682236 26000 raft_consensus.cc:740] T d356987d307c4d9da967d8141d92c169 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b890fcdb46dc4597bd9991906433c391, State: Initialized, Role: FOLLOWER
I20260807 13:50:25.682498 26000 consensus_queue.cc:260] T d356987d307c4d9da967d8141d92c169 P b890fcdb46dc4597bd9991906433c391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:25.682713 25995 ts_tablet_manager.cc:1434] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260807 13:50:25.683122 25995 tablet_bootstrap.cc:492] T d768072cffca4b74a9b790659eec7a24 P d6d3ef3a235844cbbce1370e3aeb809f: Bootstrap starting.
I20260807 13:50:25.683079 26000 ts_tablet_manager.cc:1434] T d356987d307c4d9da967d8141d92c169 P b890fcdb46dc4597bd9991906433c391: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:50:25.688711 25995 tablet_bootstrap.cc:654] T d768072cffca4b74a9b790659eec7a24 P d6d3ef3a235844cbbce1370e3aeb809f: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:25.691607 25992 tablet_bootstrap.cc:492] T d356987d307c4d9da967d8141d92c169 P fe8f3cec39fb4964a4fccfd5baa4077b: No bootstrap required, opened a new log
I20260807 13:50:25.692169 25992 ts_tablet_manager.cc:1403] T d356987d307c4d9da967d8141d92c169 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.003s
I20260807 13:50:25.693286 25992 raft_consensus.cc:359] T d356987d307c4d9da967d8141d92c169 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:25.693586 25992 raft_consensus.cc:385] T d356987d307c4d9da967d8141d92c169 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:25.693720 25992 raft_consensus.cc:740] T d356987d307c4d9da967d8141d92c169 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8f3cec39fb4964a4fccfd5baa4077b, State: Initialized, Role: FOLLOWER
I20260807 13:50:25.694044 25992 consensus_queue.cc:260] T d356987d307c4d9da967d8141d92c169 P fe8f3cec39fb4964a4fccfd5baa4077b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:25.695755 25992 ts_tablet_manager.cc:1434] T d356987d307c4d9da967d8141d92c169 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 13:50:25.697665 25995 tablet_bootstrap.cc:492] T d768072cffca4b74a9b790659eec7a24 P d6d3ef3a235844cbbce1370e3aeb809f: No bootstrap required, opened a new log
I20260807 13:50:25.697662 25996 tablet_bootstrap.cc:492] T d768072cffca4b74a9b790659eec7a24 P c8d4866795004103a4b0243906fe4d60: No bootstrap required, opened a new log
I20260807 13:50:25.697836 25995 ts_tablet_manager.cc:1403] T d768072cffca4b74a9b790659eec7a24 P d6d3ef3a235844cbbce1370e3aeb809f: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.006s
I20260807 13:50:25.697844 25996 ts_tablet_manager.cc:1403] T d768072cffca4b74a9b790659eec7a24 P c8d4866795004103a4b0243906fe4d60: Time spent bootstrapping tablet: real 0.018s user 0.012s sys 0.004s
I20260807 13:50:25.698689 25995 raft_consensus.cc:359] T d768072cffca4b74a9b790659eec7a24 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:25.698952 25995 raft_consensus.cc:385] T d768072cffca4b74a9b790659eec7a24 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:25.699052 25995 raft_consensus.cc:740] T d768072cffca4b74a9b790659eec7a24 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d3ef3a235844cbbce1370e3aeb809f, State: Initialized, Role: FOLLOWER
I20260807 13:50:25.699332 25995 consensus_queue.cc:260] T d768072cffca4b74a9b790659eec7a24 P d6d3ef3a235844cbbce1370e3aeb809f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:25.699611 25996 raft_consensus.cc:359] T d768072cffca4b74a9b790659eec7a24 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:25.699843 25996 raft_consensus.cc:385] T d768072cffca4b74a9b790659eec7a24 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:25.699890 25995 ts_tablet_manager.cc:1434] T d768072cffca4b74a9b790659eec7a24 P d6d3ef3a235844cbbce1370e3aeb809f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:50:25.699957 25996 raft_consensus.cc:740] T d768072cffca4b74a9b790659eec7a24 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8d4866795004103a4b0243906fe4d60, State: Initialized, Role: FOLLOWER
I20260807 13:50:25.700489 25996 consensus_queue.cc:260] T d768072cffca4b74a9b790659eec7a24 P c8d4866795004103a4b0243906fe4d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:25.701259 25996 ts_tablet_manager.cc:1434] T d768072cffca4b74a9b790659eec7a24 P c8d4866795004103a4b0243906fe4d60: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:50:25.739463 25646 raft_consensus.cc:493] T d768072cffca4b74a9b790659eec7a24 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:25.739675 25646 raft_consensus.cc:515] T d768072cffca4b74a9b790659eec7a24 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:25.740418 25646 leader_election.cc:290] T d768072cffca4b74a9b790659eec7a24 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131), c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641)
I20260807 13:50:25.741118 24955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d768072cffca4b74a9b790659eec7a24" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" is_pre_election: true
I20260807 13:50:25.741178 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d768072cffca4b74a9b790659eec7a24" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60" is_pre_election: true
I20260807 13:50:25.741448 24955 raft_consensus.cc:2468] T d768072cffca4b74a9b790659eec7a24 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 0.
I20260807 13:50:25.741477 24600 raft_consensus.cc:2468] T d768072cffca4b74a9b790659eec7a24 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 0.
I20260807 13:50:25.741978 24152 leader_election.cc:304] T d768072cffca4b74a9b790659eec7a24 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, d6d3ef3a235844cbbce1370e3aeb809f; no voters:
I20260807 13:50:25.742307 25646 raft_consensus.cc:2804] T d768072cffca4b74a9b790659eec7a24 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:25.742445 25646 raft_consensus.cc:493] T d768072cffca4b74a9b790659eec7a24 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:25.742578 25646 raft_consensus.cc:3060] T d768072cffca4b74a9b790659eec7a24 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:25.745966 25646 raft_consensus.cc:515] T d768072cffca4b74a9b790659eec7a24 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:25.746500 25646 leader_election.cc:290] T d768072cffca4b74a9b790659eec7a24 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 election: Requested vote from peers d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131), c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641)
I20260807 13:50:25.747004 24955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d768072cffca4b74a9b790659eec7a24" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d3ef3a235844cbbce1370e3aeb809f"
I20260807 13:50:25.747093 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d768072cffca4b74a9b790659eec7a24" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60"
I20260807 13:50:25.747232 24955 raft_consensus.cc:3060] T d768072cffca4b74a9b790659eec7a24 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:25.747273 24600 raft_consensus.cc:3060] T d768072cffca4b74a9b790659eec7a24 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:25.750443 24955 raft_consensus.cc:2468] T d768072cffca4b74a9b790659eec7a24 P d6d3ef3a235844cbbce1370e3aeb809f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 1.
I20260807 13:50:25.750437 24600 raft_consensus.cc:2468] T d768072cffca4b74a9b790659eec7a24 P c8d4866795004103a4b0243906fe4d60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 1.
I20260807 13:50:25.750910 24152 leader_election.cc:304] T d768072cffca4b74a9b790659eec7a24 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, d6d3ef3a235844cbbce1370e3aeb809f; no voters:
I20260807 13:50:25.751253 25646 raft_consensus.cc:2804] T d768072cffca4b74a9b790659eec7a24 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:25.752043 25646 raft_consensus.cc:697] T d768072cffca4b74a9b790659eec7a24 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 LEADER]: Becoming Leader. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Running, Role: LEADER
I20260807 13:50:25.752573 25646 consensus_queue.cc:237] T d768072cffca4b74a9b790659eec7a24 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:25.755528 24029 catalog_manager.cc:5697] T d768072cffca4b74a9b790659eec7a24 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129). New cstate: current_term: 1 leader_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } health_report { overall_health: UNKNOWN } } }
I20260807 13:50:25.788769 26010 raft_consensus.cc:493] T d356987d307c4d9da967d8141d92c169 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:25.789057 26010 raft_consensus.cc:515] T d356987d307c4d9da967d8141d92c169 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:25.791271 26010 leader_election.cc:290] T d356987d307c4d9da967d8141d92c169 P fe8f3cec39fb4964a4fccfd5baa4077b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1d858e0ace34c39a641ede1db85be11 (127.23.107.134:46341), b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189)
I20260807 13:50:25.799130 25131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d356987d307c4d9da967d8141d92c169" candidate_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1d858e0ace34c39a641ede1db85be11" is_pre_election: true
I20260807 13:50:25.799422 25131 raft_consensus.cc:2468] T d356987d307c4d9da967d8141d92c169 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe8f3cec39fb4964a4fccfd5baa4077b in term 0.
I20260807 13:50:25.799511 24775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d356987d307c4d9da967d8141d92c169" candidate_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b890fcdb46dc4597bd9991906433c391" is_pre_election: true
I20260807 13:50:25.799768 24775 raft_consensus.cc:2468] T d356987d307c4d9da967d8141d92c169 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe8f3cec39fb4964a4fccfd5baa4077b in term 0.
I20260807 13:50:25.800136 24339 leader_election.cc:304] T d356987d307c4d9da967d8141d92c169 P fe8f3cec39fb4964a4fccfd5baa4077b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1d858e0ace34c39a641ede1db85be11, fe8f3cec39fb4964a4fccfd5baa4077b; no voters:
I20260807 13:50:25.800601 26010 raft_consensus.cc:2804] T d356987d307c4d9da967d8141d92c169 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:25.800737 26010 raft_consensus.cc:493] T d356987d307c4d9da967d8141d92c169 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:25.800849 26010 raft_consensus.cc:3060] T d356987d307c4d9da967d8141d92c169 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:25.804214 26010 raft_consensus.cc:515] T d356987d307c4d9da967d8141d92c169 P fe8f3cec39fb4964a4fccfd5baa4077b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:25.804909 26010 leader_election.cc:290] T d356987d307c4d9da967d8141d92c169 P fe8f3cec39fb4964a4fccfd5baa4077b [CANDIDATE]: Term 1 election: Requested vote from peers d1d858e0ace34c39a641ede1db85be11 (127.23.107.134:46341), b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189)
I20260807 13:50:25.805533 25131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d356987d307c4d9da967d8141d92c169" candidate_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1d858e0ace34c39a641ede1db85be11"
I20260807 13:50:25.805591 24775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d356987d307c4d9da967d8141d92c169" candidate_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b890fcdb46dc4597bd9991906433c391"
I20260807 13:50:25.805737 25131 raft_consensus.cc:3060] T d356987d307c4d9da967d8141d92c169 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:25.805816 24775 raft_consensus.cc:3060] T d356987d307c4d9da967d8141d92c169 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:25.808167 24775 raft_consensus.cc:2468] T d356987d307c4d9da967d8141d92c169 P b890fcdb46dc4597bd9991906433c391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe8f3cec39fb4964a4fccfd5baa4077b in term 1.
I20260807 13:50:25.808763 24339 leader_election.cc:304] T d356987d307c4d9da967d8141d92c169 P fe8f3cec39fb4964a4fccfd5baa4077b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b890fcdb46dc4597bd9991906433c391, fe8f3cec39fb4964a4fccfd5baa4077b; no voters:
I20260807 13:50:25.808892 25131 raft_consensus.cc:2468] T d356987d307c4d9da967d8141d92c169 P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe8f3cec39fb4964a4fccfd5baa4077b in term 1.
I20260807 13:50:25.809108 26010 raft_consensus.cc:2804] T d356987d307c4d9da967d8141d92c169 P fe8f3cec39fb4964a4fccfd5baa4077b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:25.809716 26010 raft_consensus.cc:697] T d356987d307c4d9da967d8141d92c169 P fe8f3cec39fb4964a4fccfd5baa4077b [term 1 LEADER]: Becoming Leader. State: Replica: fe8f3cec39fb4964a4fccfd5baa4077b, State: Running, Role: LEADER
I20260807 13:50:25.810318 26010 consensus_queue.cc:237] T d356987d307c4d9da967d8141d92c169 P fe8f3cec39fb4964a4fccfd5baa4077b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:25.814671 24029 catalog_manager.cc:5697] T d356987d307c4d9da967d8141d92c169 P fe8f3cec39fb4964a4fccfd5baa4077b reported cstate change: term changed from 0 to 1, leader changed from <none> to fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130). New cstate: current_term: 1 leader_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } health_report { overall_health: UNKNOWN } } }
I20260807 13:50:25.966919 25773 raft_consensus.cc:493] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:25.967183 25773 raft_consensus.cc:515] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:25.967983 25773 leader_election.cc:290] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973), c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641)
I20260807 13:50:25.968782 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec480f94022407f8915e21468a4ad30" candidate_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60" is_pre_election: true
I20260807 13:50:25.968782 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec480f94022407f8915e21468a4ad30" candidate_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" is_pre_election: true
I20260807 13:50:25.969023 24240 raft_consensus.cc:2468] T 2ec480f94022407f8915e21468a4ad30 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6d3ef3a235844cbbce1370e3aeb809f in term 0.
I20260807 13:50:25.969049 24600 raft_consensus.cc:2468] T 2ec480f94022407f8915e21468a4ad30 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6d3ef3a235844cbbce1370e3aeb809f in term 0.
I20260807 13:50:25.969669 24863 leader_election.cc:304] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, c8d4866795004103a4b0243906fe4d60, d6d3ef3a235844cbbce1370e3aeb809f; no voters:
I20260807 13:50:25.970016 25773 raft_consensus.cc:2804] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:25.970122 25773 raft_consensus.cc:493] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:25.970242 25773 raft_consensus.cc:3060] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:25.972203 25773 raft_consensus.cc:515] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:25.972992 25773 leader_election.cc:290] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f [CANDIDATE]: Term 1 election: Requested vote from peers 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973), c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641)
I20260807 13:50:25.973377 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec480f94022407f8915e21468a4ad30" candidate_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4"
I20260807 13:50:25.973587 24240 raft_consensus.cc:3060] T 2ec480f94022407f8915e21468a4ad30 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:25.974501 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec480f94022407f8915e21468a4ad30" candidate_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60"
I20260807 13:50:25.974717 24600 raft_consensus.cc:3060] T 2ec480f94022407f8915e21468a4ad30 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:25.976543 24240 raft_consensus.cc:2468] T 2ec480f94022407f8915e21468a4ad30 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6d3ef3a235844cbbce1370e3aeb809f in term 1.
I20260807 13:50:25.977068 24864 leader_election.cc:304] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, d6d3ef3a235844cbbce1370e3aeb809f; no voters:
I20260807 13:50:25.977392 25773 raft_consensus.cc:2804] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:25.977680 24600 raft_consensus.cc:2468] T 2ec480f94022407f8915e21468a4ad30 P c8d4866795004103a4b0243906fe4d60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6d3ef3a235844cbbce1370e3aeb809f in term 1.
I20260807 13:50:25.979538 25773 raft_consensus.cc:697] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f [term 1 LEADER]: Becoming Leader. State: Replica: d6d3ef3a235844cbbce1370e3aeb809f, State: Running, Role: LEADER
I20260807 13:50:25.979875 25773 consensus_queue.cc:237] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:25.983378 24029 catalog_manager.cc:5697] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f reported cstate change: term changed from 0 to 1, leader changed from <none> to d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133). New cstate: current_term: 1 leader_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } health_report { overall_health: UNKNOWN } } }
I20260807 13:50:26.161262 26012 consensus_queue.cc:1048] T d768072cffca4b74a9b790659eec7a24 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:26.168437 26013 consensus_queue.cc:1048] T d768072cffca4b74a9b790659eec7a24 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:26.235659 26010 consensus_queue.cc:1048] T d356987d307c4d9da967d8141d92c169 P fe8f3cec39fb4964a4fccfd5baa4077b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:26.242504 26018 consensus_queue.cc:1048] T d356987d307c4d9da967d8141d92c169 P fe8f3cec39fb4964a4fccfd5baa4077b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:50:26.379302 26025 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:26.379745 26025 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_6'
I20260807 13:50:26.440757 25773 consensus_queue.cc:1048] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:26.449663 25773 consensus_queue.cc:1048] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 325.99 ms
time per row: 0.162995 ms
I20260807 13:50:26.923287 24025 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43984:
name: "rebalance_test_table_7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:50:26.933600 25106 tablet_service.cc:1511] Processing CreateTablet for tablet 31045028ef8c4da7ab6f78c91ad09438 (DEFAULT_TABLE table=rebalance_test_table_7 [id=2f1baa7f130a46e39748104c2e69ec3e]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:26.933873 24396 tablet_service.cc:1511] Processing CreateTablet for tablet 31045028ef8c4da7ab6f78c91ad09438 (DEFAULT_TABLE table=rebalance_test_table_7 [id=2f1baa7f130a46e39748104c2e69ec3e]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:26.934134 25106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31045028ef8c4da7ab6f78c91ad09438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:26.934337 24396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31045028ef8c4da7ab6f78c91ad09438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:26.934324 24750 tablet_service.cc:1511] Processing CreateTablet for tablet 31045028ef8c4da7ab6f78c91ad09438 (DEFAULT_TABLE table=rebalance_test_table_7 [id=2f1baa7f130a46e39748104c2e69ec3e]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:26.934759 24750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31045028ef8c4da7ab6f78c91ad09438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:26.935523 24211 tablet_service.cc:1511] Processing CreateTablet for tablet fb4c905b1bc94ffaa04bf4b7b98d269e (DEFAULT_TABLE table=rebalance_test_table_7 [id=2f1baa7f130a46e39748104c2e69ec3e]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:26.935961 24211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb4c905b1bc94ffaa04bf4b7b98d269e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:26.940421 24395 tablet_service.cc:1511] Processing CreateTablet for tablet 1ae0536d54d649cea511122997228e77 (DEFAULT_TABLE table=rebalance_test_table_7 [id=2f1baa7f130a46e39748104c2e69ec3e]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:26.940861 24395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ae0536d54d649cea511122997228e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:26.945924 24573 tablet_service.cc:1511] Processing CreateTablet for tablet fb4c905b1bc94ffaa04bf4b7b98d269e (DEFAULT_TABLE table=rebalance_test_table_7 [id=2f1baa7f130a46e39748104c2e69ec3e]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:26.946555 24573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb4c905b1bc94ffaa04bf4b7b98d269e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:26.950309 24926 tablet_service.cc:1511] Processing CreateTablet for tablet fb4c905b1bc94ffaa04bf4b7b98d269e (DEFAULT_TABLE table=rebalance_test_table_7 [id=2f1baa7f130a46e39748104c2e69ec3e]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:26.950930 24926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb4c905b1bc94ffaa04bf4b7b98d269e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:26.953269 26118 tablet_bootstrap.cc:492] T 31045028ef8c4da7ab6f78c91ad09438 P fe8f3cec39fb4964a4fccfd5baa4077b: Bootstrap starting.
I20260807 13:50:26.955603 26118 tablet_bootstrap.cc:654] T 31045028ef8c4da7ab6f78c91ad09438 P fe8f3cec39fb4964a4fccfd5baa4077b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:26.958135 25107 tablet_service.cc:1511] Processing CreateTablet for tablet 1ae0536d54d649cea511122997228e77 (DEFAULT_TABLE table=rebalance_test_table_7 [id=2f1baa7f130a46e39748104c2e69ec3e]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:26.958688 25107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ae0536d54d649cea511122997228e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:26.958835 24751 tablet_service.cc:1511] Processing CreateTablet for tablet 1ae0536d54d649cea511122997228e77 (DEFAULT_TABLE table=rebalance_test_table_7 [id=2f1baa7f130a46e39748104c2e69ec3e]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:26.959302 24751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ae0536d54d649cea511122997228e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:26.970793 26117 tablet_bootstrap.cc:492] T fb4c905b1bc94ffaa04bf4b7b98d269e P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Bootstrap starting.
I20260807 13:50:26.974108 26117 tablet_bootstrap.cc:654] T fb4c905b1bc94ffaa04bf4b7b98d269e P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:26.992514 26117 tablet_bootstrap.cc:492] T fb4c905b1bc94ffaa04bf4b7b98d269e P 4d09f7af7d9d4d07bfb2114f45e9e8a4: No bootstrap required, opened a new log
I20260807 13:50:26.993665 26121 tablet_bootstrap.cc:492] T 1ae0536d54d649cea511122997228e77 P b890fcdb46dc4597bd9991906433c391: Bootstrap starting.
I20260807 13:50:26.994022 26117 ts_tablet_manager.cc:1403] T fb4c905b1bc94ffaa04bf4b7b98d269e P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.000s
I20260807 13:50:26.995066 26117 raft_consensus.cc:359] T fb4c905b1bc94ffaa04bf4b7b98d269e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:26.995316 26117 raft_consensus.cc:385] T fb4c905b1bc94ffaa04bf4b7b98d269e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:26.995416 26117 raft_consensus.cc:740] T fb4c905b1bc94ffaa04bf4b7b98d269e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Initialized, Role: FOLLOWER
I20260807 13:50:26.995690 26117 consensus_queue.cc:260] T fb4c905b1bc94ffaa04bf4b7b98d269e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:26.996378 26117 ts_tablet_manager.cc:1434] T fb4c905b1bc94ffaa04bf4b7b98d269e P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 13:50:27.003268 26121 tablet_bootstrap.cc:654] T 1ae0536d54d649cea511122997228e77 P b890fcdb46dc4597bd9991906433c391: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:27.011893 26121 tablet_bootstrap.cc:492] T 1ae0536d54d649cea511122997228e77 P b890fcdb46dc4597bd9991906433c391: No bootstrap required, opened a new log
I20260807 13:50:27.012080 26121 ts_tablet_manager.cc:1403] T 1ae0536d54d649cea511122997228e77 P b890fcdb46dc4597bd9991906433c391: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.003s
I20260807 13:50:27.012926 26121 raft_consensus.cc:359] T 1ae0536d54d649cea511122997228e77 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:27.013175 26121 raft_consensus.cc:385] T 1ae0536d54d649cea511122997228e77 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:27.013283 26121 raft_consensus.cc:740] T 1ae0536d54d649cea511122997228e77 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b890fcdb46dc4597bd9991906433c391, State: Initialized, Role: FOLLOWER
I20260807 13:50:27.017184 26121 consensus_queue.cc:260] T 1ae0536d54d649cea511122997228e77 P b890fcdb46dc4597bd9991906433c391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:27.019980 26121 ts_tablet_manager.cc:1434] T 1ae0536d54d649cea511122997228e77 P b890fcdb46dc4597bd9991906433c391: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260807 13:50:27.020298 26121 tablet_bootstrap.cc:492] T 31045028ef8c4da7ab6f78c91ad09438 P b890fcdb46dc4597bd9991906433c391: Bootstrap starting.
I20260807 13:50:27.022076 26121 tablet_bootstrap.cc:654] T 31045028ef8c4da7ab6f78c91ad09438 P b890fcdb46dc4597bd9991906433c391: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:27.025394 26126 tablet_bootstrap.cc:492] T fb4c905b1bc94ffaa04bf4b7b98d269e P d6d3ef3a235844cbbce1370e3aeb809f: Bootstrap starting.
I20260807 13:50:27.030160 26125 tablet_bootstrap.cc:492] T fb4c905b1bc94ffaa04bf4b7b98d269e P c8d4866795004103a4b0243906fe4d60: Bootstrap starting.
I20260807 13:50:27.032970 26126 tablet_bootstrap.cc:654] T fb4c905b1bc94ffaa04bf4b7b98d269e P d6d3ef3a235844cbbce1370e3aeb809f: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:27.035609 26125 tablet_bootstrap.cc:654] T fb4c905b1bc94ffaa04bf4b7b98d269e P c8d4866795004103a4b0243906fe4d60: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:27.037427 26116 tablet_bootstrap.cc:492] T 31045028ef8c4da7ab6f78c91ad09438 P d1d858e0ace34c39a641ede1db85be11: Bootstrap starting.
I20260807 13:50:27.037675 26118 tablet_bootstrap.cc:492] T 31045028ef8c4da7ab6f78c91ad09438 P fe8f3cec39fb4964a4fccfd5baa4077b: No bootstrap required, opened a new log
I20260807 13:50:27.037955 26118 ts_tablet_manager.cc:1403] T 31045028ef8c4da7ab6f78c91ad09438 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent bootstrapping tablet: real 0.085s user 0.035s sys 0.026s
I20260807 13:50:27.038923 26121 tablet_bootstrap.cc:492] T 31045028ef8c4da7ab6f78c91ad09438 P b890fcdb46dc4597bd9991906433c391: No bootstrap required, opened a new log
I20260807 13:50:27.039175 26121 ts_tablet_manager.cc:1403] T 31045028ef8c4da7ab6f78c91ad09438 P b890fcdb46dc4597bd9991906433c391: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.002s
I20260807 13:50:27.039038 26118 raft_consensus.cc:359] T 31045028ef8c4da7ab6f78c91ad09438 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:27.039289 26118 raft_consensus.cc:385] T 31045028ef8c4da7ab6f78c91ad09438 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:27.039479 26118 raft_consensus.cc:740] T 31045028ef8c4da7ab6f78c91ad09438 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8f3cec39fb4964a4fccfd5baa4077b, State: Initialized, Role: FOLLOWER
I20260807 13:50:27.039558 26116 tablet_bootstrap.cc:654] T 31045028ef8c4da7ab6f78c91ad09438 P d1d858e0ace34c39a641ede1db85be11: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:27.039880 26118 consensus_queue.cc:260] T 31045028ef8c4da7ab6f78c91ad09438 P fe8f3cec39fb4964a4fccfd5baa4077b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:27.040186 26121 raft_consensus.cc:359] T 31045028ef8c4da7ab6f78c91ad09438 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:27.040481 26121 raft_consensus.cc:385] T 31045028ef8c4da7ab6f78c91ad09438 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:27.040635 26121 raft_consensus.cc:740] T 31045028ef8c4da7ab6f78c91ad09438 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b890fcdb46dc4597bd9991906433c391, State: Initialized, Role: FOLLOWER
I20260807 13:50:27.041038 26121 consensus_queue.cc:260] T 31045028ef8c4da7ab6f78c91ad09438 P b890fcdb46dc4597bd9991906433c391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:27.041884 26121 ts_tablet_manager.cc:1434] T 31045028ef8c4da7ab6f78c91ad09438 P b890fcdb46dc4597bd9991906433c391: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260807 13:50:27.043278 26126 tablet_bootstrap.cc:492] T fb4c905b1bc94ffaa04bf4b7b98d269e P d6d3ef3a235844cbbce1370e3aeb809f: No bootstrap required, opened a new log
I20260807 13:50:27.043548 26126 ts_tablet_manager.cc:1403] T fb4c905b1bc94ffaa04bf4b7b98d269e P d6d3ef3a235844cbbce1370e3aeb809f: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.005s
I20260807 13:50:27.044276 26118 ts_tablet_manager.cc:1434] T 31045028ef8c4da7ab6f78c91ad09438 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260807 13:50:27.045495 26118 tablet_bootstrap.cc:492] T 1ae0536d54d649cea511122997228e77 P fe8f3cec39fb4964a4fccfd5baa4077b: Bootstrap starting.
I20260807 13:50:27.044924 26126 raft_consensus.cc:359] T fb4c905b1bc94ffaa04bf4b7b98d269e P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:27.046223 26126 raft_consensus.cc:385] T fb4c905b1bc94ffaa04bf4b7b98d269e P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:27.046381 26126 raft_consensus.cc:740] T fb4c905b1bc94ffaa04bf4b7b98d269e P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d3ef3a235844cbbce1370e3aeb809f, State: Initialized, Role: FOLLOWER
I20260807 13:50:27.047099 26126 consensus_queue.cc:260] T fb4c905b1bc94ffaa04bf4b7b98d269e P d6d3ef3a235844cbbce1370e3aeb809f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:27.048256 26116 tablet_bootstrap.cc:492] T 31045028ef8c4da7ab6f78c91ad09438 P d1d858e0ace34c39a641ede1db85be11: No bootstrap required, opened a new log
I20260807 13:50:27.048471 26116 ts_tablet_manager.cc:1403] T 31045028ef8c4da7ab6f78c91ad09438 P d1d858e0ace34c39a641ede1db85be11: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.003s
I20260807 13:50:27.048913 25470 raft_consensus.cc:493] T 31045028ef8c4da7ab6f78c91ad09438 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:27.049121 25470 raft_consensus.cc:515] T 31045028ef8c4da7ab6f78c91ad09438 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:27.049430 26116 raft_consensus.cc:359] T 31045028ef8c4da7ab6f78c91ad09438 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:27.049641 26116 raft_consensus.cc:385] T 31045028ef8c4da7ab6f78c91ad09438 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:27.049741 26116 raft_consensus.cc:740] T 31045028ef8c4da7ab6f78c91ad09438 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Initialized, Role: FOLLOWER
I20260807 13:50:27.050020 25470 leader_election.cc:290] T 31045028ef8c4da7ab6f78c91ad09438 P b890fcdb46dc4597bd9991906433c391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1d858e0ace34c39a641ede1db85be11 (127.23.107.134:46341), fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619)
I20260807 13:50:27.050009 26116 consensus_queue.cc:260] T 31045028ef8c4da7ab6f78c91ad09438 P d1d858e0ace34c39a641ede1db85be11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:27.050863 25131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31045028ef8c4da7ab6f78c91ad09438" candidate_uuid: "b890fcdb46dc4597bd9991906433c391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1d858e0ace34c39a641ede1db85be11" is_pre_election: true
I20260807 13:50:27.051000 26118 tablet_bootstrap.cc:654] T 1ae0536d54d649cea511122997228e77 P fe8f3cec39fb4964a4fccfd5baa4077b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:27.051126 25131 raft_consensus.cc:2468] T 31045028ef8c4da7ab6f78c91ad09438 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b890fcdb46dc4597bd9991906433c391 in term 0.
I20260807 13:50:27.051481 26116 ts_tablet_manager.cc:1434] T 31045028ef8c4da7ab6f78c91ad09438 P d1d858e0ace34c39a641ede1db85be11: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:50:27.051769 26116 tablet_bootstrap.cc:492] T 1ae0536d54d649cea511122997228e77 P d1d858e0ace34c39a641ede1db85be11: Bootstrap starting.
I20260807 13:50:27.051929 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31045028ef8c4da7ab6f78c91ad09438" candidate_uuid: "b890fcdb46dc4597bd9991906433c391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" is_pre_election: true
I20260807 13:50:27.052172 24425 raft_consensus.cc:2468] T 31045028ef8c4da7ab6f78c91ad09438 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b890fcdb46dc4597bd9991906433c391 in term 0.
I20260807 13:50:27.053180 24688 leader_election.cc:304] T 31045028ef8c4da7ab6f78c91ad09438 P b890fcdb46dc4597bd9991906433c391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b890fcdb46dc4597bd9991906433c391, d1d858e0ace34c39a641ede1db85be11; no voters:
I20260807 13:50:27.054414 26116 tablet_bootstrap.cc:654] T 1ae0536d54d649cea511122997228e77 P d1d858e0ace34c39a641ede1db85be11: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:27.056219 25470 raft_consensus.cc:2804] T 31045028ef8c4da7ab6f78c91ad09438 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:27.056375 25470 raft_consensus.cc:493] T 31045028ef8c4da7ab6f78c91ad09438 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:27.056559 25470 raft_consensus.cc:3060] T 31045028ef8c4da7ab6f78c91ad09438 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:27.058054 26126 ts_tablet_manager.cc:1434] T fb4c905b1bc94ffaa04bf4b7b98d269e P d6d3ef3a235844cbbce1370e3aeb809f: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260807 13:50:27.061981 25470 raft_consensus.cc:515] T 31045028ef8c4da7ab6f78c91ad09438 P b890fcdb46dc4597bd9991906433c391 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:27.063732 25131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31045028ef8c4da7ab6f78c91ad09438" candidate_uuid: "b890fcdb46dc4597bd9991906433c391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1d858e0ace34c39a641ede1db85be11"
I20260807 13:50:27.063884 26125 tablet_bootstrap.cc:492] T fb4c905b1bc94ffaa04bf4b7b98d269e P c8d4866795004103a4b0243906fe4d60: No bootstrap required, opened a new log
I20260807 13:50:27.064055 25131 raft_consensus.cc:3060] T 31045028ef8c4da7ab6f78c91ad09438 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:27.064086 26125 ts_tablet_manager.cc:1403] T fb4c905b1bc94ffaa04bf4b7b98d269e P c8d4866795004103a4b0243906fe4d60: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.005s
I20260807 13:50:27.065219 26125 raft_consensus.cc:359] T fb4c905b1bc94ffaa04bf4b7b98d269e P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:27.065518 26125 raft_consensus.cc:385] T fb4c905b1bc94ffaa04bf4b7b98d269e P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:27.065626 26125 raft_consensus.cc:740] T fb4c905b1bc94ffaa04bf4b7b98d269e P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8d4866795004103a4b0243906fe4d60, State: Initialized, Role: FOLLOWER
I20260807 13:50:27.065938 26125 consensus_queue.cc:260] T fb4c905b1bc94ffaa04bf4b7b98d269e P c8d4866795004103a4b0243906fe4d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:27.066952 26125 ts_tablet_manager.cc:1434] T fb4c905b1bc94ffaa04bf4b7b98d269e P c8d4866795004103a4b0243906fe4d60: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260807 13:50:27.069135 26116 tablet_bootstrap.cc:492] T 1ae0536d54d649cea511122997228e77 P d1d858e0ace34c39a641ede1db85be11: No bootstrap required, opened a new log
I20260807 13:50:27.069185 26118 tablet_bootstrap.cc:492] T 1ae0536d54d649cea511122997228e77 P fe8f3cec39fb4964a4fccfd5baa4077b: No bootstrap required, opened a new log
I20260807 13:50:27.069319 26116 ts_tablet_manager.cc:1403] T 1ae0536d54d649cea511122997228e77 P d1d858e0ace34c39a641ede1db85be11: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.008s
I20260807 13:50:27.069677 26118 ts_tablet_manager.cc:1403] T 1ae0536d54d649cea511122997228e77 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent bootstrapping tablet: real 0.024s user 0.008s sys 0.007s
I20260807 13:50:27.070273 26116 raft_consensus.cc:359] T 1ae0536d54d649cea511122997228e77 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:27.070555 26116 raft_consensus.cc:385] T 1ae0536d54d649cea511122997228e77 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:27.070724 26116 raft_consensus.cc:740] T 1ae0536d54d649cea511122997228e77 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Initialized, Role: FOLLOWER
I20260807 13:50:27.070904 26118 raft_consensus.cc:359] T 1ae0536d54d649cea511122997228e77 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:27.071012 26116 consensus_queue.cc:260] T 1ae0536d54d649cea511122997228e77 P d1d858e0ace34c39a641ede1db85be11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:27.071136 26118 raft_consensus.cc:385] T 1ae0536d54d649cea511122997228e77 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:27.071201 26118 raft_consensus.cc:740] T 1ae0536d54d649cea511122997228e77 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8f3cec39fb4964a4fccfd5baa4077b, State: Initialized, Role: FOLLOWER
I20260807 13:50:27.071506 26118 consensus_queue.cc:260] T 1ae0536d54d649cea511122997228e77 P fe8f3cec39fb4964a4fccfd5baa4077b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:27.072252 26116 ts_tablet_manager.cc:1434] T 1ae0536d54d649cea511122997228e77 P d1d858e0ace34c39a641ede1db85be11: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260807 13:50:27.072866 26118 ts_tablet_manager.cc:1434] T 1ae0536d54d649cea511122997228e77 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:50:27.073328 25131 raft_consensus.cc:2468] T 31045028ef8c4da7ab6f78c91ad09438 P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b890fcdb46dc4597bd9991906433c391 in term 1.
I20260807 13:50:27.073769 25470 leader_election.cc:290] T 31045028ef8c4da7ab6f78c91ad09438 P b890fcdb46dc4597bd9991906433c391 [CANDIDATE]: Term 1 election: Requested vote from peers d1d858e0ace34c39a641ede1db85be11 (127.23.107.134:46341), fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619)
I20260807 13:50:27.074147 24688 leader_election.cc:304] T 31045028ef8c4da7ab6f78c91ad09438 P b890fcdb46dc4597bd9991906433c391 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b890fcdb46dc4597bd9991906433c391, d1d858e0ace34c39a641ede1db85be11; no voters:
I20260807 13:50:27.074599 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31045028ef8c4da7ab6f78c91ad09438" candidate_uuid: "b890fcdb46dc4597bd9991906433c391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b"
I20260807 13:50:27.074796 24425 raft_consensus.cc:3060] T 31045028ef8c4da7ab6f78c91ad09438 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:27.076258 25470 raft_consensus.cc:2804] T 31045028ef8c4da7ab6f78c91ad09438 P b890fcdb46dc4597bd9991906433c391 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:27.077020 25470 raft_consensus.cc:697] T 31045028ef8c4da7ab6f78c91ad09438 P b890fcdb46dc4597bd9991906433c391 [term 1 LEADER]: Becoming Leader. State: Replica: b890fcdb46dc4597bd9991906433c391, State: Running, Role: LEADER
I20260807 13:50:27.077461 25470 consensus_queue.cc:237] T 31045028ef8c4da7ab6f78c91ad09438 P b890fcdb46dc4597bd9991906433c391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:27.077898 24425 raft_consensus.cc:2468] T 31045028ef8c4da7ab6f78c91ad09438 P fe8f3cec39fb4964a4fccfd5baa4077b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b890fcdb46dc4597bd9991906433c391 in term 1.
I20260807 13:50:27.081053 24025 catalog_manager.cc:5697] T 31045028ef8c4da7ab6f78c91ad09438 P b890fcdb46dc4597bd9991906433c391 reported cstate change: term changed from 0 to 1, leader changed from <none> to b890fcdb46dc4597bd9991906433c391 (127.23.107.132). New cstate: current_term: 1 leader_uuid: "b890fcdb46dc4597bd9991906433c391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } health_report { overall_health: HEALTHY } } }
I20260807 13:50:27.093395 26089 raft_consensus.cc:493] T 1ae0536d54d649cea511122997228e77 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:27.093668 26089 raft_consensus.cc:515] T 1ae0536d54d649cea511122997228e77 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:27.094422 26089 leader_election.cc:290] T 1ae0536d54d649cea511122997228e77 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619), b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189)
I20260807 13:50:27.095117 24775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae0536d54d649cea511122997228e77" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b890fcdb46dc4597bd9991906433c391" is_pre_election: true
I20260807 13:50:27.095407 24775 raft_consensus.cc:2468] T 1ae0536d54d649cea511122997228e77 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 0.
I20260807 13:50:27.096031 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae0536d54d649cea511122997228e77" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" is_pre_election: true
I20260807 13:50:27.096117 25047 leader_election.cc:304] T 1ae0536d54d649cea511122997228e77 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b890fcdb46dc4597bd9991906433c391, d1d858e0ace34c39a641ede1db85be11; no voters:
I20260807 13:50:27.096298 24425 raft_consensus.cc:2468] T 1ae0536d54d649cea511122997228e77 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 0.
I20260807 13:50:27.096455 26089 raft_consensus.cc:2804] T 1ae0536d54d649cea511122997228e77 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:27.096576 26089 raft_consensus.cc:493] T 1ae0536d54d649cea511122997228e77 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:27.096688 26089 raft_consensus.cc:3060] T 1ae0536d54d649cea511122997228e77 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:27.099367 26089 raft_consensus.cc:515] T 1ae0536d54d649cea511122997228e77 P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:27.099967 26089 leader_election.cc:290] T 1ae0536d54d649cea511122997228e77 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 election: Requested vote from peers fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619), b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189)
I20260807 13:50:27.100433 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae0536d54d649cea511122997228e77" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b"
I20260807 13:50:27.100610 24775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae0536d54d649cea511122997228e77" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b890fcdb46dc4597bd9991906433c391"
I20260807 13:50:27.100684 24425 raft_consensus.cc:3060] T 1ae0536d54d649cea511122997228e77 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:27.100863 24775 raft_consensus.cc:3060] T 1ae0536d54d649cea511122997228e77 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:27.102895 24425 raft_consensus.cc:2468] T 1ae0536d54d649cea511122997228e77 P fe8f3cec39fb4964a4fccfd5baa4077b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 1.
I20260807 13:50:27.103235 24775 raft_consensus.cc:2468] T 1ae0536d54d649cea511122997228e77 P b890fcdb46dc4597bd9991906433c391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 1.
I20260807 13:50:27.103802 25049 leader_election.cc:304] T 1ae0536d54d649cea511122997228e77 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: b890fcdb46dc4597bd9991906433c391, d1d858e0ace34c39a641ede1db85be11, fe8f3cec39fb4964a4fccfd5baa4077b; no voters:
I20260807 13:50:27.104130 26089 raft_consensus.cc:2804] T 1ae0536d54d649cea511122997228e77 P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:27.104252 26089 raft_consensus.cc:697] T 1ae0536d54d649cea511122997228e77 P d1d858e0ace34c39a641ede1db85be11 [term 1 LEADER]: Becoming Leader. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Running, Role: LEADER
I20260807 13:50:27.104578 26089 consensus_queue.cc:237] T 1ae0536d54d649cea511122997228e77 P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:27.107944 24025 catalog_manager.cc:5697] T 1ae0536d54d649cea511122997228e77 P d1d858e0ace34c39a641ede1db85be11 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1d858e0ace34c39a641ede1db85be11 (127.23.107.134). New cstate: current_term: 1 leader_uuid: "d1d858e0ace34c39a641ede1db85be11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } health_report { overall_health: UNKNOWN } } }
I20260807 13:50:27.314492 26068 raft_consensus.cc:493] T fb4c905b1bc94ffaa04bf4b7b98d269e P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:27.314744 26068 raft_consensus.cc:515] T fb4c905b1bc94ffaa04bf4b7b98d269e P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:27.315711 26068 leader_election.cc:290] T fb4c905b1bc94ffaa04bf4b7b98d269e P d6d3ef3a235844cbbce1370e3aeb809f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973), c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641)
I20260807 13:50:27.316260 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4c905b1bc94ffaa04bf4b7b98d269e" candidate_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" is_pre_election: true
I20260807 13:50:27.316545 24240 raft_consensus.cc:2468] T fb4c905b1bc94ffaa04bf4b7b98d269e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6d3ef3a235844cbbce1370e3aeb809f in term 0.
I20260807 13:50:27.316774 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4c905b1bc94ffaa04bf4b7b98d269e" candidate_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60" is_pre_election: true
I20260807 13:50:27.317090 24600 raft_consensus.cc:2468] T fb4c905b1bc94ffaa04bf4b7b98d269e P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6d3ef3a235844cbbce1370e3aeb809f in term 0.
I20260807 13:50:27.317106 24864 leader_election.cc:304] T fb4c905b1bc94ffaa04bf4b7b98d269e P d6d3ef3a235844cbbce1370e3aeb809f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, d6d3ef3a235844cbbce1370e3aeb809f; no voters:
I20260807 13:50:27.317479 26068 raft_consensus.cc:2804] T fb4c905b1bc94ffaa04bf4b7b98d269e P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:27.317576 26068 raft_consensus.cc:493] T fb4c905b1bc94ffaa04bf4b7b98d269e P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:27.317637 26068 raft_consensus.cc:3060] T fb4c905b1bc94ffaa04bf4b7b98d269e P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:27.320348 26068 raft_consensus.cc:515] T fb4c905b1bc94ffaa04bf4b7b98d269e P d6d3ef3a235844cbbce1370e3aeb809f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:27.320953 26068 leader_election.cc:290] T fb4c905b1bc94ffaa04bf4b7b98d269e P d6d3ef3a235844cbbce1370e3aeb809f [CANDIDATE]: Term 1 election: Requested vote from peers 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973), c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641)
I20260807 13:50:27.321569 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4c905b1bc94ffaa04bf4b7b98d269e" candidate_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4"
I20260807 13:50:27.321830 24240 raft_consensus.cc:3060] T fb4c905b1bc94ffaa04bf4b7b98d269e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:27.322084 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4c905b1bc94ffaa04bf4b7b98d269e" candidate_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60"
I20260807 13:50:27.322300 24600 raft_consensus.cc:3060] T fb4c905b1bc94ffaa04bf4b7b98d269e P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:27.325125 24240 raft_consensus.cc:2468] T fb4c905b1bc94ffaa04bf4b7b98d269e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6d3ef3a235844cbbce1370e3aeb809f in term 1.
I20260807 13:50:27.325390 24600 raft_consensus.cc:2468] T fb4c905b1bc94ffaa04bf4b7b98d269e P c8d4866795004103a4b0243906fe4d60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6d3ef3a235844cbbce1370e3aeb809f in term 1.
I20260807 13:50:27.325946 24864 leader_election.cc:304] T fb4c905b1bc94ffaa04bf4b7b98d269e P d6d3ef3a235844cbbce1370e3aeb809f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, c8d4866795004103a4b0243906fe4d60, d6d3ef3a235844cbbce1370e3aeb809f; no voters:
I20260807 13:50:27.326344 26068 raft_consensus.cc:2804] T fb4c905b1bc94ffaa04bf4b7b98d269e P d6d3ef3a235844cbbce1370e3aeb809f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:27.326797 26068 raft_consensus.cc:697] T fb4c905b1bc94ffaa04bf4b7b98d269e P d6d3ef3a235844cbbce1370e3aeb809f [term 1 LEADER]: Becoming Leader. State: Replica: d6d3ef3a235844cbbce1370e3aeb809f, State: Running, Role: LEADER
I20260807 13:50:27.327196 26068 consensus_queue.cc:237] T fb4c905b1bc94ffaa04bf4b7b98d269e P d6d3ef3a235844cbbce1370e3aeb809f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:27.331368 24025 catalog_manager.cc:5697] T fb4c905b1bc94ffaa04bf4b7b98d269e P d6d3ef3a235844cbbce1370e3aeb809f reported cstate change: term changed from 0 to 1, leader changed from <none> to d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133). New cstate: current_term: 1 leader_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } health_report { overall_health: UNKNOWN } } }
I20260807 13:50:27.561826 25470 consensus_queue.cc:1048] T 31045028ef8c4da7ab6f78c91ad09438 P b890fcdb46dc4597bd9991906433c391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:27.568053 25470 consensus_queue.cc:1048] T 31045028ef8c4da7ab6f78c91ad09438 P b890fcdb46dc4597bd9991906433c391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:27.612249 26089 consensus_queue.cc:1048] T 1ae0536d54d649cea511122997228e77 P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:27.612995 26089 consensus_queue.cc:1048] T 1ae0536d54d649cea511122997228e77 P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:27.705752 26068 consensus_queue.cc:1048] T fb4c905b1bc94ffaa04bf4b7b98d269e P d6d3ef3a235844cbbce1370e3aeb809f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:27.714923 26068 consensus_queue.cc:1048] T fb4c905b1bc94ffaa04bf4b7b98d269e P d6d3ef3a235844cbbce1370e3aeb809f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:50:27.767983 26143 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:27.768421 26143 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_7'
INSERT report
rows total: 2000
time total: 311.583 ms
time per row: 0.155792 ms
I20260807 13:50:28.302798 24025 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43984:
name: "rebalance_test_table_8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:50:28.313639 24211 tablet_service.cc:1511] Processing CreateTablet for tablet 2df3f87f0d47451d9d8efaa9e4d3727d (DEFAULT_TABLE table=rebalance_test_table_8 [id=b92f3ae92b934b5fb6f7206a582d845f]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:28.314237 24211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df3f87f0d47451d9d8efaa9e4d3727d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:28.314265 24573 tablet_service.cc:1511] Processing CreateTablet for tablet 2df3f87f0d47451d9d8efaa9e4d3727d (DEFAULT_TABLE table=rebalance_test_table_8 [id=b92f3ae92b934b5fb6f7206a582d845f]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:28.314745 24573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df3f87f0d47451d9d8efaa9e4d3727d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:28.314751 24926 tablet_service.cc:1511] Processing CreateTablet for tablet 2df3f87f0d47451d9d8efaa9e4d3727d (DEFAULT_TABLE table=rebalance_test_table_8 [id=b92f3ae92b934b5fb6f7206a582d845f]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:28.315227 24926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df3f87f0d47451d9d8efaa9e4d3727d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:28.318320 24927 tablet_service.cc:1511] Processing CreateTablet for tablet 3e647f2b7d7a4177b4ada37eea66d8dd (DEFAULT_TABLE table=rebalance_test_table_8 [id=b92f3ae92b934b5fb6f7206a582d845f]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:28.318609 24395 tablet_service.cc:1511] Processing CreateTablet for tablet c82b10494c3e4b63974a9c574543b1ab (DEFAULT_TABLE table=rebalance_test_table_8 [id=b92f3ae92b934b5fb6f7206a582d845f]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:28.318641 24210 tablet_service.cc:1511] Processing CreateTablet for tablet 3e647f2b7d7a4177b4ada37eea66d8dd (DEFAULT_TABLE table=rebalance_test_table_8 [id=b92f3ae92b934b5fb6f7206a582d845f]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:28.318787 24927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e647f2b7d7a4177b4ada37eea66d8dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:28.319074 24395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c82b10494c3e4b63974a9c574543b1ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:28.319084 24210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e647f2b7d7a4177b4ada37eea66d8dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:28.322100 24572 tablet_service.cc:1511] Processing CreateTablet for tablet 3e647f2b7d7a4177b4ada37eea66d8dd (DEFAULT_TABLE table=rebalance_test_table_8 [id=b92f3ae92b934b5fb6f7206a582d845f]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:28.322533 24572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e647f2b7d7a4177b4ada37eea66d8dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:28.325620 24750 tablet_service.cc:1511] Processing CreateTablet for tablet c82b10494c3e4b63974a9c574543b1ab (DEFAULT_TABLE table=rebalance_test_table_8 [id=b92f3ae92b934b5fb6f7206a582d845f]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:28.325619 25106 tablet_service.cc:1511] Processing CreateTablet for tablet c82b10494c3e4b63974a9c574543b1ab (DEFAULT_TABLE table=rebalance_test_table_8 [id=b92f3ae92b934b5fb6f7206a582d845f]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:28.326094 24750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c82b10494c3e4b63974a9c574543b1ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:28.326143 25106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c82b10494c3e4b63974a9c574543b1ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:28.337373 26234 tablet_bootstrap.cc:492] T 2df3f87f0d47451d9d8efaa9e4d3727d P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Bootstrap starting.
I20260807 13:50:28.339993 26234 tablet_bootstrap.cc:654] T 2df3f87f0d47451d9d8efaa9e4d3727d P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:28.342382 26235 tablet_bootstrap.cc:492] T 2df3f87f0d47451d9d8efaa9e4d3727d P d6d3ef3a235844cbbce1370e3aeb809f: Bootstrap starting.
I20260807 13:50:28.341646 26233 tablet_bootstrap.cc:492] T 2df3f87f0d47451d9d8efaa9e4d3727d P c8d4866795004103a4b0243906fe4d60: Bootstrap starting.
I20260807 13:50:28.343223 26238 tablet_bootstrap.cc:492] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11: Bootstrap starting.
I20260807 13:50:28.346022 26233 tablet_bootstrap.cc:654] T 2df3f87f0d47451d9d8efaa9e4d3727d P c8d4866795004103a4b0243906fe4d60: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:28.346665 26235 tablet_bootstrap.cc:654] T 2df3f87f0d47451d9d8efaa9e4d3727d P d6d3ef3a235844cbbce1370e3aeb809f: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:28.349650 26238 tablet_bootstrap.cc:654] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:28.350405 26234 tablet_bootstrap.cc:492] T 2df3f87f0d47451d9d8efaa9e4d3727d P 4d09f7af7d9d4d07bfb2114f45e9e8a4: No bootstrap required, opened a new log
I20260807 13:50:28.350476 26242 tablet_bootstrap.cc:492] T c82b10494c3e4b63974a9c574543b1ab P b890fcdb46dc4597bd9991906433c391: Bootstrap starting.
I20260807 13:50:28.350700 26234 ts_tablet_manager.cc:1403] T 2df3f87f0d47451d9d8efaa9e4d3727d P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.007s
I20260807 13:50:28.351830 26234 raft_consensus.cc:359] T 2df3f87f0d47451d9d8efaa9e4d3727d P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:28.352202 26234 raft_consensus.cc:385] T 2df3f87f0d47451d9d8efaa9e4d3727d P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:28.352358 26234 raft_consensus.cc:740] T 2df3f87f0d47451d9d8efaa9e4d3727d P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Initialized, Role: FOLLOWER
I20260807 13:50:28.352694 26242 tablet_bootstrap.cc:654] T c82b10494c3e4b63974a9c574543b1ab P b890fcdb46dc4597bd9991906433c391: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:28.352829 26235 tablet_bootstrap.cc:492] T 2df3f87f0d47451d9d8efaa9e4d3727d P d6d3ef3a235844cbbce1370e3aeb809f: No bootstrap required, opened a new log
I20260807 13:50:28.352734 26234 consensus_queue.cc:260] T 2df3f87f0d47451d9d8efaa9e4d3727d P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:28.353108 26235 ts_tablet_manager.cc:1403] T 2df3f87f0d47451d9d8efaa9e4d3727d P d6d3ef3a235844cbbce1370e3aeb809f: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.000s
I20260807 13:50:28.353848 26233 tablet_bootstrap.cc:492] T 2df3f87f0d47451d9d8efaa9e4d3727d P c8d4866795004103a4b0243906fe4d60: No bootstrap required, opened a new log
I20260807 13:50:28.354074 26233 ts_tablet_manager.cc:1403] T 2df3f87f0d47451d9d8efaa9e4d3727d P c8d4866795004103a4b0243906fe4d60: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.002s
I20260807 13:50:28.354072 26235 raft_consensus.cc:359] T 2df3f87f0d47451d9d8efaa9e4d3727d P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:28.354378 26235 raft_consensus.cc:385] T 2df3f87f0d47451d9d8efaa9e4d3727d P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:28.354522 26235 raft_consensus.cc:740] T 2df3f87f0d47451d9d8efaa9e4d3727d P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d3ef3a235844cbbce1370e3aeb809f, State: Initialized, Role: FOLLOWER
I20260807 13:50:28.354862 26235 consensus_queue.cc:260] T 2df3f87f0d47451d9d8efaa9e4d3727d P d6d3ef3a235844cbbce1370e3aeb809f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:28.355162 26233 raft_consensus.cc:359] T 2df3f87f0d47451d9d8efaa9e4d3727d P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:28.355456 26233 raft_consensus.cc:385] T 2df3f87f0d47451d9d8efaa9e4d3727d P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:28.355643 26235 ts_tablet_manager.cc:1434] T 2df3f87f0d47451d9d8efaa9e4d3727d P d6d3ef3a235844cbbce1370e3aeb809f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:50:28.355625 26233 raft_consensus.cc:740] T 2df3f87f0d47451d9d8efaa9e4d3727d P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8d4866795004103a4b0243906fe4d60, State: Initialized, Role: FOLLOWER
I20260807 13:50:28.356024 26235 tablet_bootstrap.cc:492] T 3e647f2b7d7a4177b4ada37eea66d8dd P d6d3ef3a235844cbbce1370e3aeb809f: Bootstrap starting.
I20260807 13:50:28.356002 26233 consensus_queue.cc:260] T 2df3f87f0d47451d9d8efaa9e4d3727d P c8d4866795004103a4b0243906fe4d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:28.356801 26233 ts_tablet_manager.cc:1434] T 2df3f87f0d47451d9d8efaa9e4d3727d P c8d4866795004103a4b0243906fe4d60: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260807 13:50:28.357117 26233 tablet_bootstrap.cc:492] T 3e647f2b7d7a4177b4ada37eea66d8dd P c8d4866795004103a4b0243906fe4d60: Bootstrap starting.
I20260807 13:50:28.357568 26234 ts_tablet_manager.cc:1434] T 2df3f87f0d47451d9d8efaa9e4d3727d P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260807 13:50:28.359790 26233 tablet_bootstrap.cc:654] T 3e647f2b7d7a4177b4ada37eea66d8dd P c8d4866795004103a4b0243906fe4d60: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:28.363071 26234 tablet_bootstrap.cc:492] T 3e647f2b7d7a4177b4ada37eea66d8dd P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Bootstrap starting.
I20260807 13:50:28.365314 26234 tablet_bootstrap.cc:654] T 3e647f2b7d7a4177b4ada37eea66d8dd P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:28.365681 26243 tablet_bootstrap.cc:492] T c82b10494c3e4b63974a9c574543b1ab P fe8f3cec39fb4964a4fccfd5baa4077b: Bootstrap starting.
I20260807 13:50:28.367355 26235 tablet_bootstrap.cc:654] T 3e647f2b7d7a4177b4ada37eea66d8dd P d6d3ef3a235844cbbce1370e3aeb809f: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:28.368009 26243 tablet_bootstrap.cc:654] T c82b10494c3e4b63974a9c574543b1ab P fe8f3cec39fb4964a4fccfd5baa4077b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:28.371438 26238 tablet_bootstrap.cc:492] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11: No bootstrap required, opened a new log
I20260807 13:50:28.371649 26238 ts_tablet_manager.cc:1403] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.006s
I20260807 13:50:28.372816 26238 raft_consensus.cc:359] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:28.373088 26238 raft_consensus.cc:385] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:28.373185 26238 raft_consensus.cc:740] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Initialized, Role: FOLLOWER
I20260807 13:50:28.373533 26238 consensus_queue.cc:260] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:28.374501 26238 ts_tablet_manager.cc:1434] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260807 13:50:28.377418 26233 tablet_bootstrap.cc:492] T 3e647f2b7d7a4177b4ada37eea66d8dd P c8d4866795004103a4b0243906fe4d60: No bootstrap required, opened a new log
I20260807 13:50:28.379415 26233 ts_tablet_manager.cc:1403] T 3e647f2b7d7a4177b4ada37eea66d8dd P c8d4866795004103a4b0243906fe4d60: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.014s
I20260807 13:50:28.379701 26243 tablet_bootstrap.cc:492] T c82b10494c3e4b63974a9c574543b1ab P fe8f3cec39fb4964a4fccfd5baa4077b: No bootstrap required, opened a new log
I20260807 13:50:28.380584 26233 raft_consensus.cc:359] T 3e647f2b7d7a4177b4ada37eea66d8dd P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:28.380928 26233 raft_consensus.cc:385] T 3e647f2b7d7a4177b4ada37eea66d8dd P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:28.380997 26242 tablet_bootstrap.cc:492] T c82b10494c3e4b63974a9c574543b1ab P b890fcdb46dc4597bd9991906433c391: No bootstrap required, opened a new log
I20260807 13:50:28.381119 26233 raft_consensus.cc:740] T 3e647f2b7d7a4177b4ada37eea66d8dd P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8d4866795004103a4b0243906fe4d60, State: Initialized, Role: FOLLOWER
I20260807 13:50:28.381201 26242 ts_tablet_manager.cc:1403] T c82b10494c3e4b63974a9c574543b1ab P b890fcdb46dc4597bd9991906433c391: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.011s
I20260807 13:50:28.381536 26235 tablet_bootstrap.cc:492] T 3e647f2b7d7a4177b4ada37eea66d8dd P d6d3ef3a235844cbbce1370e3aeb809f: No bootstrap required, opened a new log
I20260807 13:50:28.381758 26235 ts_tablet_manager.cc:1403] T 3e647f2b7d7a4177b4ada37eea66d8dd P d6d3ef3a235844cbbce1370e3aeb809f: Time spent bootstrapping tablet: real 0.026s user 0.008s sys 0.000s
I20260807 13:50:28.381793 26233 consensus_queue.cc:260] T 3e647f2b7d7a4177b4ada37eea66d8dd P c8d4866795004103a4b0243906fe4d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:28.382112 26242 raft_consensus.cc:359] T c82b10494c3e4b63974a9c574543b1ab P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:28.382402 26233 ts_tablet_manager.cc:1434] T 3e647f2b7d7a4177b4ada37eea66d8dd P c8d4866795004103a4b0243906fe4d60: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:50:28.382390 26242 raft_consensus.cc:385] T c82b10494c3e4b63974a9c574543b1ab P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:28.382503 26242 raft_consensus.cc:740] T c82b10494c3e4b63974a9c574543b1ab P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b890fcdb46dc4597bd9991906433c391, State: Initialized, Role: FOLLOWER
I20260807 13:50:28.382669 26235 raft_consensus.cc:359] T 3e647f2b7d7a4177b4ada37eea66d8dd P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:28.382908 26235 raft_consensus.cc:385] T 3e647f2b7d7a4177b4ada37eea66d8dd P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:28.382776 26242 consensus_queue.cc:260] T c82b10494c3e4b63974a9c574543b1ab P b890fcdb46dc4597bd9991906433c391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:28.382994 26235 raft_consensus.cc:740] T 3e647f2b7d7a4177b4ada37eea66d8dd P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d3ef3a235844cbbce1370e3aeb809f, State: Initialized, Role: FOLLOWER
I20260807 13:50:28.383509 26242 ts_tablet_manager.cc:1434] T c82b10494c3e4b63974a9c574543b1ab P b890fcdb46dc4597bd9991906433c391: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260807 13:50:28.383888 26243 ts_tablet_manager.cc:1403] T c82b10494c3e4b63974a9c574543b1ab P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.004s
I20260807 13:50:28.385079 26243 raft_consensus.cc:359] T c82b10494c3e4b63974a9c574543b1ab P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:28.385309 26243 raft_consensus.cc:385] T c82b10494c3e4b63974a9c574543b1ab P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:28.385475 26243 raft_consensus.cc:740] T c82b10494c3e4b63974a9c574543b1ab P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8f3cec39fb4964a4fccfd5baa4077b, State: Initialized, Role: FOLLOWER
I20260807 13:50:28.385740 26243 consensus_queue.cc:260] T c82b10494c3e4b63974a9c574543b1ab P fe8f3cec39fb4964a4fccfd5baa4077b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:28.386150 26235 consensus_queue.cc:260] T 3e647f2b7d7a4177b4ada37eea66d8dd P d6d3ef3a235844cbbce1370e3aeb809f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:28.386929 26235 ts_tablet_manager.cc:1434] T 3e647f2b7d7a4177b4ada37eea66d8dd P d6d3ef3a235844cbbce1370e3aeb809f: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260807 13:50:28.388923 26243 ts_tablet_manager.cc:1434] T c82b10494c3e4b63974a9c574543b1ab P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260807 13:50:28.389978 26234 tablet_bootstrap.cc:492] T 3e647f2b7d7a4177b4ada37eea66d8dd P 4d09f7af7d9d4d07bfb2114f45e9e8a4: No bootstrap required, opened a new log
I20260807 13:50:28.390219 26234 ts_tablet_manager.cc:1403] T 3e647f2b7d7a4177b4ada37eea66d8dd P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.003s
I20260807 13:50:28.390977 26234 raft_consensus.cc:359] T 3e647f2b7d7a4177b4ada37eea66d8dd P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:28.391181 26234 raft_consensus.cc:385] T 3e647f2b7d7a4177b4ada37eea66d8dd P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:28.391264 26234 raft_consensus.cc:740] T 3e647f2b7d7a4177b4ada37eea66d8dd P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Initialized, Role: FOLLOWER
I20260807 13:50:28.391537 26234 consensus_queue.cc:260] T 3e647f2b7d7a4177b4ada37eea66d8dd P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:28.392108 26234 ts_tablet_manager.cc:1434] T 3e647f2b7d7a4177b4ada37eea66d8dd P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 13:50:28.501586 26090 raft_consensus.cc:493] T 3e647f2b7d7a4177b4ada37eea66d8dd P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:28.501796 26090 raft_consensus.cc:515] T 3e647f2b7d7a4177b4ada37eea66d8dd P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:28.502609 26090 leader_election.cc:290] T 3e647f2b7d7a4177b4ada37eea66d8dd P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131), c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641)
I20260807 13:50:28.503566 24956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e647f2b7d7a4177b4ada37eea66d8dd" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" is_pre_election: true
I20260807 13:50:28.503603 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e647f2b7d7a4177b4ada37eea66d8dd" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60" is_pre_election: true
I20260807 13:50:28.503822 24956 raft_consensus.cc:2468] T 3e647f2b7d7a4177b4ada37eea66d8dd P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 0.
I20260807 13:50:28.503850 24600 raft_consensus.cc:2468] T 3e647f2b7d7a4177b4ada37eea66d8dd P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 0.
I20260807 13:50:28.504462 24152 leader_election.cc:304] T 3e647f2b7d7a4177b4ada37eea66d8dd P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, c8d4866795004103a4b0243906fe4d60; no voters:
I20260807 13:50:28.504798 26090 raft_consensus.cc:2804] T 3e647f2b7d7a4177b4ada37eea66d8dd P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:28.504940 26090 raft_consensus.cc:493] T 3e647f2b7d7a4177b4ada37eea66d8dd P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:28.505086 26090 raft_consensus.cc:3060] T 3e647f2b7d7a4177b4ada37eea66d8dd P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:28.508198 26090 raft_consensus.cc:515] T 3e647f2b7d7a4177b4ada37eea66d8dd P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:28.508888 26090 leader_election.cc:290] T 3e647f2b7d7a4177b4ada37eea66d8dd P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 election: Requested vote from peers d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131), c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641)
I20260807 13:50:28.509509 24956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e647f2b7d7a4177b4ada37eea66d8dd" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d3ef3a235844cbbce1370e3aeb809f"
I20260807 13:50:28.509523 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e647f2b7d7a4177b4ada37eea66d8dd" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60"
I20260807 13:50:28.509723 24956 raft_consensus.cc:3060] T 3e647f2b7d7a4177b4ada37eea66d8dd P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:28.509735 24600 raft_consensus.cc:3060] T 3e647f2b7d7a4177b4ada37eea66d8dd P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:28.511914 24956 raft_consensus.cc:2468] T 3e647f2b7d7a4177b4ada37eea66d8dd P d6d3ef3a235844cbbce1370e3aeb809f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 1.
I20260807 13:50:28.512396 24152 leader_election.cc:304] T 3e647f2b7d7a4177b4ada37eea66d8dd P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, d6d3ef3a235844cbbce1370e3aeb809f; no voters:
I20260807 13:50:28.512753 26090 raft_consensus.cc:2804] T 3e647f2b7d7a4177b4ada37eea66d8dd P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:28.512781 24600 raft_consensus.cc:2468] T 3e647f2b7d7a4177b4ada37eea66d8dd P c8d4866795004103a4b0243906fe4d60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 1.
I20260807 13:50:28.513222 26090 raft_consensus.cc:697] T 3e647f2b7d7a4177b4ada37eea66d8dd P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 LEADER]: Becoming Leader. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Running, Role: LEADER
I20260807 13:50:28.513833 26090 consensus_queue.cc:237] T 3e647f2b7d7a4177b4ada37eea66d8dd P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:28.517431 24025 catalog_manager.cc:5697] T 3e647f2b7d7a4177b4ada37eea66d8dd P 4d09f7af7d9d4d07bfb2114f45e9e8a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129). New cstate: current_term: 1 leader_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } health_report { overall_health: UNKNOWN } } }
I20260807 13:50:28.528259 26154 raft_consensus.cc:493] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:28.528467 26154 raft_consensus.cc:515] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:28.529183 26154 leader_election.cc:290] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619), b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189)
I20260807 13:50:28.529834 24775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c82b10494c3e4b63974a9c574543b1ab" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b890fcdb46dc4597bd9991906433c391" is_pre_election: true
I20260807 13:50:28.529837 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c82b10494c3e4b63974a9c574543b1ab" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" is_pre_election: true
I20260807 13:50:28.530097 24775 raft_consensus.cc:2468] T c82b10494c3e4b63974a9c574543b1ab P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 0.
I20260807 13:50:28.530128 24425 raft_consensus.cc:2468] T c82b10494c3e4b63974a9c574543b1ab P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 0.
I20260807 13:50:28.530692 25047 leader_election.cc:304] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b890fcdb46dc4597bd9991906433c391, d1d858e0ace34c39a641ede1db85be11; no voters:
I20260807 13:50:28.531299 26154 raft_consensus.cc:2804] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:28.531437 26154 raft_consensus.cc:493] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:28.531553 26154 raft_consensus.cc:3060] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:28.534176 26154 raft_consensus.cc:515] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:28.534821 26154 leader_election.cc:290] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 election: Requested vote from peers fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619), b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189)
I20260807 13:50:28.535254 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c82b10494c3e4b63974a9c574543b1ab" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b"
I20260807 13:50:28.535475 24427 raft_consensus.cc:3060] T c82b10494c3e4b63974a9c574543b1ab P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:28.535522 24775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c82b10494c3e4b63974a9c574543b1ab" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b890fcdb46dc4597bd9991906433c391"
I20260807 13:50:28.535768 24775 raft_consensus.cc:3060] T c82b10494c3e4b63974a9c574543b1ab P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:28.537720 24427 raft_consensus.cc:2468] T c82b10494c3e4b63974a9c574543b1ab P fe8f3cec39fb4964a4fccfd5baa4077b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 1.
I20260807 13:50:28.538103 24775 raft_consensus.cc:2468] T c82b10494c3e4b63974a9c574543b1ab P b890fcdb46dc4597bd9991906433c391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 1.
I20260807 13:50:28.538209 25049 leader_election.cc:304] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1d858e0ace34c39a641ede1db85be11, fe8f3cec39fb4964a4fccfd5baa4077b; no voters:
I20260807 13:50:28.538564 26154 raft_consensus.cc:2804] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:28.538764 26154 raft_consensus.cc:697] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11 [term 1 LEADER]: Becoming Leader. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Running, Role: LEADER
I20260807 13:50:28.539104 26154 consensus_queue.cc:237] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:28.542476 24025 catalog_manager.cc:5697] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1d858e0ace34c39a641ede1db85be11 (127.23.107.134). New cstate: current_term: 1 leader_uuid: "d1d858e0ace34c39a641ede1db85be11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } health_report { overall_health: UNKNOWN } } }
I20260807 13:50:28.565613 25904 raft_consensus.cc:493] T 2df3f87f0d47451d9d8efaa9e4d3727d P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:28.565838 25904 raft_consensus.cc:515] T 2df3f87f0d47451d9d8efaa9e4d3727d P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:28.566624 25904 leader_election.cc:290] T 2df3f87f0d47451d9d8efaa9e4d3727d P c8d4866795004103a4b0243906fe4d60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973), d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131)
I20260807 13:50:28.567070 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2df3f87f0d47451d9d8efaa9e4d3727d" candidate_uuid: "c8d4866795004103a4b0243906fe4d60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" is_pre_election: true
I20260807 13:50:28.567307 24240 raft_consensus.cc:2468] T 2df3f87f0d47451d9d8efaa9e4d3727d P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8d4866795004103a4b0243906fe4d60 in term 0.
I20260807 13:50:28.567219 24956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2df3f87f0d47451d9d8efaa9e4d3727d" candidate_uuid: "c8d4866795004103a4b0243906fe4d60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" is_pre_election: true
I20260807 13:50:28.567546 24956 raft_consensus.cc:2468] T 2df3f87f0d47451d9d8efaa9e4d3727d P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8d4866795004103a4b0243906fe4d60 in term 0.
I20260807 13:50:28.567838 24513 leader_election.cc:304] T 2df3f87f0d47451d9d8efaa9e4d3727d P c8d4866795004103a4b0243906fe4d60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, c8d4866795004103a4b0243906fe4d60; no voters:
I20260807 13:50:28.568127 25904 raft_consensus.cc:2804] T 2df3f87f0d47451d9d8efaa9e4d3727d P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:28.568248 25904 raft_consensus.cc:493] T 2df3f87f0d47451d9d8efaa9e4d3727d P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:28.568365 25904 raft_consensus.cc:3060] T 2df3f87f0d47451d9d8efaa9e4d3727d P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:28.570502 25904 raft_consensus.cc:515] T 2df3f87f0d47451d9d8efaa9e4d3727d P c8d4866795004103a4b0243906fe4d60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:28.571158 25904 leader_election.cc:290] T 2df3f87f0d47451d9d8efaa9e4d3727d P c8d4866795004103a4b0243906fe4d60 [CANDIDATE]: Term 1 election: Requested vote from peers 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973), d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131)
I20260807 13:50:28.571672 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2df3f87f0d47451d9d8efaa9e4d3727d" candidate_uuid: "c8d4866795004103a4b0243906fe4d60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4"
I20260807 13:50:28.571714 24956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2df3f87f0d47451d9d8efaa9e4d3727d" candidate_uuid: "c8d4866795004103a4b0243906fe4d60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d3ef3a235844cbbce1370e3aeb809f"
I20260807 13:50:28.571877 24240 raft_consensus.cc:3060] T 2df3f87f0d47451d9d8efaa9e4d3727d P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:28.571923 24956 raft_consensus.cc:3060] T 2df3f87f0d47451d9d8efaa9e4d3727d P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:28.574182 24240 raft_consensus.cc:2468] T 2df3f87f0d47451d9d8efaa9e4d3727d P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d4866795004103a4b0243906fe4d60 in term 1.
I20260807 13:50:28.574189 24956 raft_consensus.cc:2468] T 2df3f87f0d47451d9d8efaa9e4d3727d P d6d3ef3a235844cbbce1370e3aeb809f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d4866795004103a4b0243906fe4d60 in term 1.
I20260807 13:50:28.574662 24513 leader_election.cc:304] T 2df3f87f0d47451d9d8efaa9e4d3727d P c8d4866795004103a4b0243906fe4d60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, c8d4866795004103a4b0243906fe4d60; no voters:
I20260807 13:50:28.575026 25904 raft_consensus.cc:2804] T 2df3f87f0d47451d9d8efaa9e4d3727d P c8d4866795004103a4b0243906fe4d60 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:28.575488 25904 raft_consensus.cc:697] T 2df3f87f0d47451d9d8efaa9e4d3727d P c8d4866795004103a4b0243906fe4d60 [term 1 LEADER]: Becoming Leader. State: Replica: c8d4866795004103a4b0243906fe4d60, State: Running, Role: LEADER
I20260807 13:50:28.575866 25904 consensus_queue.cc:237] T 2df3f87f0d47451d9d8efaa9e4d3727d P c8d4866795004103a4b0243906fe4d60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:28.579339 24029 catalog_manager.cc:5697] T 2df3f87f0d47451d9d8efaa9e4d3727d P c8d4866795004103a4b0243906fe4d60 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8d4866795004103a4b0243906fe4d60 (127.23.107.131). New cstate: current_term: 1 leader_uuid: "c8d4866795004103a4b0243906fe4d60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } health_report { overall_health: HEALTHY } } }
I20260807 13:50:28.955006 26252 consensus_queue.cc:1048] T 3e647f2b7d7a4177b4ada37eea66d8dd P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:28.967765 26261 consensus_queue.cc:1048] T 3e647f2b7d7a4177b4ada37eea66d8dd P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:28.990677 25904 consensus_queue.cc:1048] T 2df3f87f0d47451d9d8efaa9e4d3727d P c8d4866795004103a4b0243906fe4d60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:29.030844 26154 consensus_queue.cc:1048] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:29.036753 26256 consensus_queue.cc:1048] T 2df3f87f0d47451d9d8efaa9e4d3727d P c8d4866795004103a4b0243906fe4d60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:50:29.046198 26258 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:29.047315 26258 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260807 13:50:29.050851 26154 consensus_queue.cc:1048] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Using table 'rebalance_test_table_8'
W20260807 13:50:29.334709 24513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 61291.9us
INSERT report
rows total: 2000
time total: 301.214 ms
time per row: 0.150607 ms
I20260807 13:50:29.549645 24041 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43984:
name: "rebalance_test_table_9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:50:29.559978 24395 tablet_service.cc:1511] Processing CreateTablet for tablet c41e20fc995e483d900d559235f48b32 (DEFAULT_TABLE table=rebalance_test_table_9 [id=32f5198718cb45c28ed766d0771c2791]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:29.560213 25106 tablet_service.cc:1511] Processing CreateTablet for tablet c41e20fc995e483d900d559235f48b32 (DEFAULT_TABLE table=rebalance_test_table_9 [id=32f5198718cb45c28ed766d0771c2791]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:29.560529 24395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c41e20fc995e483d900d559235f48b32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:29.560658 25106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c41e20fc995e483d900d559235f48b32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:29.560686 24750 tablet_service.cc:1511] Processing CreateTablet for tablet c41e20fc995e483d900d559235f48b32 (DEFAULT_TABLE table=rebalance_test_table_9 [id=32f5198718cb45c28ed766d0771c2791]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:29.561230 24750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c41e20fc995e483d900d559235f48b32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:29.562598 24926 tablet_service.cc:1511] Processing CreateTablet for tablet 5ab0e0a3aec1460192bbe02bf37342c1 (DEFAULT_TABLE table=rebalance_test_table_9 [id=32f5198718cb45c28ed766d0771c2791]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:29.563040 24926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ab0e0a3aec1460192bbe02bf37342c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:29.563756 24396 tablet_service.cc:1511] Processing CreateTablet for tablet 731a37a83f1b4971b0f4e7c44f7e3433 (DEFAULT_TABLE table=rebalance_test_table_9 [id=32f5198718cb45c28ed766d0771c2791]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:29.564163 24396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 731a37a83f1b4971b0f4e7c44f7e3433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:29.566316 24211 tablet_service.cc:1511] Processing CreateTablet for tablet 5ab0e0a3aec1460192bbe02bf37342c1 (DEFAULT_TABLE table=rebalance_test_table_9 [id=32f5198718cb45c28ed766d0771c2791]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:29.566752 24211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ab0e0a3aec1460192bbe02bf37342c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:29.567912 24751 tablet_service.cc:1511] Processing CreateTablet for tablet 731a37a83f1b4971b0f4e7c44f7e3433 (DEFAULT_TABLE table=rebalance_test_table_9 [id=32f5198718cb45c28ed766d0771c2791]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:29.568341 24751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 731a37a83f1b4971b0f4e7c44f7e3433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:29.573765 24572 tablet_service.cc:1511] Processing CreateTablet for tablet 5ab0e0a3aec1460192bbe02bf37342c1 (DEFAULT_TABLE table=rebalance_test_table_9 [id=32f5198718cb45c28ed766d0771c2791]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:29.574246 24572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ab0e0a3aec1460192bbe02bf37342c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:29.574131 25107 tablet_service.cc:1511] Processing CreateTablet for tablet 731a37a83f1b4971b0f4e7c44f7e3433 (DEFAULT_TABLE table=rebalance_test_table_9 [id=32f5198718cb45c28ed766d0771c2791]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:29.574695 25107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 731a37a83f1b4971b0f4e7c44f7e3433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:29.585578 26347 tablet_bootstrap.cc:492] T c41e20fc995e483d900d559235f48b32 P d1d858e0ace34c39a641ede1db85be11: Bootstrap starting.
I20260807 13:50:29.588294 26347 tablet_bootstrap.cc:654] T c41e20fc995e483d900d559235f48b32 P d1d858e0ace34c39a641ede1db85be11: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:29.589043 26344 tablet_bootstrap.cc:492] T c41e20fc995e483d900d559235f48b32 P b890fcdb46dc4597bd9991906433c391: Bootstrap starting.
I20260807 13:50:29.590714 26351 tablet_bootstrap.cc:492] T 731a37a83f1b4971b0f4e7c44f7e3433 P fe8f3cec39fb4964a4fccfd5baa4077b: Bootstrap starting.
I20260807 13:50:29.591917 26344 tablet_bootstrap.cc:654] T c41e20fc995e483d900d559235f48b32 P b890fcdb46dc4597bd9991906433c391: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:29.592584 26351 tablet_bootstrap.cc:654] T 731a37a83f1b4971b0f4e7c44f7e3433 P fe8f3cec39fb4964a4fccfd5baa4077b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:29.597384 26347 tablet_bootstrap.cc:492] T c41e20fc995e483d900d559235f48b32 P d1d858e0ace34c39a641ede1db85be11: No bootstrap required, opened a new log
I20260807 13:50:29.597574 26347 ts_tablet_manager.cc:1403] T c41e20fc995e483d900d559235f48b32 P d1d858e0ace34c39a641ede1db85be11: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.001s
I20260807 13:50:29.598465 26347 raft_consensus.cc:359] T c41e20fc995e483d900d559235f48b32 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:29.598702 26347 raft_consensus.cc:385] T c41e20fc995e483d900d559235f48b32 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:29.598842 26347 raft_consensus.cc:740] T c41e20fc995e483d900d559235f48b32 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Initialized, Role: FOLLOWER
I20260807 13:50:29.599196 26351 tablet_bootstrap.cc:492] T 731a37a83f1b4971b0f4e7c44f7e3433 P fe8f3cec39fb4964a4fccfd5baa4077b: No bootstrap required, opened a new log
I20260807 13:50:29.599205 26347 consensus_queue.cc:260] T c41e20fc995e483d900d559235f48b32 P d1d858e0ace34c39a641ede1db85be11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:29.599367 26351 ts_tablet_manager.cc:1403] T 731a37a83f1b4971b0f4e7c44f7e3433 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260807 13:50:29.600035 26347 ts_tablet_manager.cc:1434] T c41e20fc995e483d900d559235f48b32 P d1d858e0ace34c39a641ede1db85be11: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260807 13:50:29.600419 26347 tablet_bootstrap.cc:492] T 731a37a83f1b4971b0f4e7c44f7e3433 P d1d858e0ace34c39a641ede1db85be11: Bootstrap starting.
I20260807 13:50:29.601120 26356 tablet_bootstrap.cc:492] T 5ab0e0a3aec1460192bbe02bf37342c1 P c8d4866795004103a4b0243906fe4d60: Bootstrap starting.
I20260807 13:50:29.602428 26347 tablet_bootstrap.cc:654] T 731a37a83f1b4971b0f4e7c44f7e3433 P d1d858e0ace34c39a641ede1db85be11: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:29.602456 26355 tablet_bootstrap.cc:492] T 5ab0e0a3aec1460192bbe02bf37342c1 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Bootstrap starting.
I20260807 13:50:29.603511 26351 raft_consensus.cc:359] T 731a37a83f1b4971b0f4e7c44f7e3433 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } }
I20260807 13:50:29.604188 26351 raft_consensus.cc:385] T 731a37a83f1b4971b0f4e7c44f7e3433 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:29.604521 26351 raft_consensus.cc:740] T 731a37a83f1b4971b0f4e7c44f7e3433 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8f3cec39fb4964a4fccfd5baa4077b, State: Initialized, Role: FOLLOWER
I20260807 13:50:29.605140 26351 consensus_queue.cc:260] T 731a37a83f1b4971b0f4e7c44f7e3433 P fe8f3cec39fb4964a4fccfd5baa4077b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } }
I20260807 13:50:29.605324 26355 tablet_bootstrap.cc:654] T 5ab0e0a3aec1460192bbe02bf37342c1 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:29.608646 26351 ts_tablet_manager.cc:1434] T 731a37a83f1b4971b0f4e7c44f7e3433 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260807 13:50:29.608709 26346 tablet_bootstrap.cc:492] T 5ab0e0a3aec1460192bbe02bf37342c1 P d6d3ef3a235844cbbce1370e3aeb809f: Bootstrap starting.
I20260807 13:50:29.608966 26351 tablet_bootstrap.cc:492] T c41e20fc995e483d900d559235f48b32 P fe8f3cec39fb4964a4fccfd5baa4077b: Bootstrap starting.
I20260807 13:50:29.609265 26344 tablet_bootstrap.cc:492] T c41e20fc995e483d900d559235f48b32 P b890fcdb46dc4597bd9991906433c391: No bootstrap required, opened a new log
I20260807 13:50:29.609534 26344 ts_tablet_manager.cc:1403] T c41e20fc995e483d900d559235f48b32 P b890fcdb46dc4597bd9991906433c391: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.010s
I20260807 13:50:29.610512 26344 raft_consensus.cc:359] T c41e20fc995e483d900d559235f48b32 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:29.610818 26344 raft_consensus.cc:385] T c41e20fc995e483d900d559235f48b32 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:29.610858 26346 tablet_bootstrap.cc:654] T 5ab0e0a3aec1460192bbe02bf37342c1 P d6d3ef3a235844cbbce1370e3aeb809f: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:29.610996 26344 raft_consensus.cc:740] T c41e20fc995e483d900d559235f48b32 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b890fcdb46dc4597bd9991906433c391, State: Initialized, Role: FOLLOWER
I20260807 13:50:29.611393 26344 consensus_queue.cc:260] T c41e20fc995e483d900d559235f48b32 P b890fcdb46dc4597bd9991906433c391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:29.612253 26344 ts_tablet_manager.cc:1434] T c41e20fc995e483d900d559235f48b32 P b890fcdb46dc4597bd9991906433c391: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260807 13:50:29.612336 26351 tablet_bootstrap.cc:654] T c41e20fc995e483d900d559235f48b32 P fe8f3cec39fb4964a4fccfd5baa4077b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:29.614187 26344 tablet_bootstrap.cc:492] T 731a37a83f1b4971b0f4e7c44f7e3433 P b890fcdb46dc4597bd9991906433c391: Bootstrap starting.
I20260807 13:50:29.619401 26355 tablet_bootstrap.cc:492] T 5ab0e0a3aec1460192bbe02bf37342c1 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: No bootstrap required, opened a new log
I20260807 13:50:29.619666 26355 ts_tablet_manager.cc:1403] T 5ab0e0a3aec1460192bbe02bf37342c1 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.004s
I20260807 13:50:29.620299 26347 tablet_bootstrap.cc:492] T 731a37a83f1b4971b0f4e7c44f7e3433 P d1d858e0ace34c39a641ede1db85be11: No bootstrap required, opened a new log
I20260807 13:50:29.620492 26347 ts_tablet_manager.cc:1403] T 731a37a83f1b4971b0f4e7c44f7e3433 P d1d858e0ace34c39a641ede1db85be11: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.004s
I20260807 13:50:29.620790 26355 raft_consensus.cc:359] T 5ab0e0a3aec1460192bbe02bf37342c1 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:29.621078 26355 raft_consensus.cc:385] T 5ab0e0a3aec1460192bbe02bf37342c1 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:29.621259 26355 raft_consensus.cc:740] T 5ab0e0a3aec1460192bbe02bf37342c1 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Initialized, Role: FOLLOWER
I20260807 13:50:29.621431 26347 raft_consensus.cc:359] T 731a37a83f1b4971b0f4e7c44f7e3433 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } }
I20260807 13:50:29.621666 26347 raft_consensus.cc:385] T 731a37a83f1b4971b0f4e7c44f7e3433 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:29.621758 26347 raft_consensus.cc:740] T 731a37a83f1b4971b0f4e7c44f7e3433 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Initialized, Role: FOLLOWER
I20260807 13:50:29.621606 26355 consensus_queue.cc:260] T 5ab0e0a3aec1460192bbe02bf37342c1 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:29.622074 26347 consensus_queue.cc:260] T 731a37a83f1b4971b0f4e7c44f7e3433 P d1d858e0ace34c39a641ede1db85be11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } }
I20260807 13:50:29.623283 26347 ts_tablet_manager.cc:1434] T 731a37a83f1b4971b0f4e7c44f7e3433 P d1d858e0ace34c39a641ede1db85be11: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:50:29.623536 26344 tablet_bootstrap.cc:654] T 731a37a83f1b4971b0f4e7c44f7e3433 P b890fcdb46dc4597bd9991906433c391: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:29.623546 26355 ts_tablet_manager.cc:1434] T 5ab0e0a3aec1460192bbe02bf37342c1 P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260807 13:50:29.625484 26346 tablet_bootstrap.cc:492] T 5ab0e0a3aec1460192bbe02bf37342c1 P d6d3ef3a235844cbbce1370e3aeb809f: No bootstrap required, opened a new log
I20260807 13:50:29.625785 26346 ts_tablet_manager.cc:1403] T 5ab0e0a3aec1460192bbe02bf37342c1 P d6d3ef3a235844cbbce1370e3aeb809f: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.003s
I20260807 13:50:29.628181 26346 raft_consensus.cc:359] T 5ab0e0a3aec1460192bbe02bf37342c1 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:29.628710 26346 raft_consensus.cc:385] T 5ab0e0a3aec1460192bbe02bf37342c1 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:29.628890 26346 raft_consensus.cc:740] T 5ab0e0a3aec1460192bbe02bf37342c1 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d3ef3a235844cbbce1370e3aeb809f, State: Initialized, Role: FOLLOWER
I20260807 13:50:29.629315 26346 consensus_queue.cc:260] T 5ab0e0a3aec1460192bbe02bf37342c1 P d6d3ef3a235844cbbce1370e3aeb809f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:29.631726 26356 tablet_bootstrap.cc:654] T 5ab0e0a3aec1460192bbe02bf37342c1 P c8d4866795004103a4b0243906fe4d60: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:29.632952 26344 tablet_bootstrap.cc:492] T 731a37a83f1b4971b0f4e7c44f7e3433 P b890fcdb46dc4597bd9991906433c391: No bootstrap required, opened a new log
I20260807 13:50:29.633172 26344 ts_tablet_manager.cc:1403] T 731a37a83f1b4971b0f4e7c44f7e3433 P b890fcdb46dc4597bd9991906433c391: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.010s
I20260807 13:50:29.633839 26346 ts_tablet_manager.cc:1434] T 5ab0e0a3aec1460192bbe02bf37342c1 P d6d3ef3a235844cbbce1370e3aeb809f: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260807 13:50:29.634119 26344 raft_consensus.cc:359] T 731a37a83f1b4971b0f4e7c44f7e3433 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } }
I20260807 13:50:29.634357 26344 raft_consensus.cc:385] T 731a37a83f1b4971b0f4e7c44f7e3433 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:29.634443 26344 raft_consensus.cc:740] T 731a37a83f1b4971b0f4e7c44f7e3433 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b890fcdb46dc4597bd9991906433c391, State: Initialized, Role: FOLLOWER
I20260807 13:50:29.634768 26344 consensus_queue.cc:260] T 731a37a83f1b4971b0f4e7c44f7e3433 P b890fcdb46dc4597bd9991906433c391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } }
I20260807 13:50:29.636435 26344 ts_tablet_manager.cc:1434] T 731a37a83f1b4971b0f4e7c44f7e3433 P b890fcdb46dc4597bd9991906433c391: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260807 13:50:29.642701 26356 tablet_bootstrap.cc:492] T 5ab0e0a3aec1460192bbe02bf37342c1 P c8d4866795004103a4b0243906fe4d60: No bootstrap required, opened a new log
I20260807 13:50:29.642787 26351 tablet_bootstrap.cc:492] T c41e20fc995e483d900d559235f48b32 P fe8f3cec39fb4964a4fccfd5baa4077b: No bootstrap required, opened a new log
I20260807 13:50:29.642925 26356 ts_tablet_manager.cc:1403] T 5ab0e0a3aec1460192bbe02bf37342c1 P c8d4866795004103a4b0243906fe4d60: Time spent bootstrapping tablet: real 0.042s user 0.004s sys 0.002s
I20260807 13:50:29.642999 26351 ts_tablet_manager.cc:1403] T c41e20fc995e483d900d559235f48b32 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent bootstrapping tablet: real 0.034s user 0.011s sys 0.012s
I20260807 13:50:29.643723 26356 raft_consensus.cc:359] T 5ab0e0a3aec1460192bbe02bf37342c1 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:29.643987 26356 raft_consensus.cc:385] T 5ab0e0a3aec1460192bbe02bf37342c1 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:29.644096 26356 raft_consensus.cc:740] T 5ab0e0a3aec1460192bbe02bf37342c1 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8d4866795004103a4b0243906fe4d60, State: Initialized, Role: FOLLOWER
I20260807 13:50:29.644035 26351 raft_consensus.cc:359] T c41e20fc995e483d900d559235f48b32 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:29.644280 26351 raft_consensus.cc:385] T c41e20fc995e483d900d559235f48b32 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:29.644375 26351 raft_consensus.cc:740] T c41e20fc995e483d900d559235f48b32 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8f3cec39fb4964a4fccfd5baa4077b, State: Initialized, Role: FOLLOWER
I20260807 13:50:29.644352 26356 consensus_queue.cc:260] T 5ab0e0a3aec1460192bbe02bf37342c1 P c8d4866795004103a4b0243906fe4d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:29.644707 26351 consensus_queue.cc:260] T c41e20fc995e483d900d559235f48b32 P fe8f3cec39fb4964a4fccfd5baa4077b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:29.644944 26356 ts_tablet_manager.cc:1434] T 5ab0e0a3aec1460192bbe02bf37342c1 P c8d4866795004103a4b0243906fe4d60: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260807 13:50:29.645391 26351 ts_tablet_manager.cc:1434] T c41e20fc995e483d900d559235f48b32 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260807 13:50:29.690177 25904 raft_consensus.cc:493] T 5ab0e0a3aec1460192bbe02bf37342c1 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:29.690421 25904 raft_consensus.cc:515] T 5ab0e0a3aec1460192bbe02bf37342c1 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:29.691119 25904 leader_election.cc:290] T 5ab0e0a3aec1460192bbe02bf37342c1 P c8d4866795004103a4b0243906fe4d60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131), 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973)
I20260807 13:50:29.691648 24955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab0e0a3aec1460192bbe02bf37342c1" candidate_uuid: "c8d4866795004103a4b0243906fe4d60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" is_pre_election: true
I20260807 13:50:29.691704 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab0e0a3aec1460192bbe02bf37342c1" candidate_uuid: "c8d4866795004103a4b0243906fe4d60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" is_pre_election: true
I20260807 13:50:29.691897 24955 raft_consensus.cc:2468] T 5ab0e0a3aec1460192bbe02bf37342c1 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8d4866795004103a4b0243906fe4d60 in term 0.
I20260807 13:50:29.691991 24240 raft_consensus.cc:2468] T 5ab0e0a3aec1460192bbe02bf37342c1 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8d4866795004103a4b0243906fe4d60 in term 0.
I20260807 13:50:29.692517 24513 leader_election.cc:304] T 5ab0e0a3aec1460192bbe02bf37342c1 P c8d4866795004103a4b0243906fe4d60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, c8d4866795004103a4b0243906fe4d60; no voters:
I20260807 13:50:29.692936 25904 raft_consensus.cc:2804] T 5ab0e0a3aec1460192bbe02bf37342c1 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:29.693071 25904 raft_consensus.cc:493] T 5ab0e0a3aec1460192bbe02bf37342c1 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:29.693186 25904 raft_consensus.cc:3060] T 5ab0e0a3aec1460192bbe02bf37342c1 P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:29.695449 26225 raft_consensus.cc:493] T c41e20fc995e483d900d559235f48b32 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:29.695540 25904 raft_consensus.cc:515] T 5ab0e0a3aec1460192bbe02bf37342c1 P c8d4866795004103a4b0243906fe4d60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:29.695637 26225 raft_consensus.cc:515] T c41e20fc995e483d900d559235f48b32 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:29.696301 25904 leader_election.cc:290] T 5ab0e0a3aec1460192bbe02bf37342c1 P c8d4866795004103a4b0243906fe4d60 [CANDIDATE]: Term 1 election: Requested vote from peers d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131), 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973)
I20260807 13:50:29.696619 26225 leader_election.cc:290] T c41e20fc995e483d900d559235f48b32 P b890fcdb46dc4597bd9991906433c391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619), d1d858e0ace34c39a641ede1db85be11 (127.23.107.134:46341)
I20260807 13:50:29.697157 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab0e0a3aec1460192bbe02bf37342c1" candidate_uuid: "c8d4866795004103a4b0243906fe4d60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4"
I20260807 13:50:29.697242 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41e20fc995e483d900d559235f48b32" candidate_uuid: "b890fcdb46dc4597bd9991906433c391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" is_pre_election: true
I20260807 13:50:29.697324 25131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41e20fc995e483d900d559235f48b32" candidate_uuid: "b890fcdb46dc4597bd9991906433c391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1d858e0ace34c39a641ede1db85be11" is_pre_election: true
I20260807 13:50:29.697422 24240 raft_consensus.cc:3060] T 5ab0e0a3aec1460192bbe02bf37342c1 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:29.697515 24425 raft_consensus.cc:2468] T c41e20fc995e483d900d559235f48b32 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b890fcdb46dc4597bd9991906433c391 in term 0.
I20260807 13:50:29.697584 25131 raft_consensus.cc:2468] T c41e20fc995e483d900d559235f48b32 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b890fcdb46dc4597bd9991906433c391 in term 0.
I20260807 13:50:29.697798 24955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab0e0a3aec1460192bbe02bf37342c1" candidate_uuid: "c8d4866795004103a4b0243906fe4d60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d3ef3a235844cbbce1370e3aeb809f"
I20260807 13:50:29.698024 24955 raft_consensus.cc:3060] T 5ab0e0a3aec1460192bbe02bf37342c1 P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:29.698091 24692 leader_election.cc:304] T c41e20fc995e483d900d559235f48b32 P b890fcdb46dc4597bd9991906433c391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b890fcdb46dc4597bd9991906433c391, fe8f3cec39fb4964a4fccfd5baa4077b; no voters:
I20260807 13:50:29.698395 26225 raft_consensus.cc:2804] T c41e20fc995e483d900d559235f48b32 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:29.698496 26225 raft_consensus.cc:493] T c41e20fc995e483d900d559235f48b32 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:29.698588 26225 raft_consensus.cc:3060] T c41e20fc995e483d900d559235f48b32 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:29.700217 24955 raft_consensus.cc:2468] T 5ab0e0a3aec1460192bbe02bf37342c1 P d6d3ef3a235844cbbce1370e3aeb809f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d4866795004103a4b0243906fe4d60 in term 1.
I20260807 13:50:29.700536 24240 raft_consensus.cc:2468] T 5ab0e0a3aec1460192bbe02bf37342c1 P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d4866795004103a4b0243906fe4d60 in term 1.
I20260807 13:50:29.700769 24512 leader_election.cc:304] T 5ab0e0a3aec1460192bbe02bf37342c1 P c8d4866795004103a4b0243906fe4d60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8d4866795004103a4b0243906fe4d60, d6d3ef3a235844cbbce1370e3aeb809f; no voters:
I20260807 13:50:29.701100 25904 raft_consensus.cc:2804] T 5ab0e0a3aec1460192bbe02bf37342c1 P c8d4866795004103a4b0243906fe4d60 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:29.701462 25904 raft_consensus.cc:697] T 5ab0e0a3aec1460192bbe02bf37342c1 P c8d4866795004103a4b0243906fe4d60 [term 1 LEADER]: Becoming Leader. State: Replica: c8d4866795004103a4b0243906fe4d60, State: Running, Role: LEADER
I20260807 13:50:29.701819 25904 consensus_queue.cc:237] T 5ab0e0a3aec1460192bbe02bf37342c1 P c8d4866795004103a4b0243906fe4d60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } }
I20260807 13:50:29.701941 26225 raft_consensus.cc:515] T c41e20fc995e483d900d559235f48b32 P b890fcdb46dc4597bd9991906433c391 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:29.703101 26225 leader_election.cc:290] T c41e20fc995e483d900d559235f48b32 P b890fcdb46dc4597bd9991906433c391 [CANDIDATE]: Term 1 election: Requested vote from peers fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619), d1d858e0ace34c39a641ede1db85be11 (127.23.107.134:46341)
I20260807 13:50:29.703213 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41e20fc995e483d900d559235f48b32" candidate_uuid: "b890fcdb46dc4597bd9991906433c391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b"
I20260807 13:50:29.703471 24425 raft_consensus.cc:3060] T c41e20fc995e483d900d559235f48b32 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:29.703608 25130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41e20fc995e483d900d559235f48b32" candidate_uuid: "b890fcdb46dc4597bd9991906433c391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1d858e0ace34c39a641ede1db85be11"
I20260807 13:50:29.703883 25130 raft_consensus.cc:3060] T c41e20fc995e483d900d559235f48b32 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:29.706704 24425 raft_consensus.cc:2468] T c41e20fc995e483d900d559235f48b32 P fe8f3cec39fb4964a4fccfd5baa4077b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b890fcdb46dc4597bd9991906433c391 in term 1.
I20260807 13:50:29.706995 25130 raft_consensus.cc:2468] T c41e20fc995e483d900d559235f48b32 P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b890fcdb46dc4597bd9991906433c391 in term 1.
I20260807 13:50:29.707326 24692 leader_election.cc:304] T c41e20fc995e483d900d559235f48b32 P b890fcdb46dc4597bd9991906433c391 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b890fcdb46dc4597bd9991906433c391, fe8f3cec39fb4964a4fccfd5baa4077b; no voters:
I20260807 13:50:29.707690 26366 raft_consensus.cc:2804] T c41e20fc995e483d900d559235f48b32 P b890fcdb46dc4597bd9991906433c391 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:29.707855 26366 raft_consensus.cc:697] T c41e20fc995e483d900d559235f48b32 P b890fcdb46dc4597bd9991906433c391 [term 1 LEADER]: Becoming Leader. State: Replica: b890fcdb46dc4597bd9991906433c391, State: Running, Role: LEADER
I20260807 13:50:29.708163 26366 consensus_queue.cc:237] T c41e20fc995e483d900d559235f48b32 P b890fcdb46dc4597bd9991906433c391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:29.710397 24035 catalog_manager.cc:5697] T 5ab0e0a3aec1460192bbe02bf37342c1 P c8d4866795004103a4b0243906fe4d60 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8d4866795004103a4b0243906fe4d60 (127.23.107.131). New cstate: current_term: 1 leader_uuid: "c8d4866795004103a4b0243906fe4d60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } health_report { overall_health: HEALTHY } } }
I20260807 13:50:29.711418 24041 catalog_manager.cc:5697] T c41e20fc995e483d900d559235f48b32 P b890fcdb46dc4597bd9991906433c391 reported cstate change: term changed from 0 to 1, leader changed from <none> to b890fcdb46dc4597bd9991906433c391 (127.23.107.132). New cstate: current_term: 1 leader_uuid: "b890fcdb46dc4597bd9991906433c391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } health_report { overall_health: HEALTHY } } }
I20260807 13:50:29.718647 26079 raft_consensus.cc:493] T 731a37a83f1b4971b0f4e7c44f7e3433 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:29.718796 26079 raft_consensus.cc:515] T 731a37a83f1b4971b0f4e7c44f7e3433 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } }
I20260807 13:50:29.719340 26079 leader_election.cc:290] T 731a37a83f1b4971b0f4e7c44f7e3433 P fe8f3cec39fb4964a4fccfd5baa4077b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1d858e0ace34c39a641ede1db85be11 (127.23.107.134:46341), b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189)
I20260807 13:50:29.719885 25130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731a37a83f1b4971b0f4e7c44f7e3433" candidate_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1d858e0ace34c39a641ede1db85be11" is_pre_election: true
I20260807 13:50:29.719970 24775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731a37a83f1b4971b0f4e7c44f7e3433" candidate_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b890fcdb46dc4597bd9991906433c391" is_pre_election: true
I20260807 13:50:29.720187 24775 raft_consensus.cc:2468] T 731a37a83f1b4971b0f4e7c44f7e3433 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe8f3cec39fb4964a4fccfd5baa4077b in term 0.
I20260807 13:50:29.720178 25130 raft_consensus.cc:2468] T 731a37a83f1b4971b0f4e7c44f7e3433 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe8f3cec39fb4964a4fccfd5baa4077b in term 0.
I20260807 13:50:29.720676 24339 leader_election.cc:304] T 731a37a83f1b4971b0f4e7c44f7e3433 P fe8f3cec39fb4964a4fccfd5baa4077b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1d858e0ace34c39a641ede1db85be11, fe8f3cec39fb4964a4fccfd5baa4077b; no voters:
I20260807 13:50:29.720930 26079 raft_consensus.cc:2804] T 731a37a83f1b4971b0f4e7c44f7e3433 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:29.721068 26079 raft_consensus.cc:493] T 731a37a83f1b4971b0f4e7c44f7e3433 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:29.721190 26079 raft_consensus.cc:3060] T 731a37a83f1b4971b0f4e7c44f7e3433 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:29.723196 26079 raft_consensus.cc:515] T 731a37a83f1b4971b0f4e7c44f7e3433 P fe8f3cec39fb4964a4fccfd5baa4077b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } }
I20260807 13:50:29.723793 26079 leader_election.cc:290] T 731a37a83f1b4971b0f4e7c44f7e3433 P fe8f3cec39fb4964a4fccfd5baa4077b [CANDIDATE]: Term 1 election: Requested vote from peers d1d858e0ace34c39a641ede1db85be11 (127.23.107.134:46341), b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189)
I20260807 13:50:29.724258 25130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731a37a83f1b4971b0f4e7c44f7e3433" candidate_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1d858e0ace34c39a641ede1db85be11"
I20260807 13:50:29.724295 24775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731a37a83f1b4971b0f4e7c44f7e3433" candidate_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b890fcdb46dc4597bd9991906433c391"
I20260807 13:50:29.724493 25130 raft_consensus.cc:3060] T 731a37a83f1b4971b0f4e7c44f7e3433 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:29.724504 24775 raft_consensus.cc:3060] T 731a37a83f1b4971b0f4e7c44f7e3433 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:29.727650 25130 raft_consensus.cc:2468] T 731a37a83f1b4971b0f4e7c44f7e3433 P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe8f3cec39fb4964a4fccfd5baa4077b in term 1.
I20260807 13:50:29.727653 24775 raft_consensus.cc:2468] T 731a37a83f1b4971b0f4e7c44f7e3433 P b890fcdb46dc4597bd9991906433c391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe8f3cec39fb4964a4fccfd5baa4077b in term 1.
I20260807 13:50:29.728104 24339 leader_election.cc:304] T 731a37a83f1b4971b0f4e7c44f7e3433 P fe8f3cec39fb4964a4fccfd5baa4077b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b890fcdb46dc4597bd9991906433c391, fe8f3cec39fb4964a4fccfd5baa4077b; no voters:
I20260807 13:50:29.728416 26079 raft_consensus.cc:2804] T 731a37a83f1b4971b0f4e7c44f7e3433 P fe8f3cec39fb4964a4fccfd5baa4077b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:29.728816 26079 raft_consensus.cc:697] T 731a37a83f1b4971b0f4e7c44f7e3433 P fe8f3cec39fb4964a4fccfd5baa4077b [term 1 LEADER]: Becoming Leader. State: Replica: fe8f3cec39fb4964a4fccfd5baa4077b, State: Running, Role: LEADER
I20260807 13:50:29.729161 26079 consensus_queue.cc:237] T 731a37a83f1b4971b0f4e7c44f7e3433 P fe8f3cec39fb4964a4fccfd5baa4077b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } }
I20260807 13:50:29.732235 24041 catalog_manager.cc:5697] T 731a37a83f1b4971b0f4e7c44f7e3433 P fe8f3cec39fb4964a4fccfd5baa4077b reported cstate change: term changed from 0 to 1, leader changed from <none> to fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130). New cstate: current_term: 1 leader_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } health_report { overall_health: HEALTHY } } }
I20260807 13:50:30.113596 26079 consensus_queue.cc:1048] T 731a37a83f1b4971b0f4e7c44f7e3433 P fe8f3cec39fb4964a4fccfd5baa4077b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:30.115840 26373 consensus_queue.cc:1048] T 731a37a83f1b4971b0f4e7c44f7e3433 P fe8f3cec39fb4964a4fccfd5baa4077b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:30.140609 26225 consensus_queue.cc:1048] T c41e20fc995e483d900d559235f48b32 P b890fcdb46dc4597bd9991906433c391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:50:30.148322 26376 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:30.148849 26376 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260807 13:50:30.150022 26225 consensus_queue.cc:1048] T c41e20fc995e483d900d559235f48b32 P b890fcdb46dc4597bd9991906433c391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Using table 'rebalance_test_table_9'
I20260807 13:50:30.262821 25904 consensus_queue.cc:1048] T 5ab0e0a3aec1460192bbe02bf37342c1 P c8d4866795004103a4b0243906fe4d60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:30.277467 25904 consensus_queue.cc:1048] T 5ab0e0a3aec1460192bbe02bf37342c1 P c8d4866795004103a4b0243906fe4d60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 252.803 ms
time per row: 0.126401 ms
I20260807 13:50:30.636802 24035 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43984:
name: "rebalance_test_table_10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:50:30.647950 24572 tablet_service.cc:1511] Processing CreateTablet for tablet eea163000bab4b00b94290f685600b8f (DEFAULT_TABLE table=rebalance_test_table_10 [id=5cc480825ce046d89110c5a217df0168]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:30.648519 24572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eea163000bab4b00b94290f685600b8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:30.648782 24211 tablet_service.cc:1511] Processing CreateTablet for tablet eea163000bab4b00b94290f685600b8f (DEFAULT_TABLE table=rebalance_test_table_10 [id=5cc480825ce046d89110c5a217df0168]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:30.649010 24395 tablet_service.cc:1511] Processing CreateTablet for tablet 756b98adc32f484180185464f67b20dc (DEFAULT_TABLE table=rebalance_test_table_10 [id=5cc480825ce046d89110c5a217df0168]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:30.649260 24211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eea163000bab4b00b94290f685600b8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:30.649508 24395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 756b98adc32f484180185464f67b20dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:30.654469 24210 tablet_service.cc:1511] Processing CreateTablet for tablet b1a6f114c1fa4d1a98841a108196ba1e (DEFAULT_TABLE table=rebalance_test_table_10 [id=5cc480825ce046d89110c5a217df0168]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:30.654910 24210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1a6f114c1fa4d1a98841a108196ba1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:30.655014 24926 tablet_service.cc:1511] Processing CreateTablet for tablet eea163000bab4b00b94290f685600b8f (DEFAULT_TABLE table=rebalance_test_table_10 [id=5cc480825ce046d89110c5a217df0168]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:30.655447 24926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eea163000bab4b00b94290f685600b8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:30.655486 24750 tablet_service.cc:1511] Processing CreateTablet for tablet 756b98adc32f484180185464f67b20dc (DEFAULT_TABLE table=rebalance_test_table_10 [id=5cc480825ce046d89110c5a217df0168]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:30.655746 25106 tablet_service.cc:1511] Processing CreateTablet for tablet 756b98adc32f484180185464f67b20dc (DEFAULT_TABLE table=rebalance_test_table_10 [id=5cc480825ce046d89110c5a217df0168]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:30.655907 24750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 756b98adc32f484180185464f67b20dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:30.656184 25106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 756b98adc32f484180185464f67b20dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:30.661846 24927 tablet_service.cc:1511] Processing CreateTablet for tablet b1a6f114c1fa4d1a98841a108196ba1e (DEFAULT_TABLE table=rebalance_test_table_10 [id=5cc480825ce046d89110c5a217df0168]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:30.662262 24927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1a6f114c1fa4d1a98841a108196ba1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:30.666728 24573 tablet_service.cc:1511] Processing CreateTablet for tablet b1a6f114c1fa4d1a98841a108196ba1e (DEFAULT_TABLE table=rebalance_test_table_10 [id=5cc480825ce046d89110c5a217df0168]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:30.667322 24573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1a6f114c1fa4d1a98841a108196ba1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:30.681186 26487 tablet_bootstrap.cc:492] T b1a6f114c1fa4d1a98841a108196ba1e P d6d3ef3a235844cbbce1370e3aeb809f: Bootstrap starting.
I20260807 13:50:30.682250 26486 tablet_bootstrap.cc:492] T eea163000bab4b00b94290f685600b8f P c8d4866795004103a4b0243906fe4d60: Bootstrap starting.
I20260807 13:50:30.683332 26484 tablet_bootstrap.cc:492] T 756b98adc32f484180185464f67b20dc P b890fcdb46dc4597bd9991906433c391: Bootstrap starting.
I20260807 13:50:30.684441 26487 tablet_bootstrap.cc:654] T b1a6f114c1fa4d1a98841a108196ba1e P d6d3ef3a235844cbbce1370e3aeb809f: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:30.686005 26484 tablet_bootstrap.cc:654] T 756b98adc32f484180185464f67b20dc P b890fcdb46dc4597bd9991906433c391: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:30.686889 26478 tablet_bootstrap.cc:492] T 756b98adc32f484180185464f67b20dc P fe8f3cec39fb4964a4fccfd5baa4077b: Bootstrap starting.
I20260807 13:50:30.688242 26486 tablet_bootstrap.cc:654] T eea163000bab4b00b94290f685600b8f P c8d4866795004103a4b0243906fe4d60: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:30.690197 26477 tablet_bootstrap.cc:492] T eea163000bab4b00b94290f685600b8f P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Bootstrap starting.
I20260807 13:50:30.691018 26478 tablet_bootstrap.cc:654] T 756b98adc32f484180185464f67b20dc P fe8f3cec39fb4964a4fccfd5baa4077b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:30.692327 26477 tablet_bootstrap.cc:654] T eea163000bab4b00b94290f685600b8f P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:30.696775 26489 tablet_bootstrap.cc:492] T 756b98adc32f484180185464f67b20dc P d1d858e0ace34c39a641ede1db85be11: Bootstrap starting.
I20260807 13:50:30.699149 26478 tablet_bootstrap.cc:492] T 756b98adc32f484180185464f67b20dc P fe8f3cec39fb4964a4fccfd5baa4077b: No bootstrap required, opened a new log
I20260807 13:50:30.699368 26484 tablet_bootstrap.cc:492] T 756b98adc32f484180185464f67b20dc P b890fcdb46dc4597bd9991906433c391: No bootstrap required, opened a new log
I20260807 13:50:30.699553 26484 ts_tablet_manager.cc:1403] T 756b98adc32f484180185464f67b20dc P b890fcdb46dc4597bd9991906433c391: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.003s
I20260807 13:50:30.699827 26489 tablet_bootstrap.cc:654] T 756b98adc32f484180185464f67b20dc P d1d858e0ace34c39a641ede1db85be11: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:30.700103 26478 ts_tablet_manager.cc:1403] T 756b98adc32f484180185464f67b20dc P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.000s
I20260807 13:50:30.700518 26484 raft_consensus.cc:359] T 756b98adc32f484180185464f67b20dc P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:30.700740 26484 raft_consensus.cc:385] T 756b98adc32f484180185464f67b20dc P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:30.700918 26484 raft_consensus.cc:740] T 756b98adc32f484180185464f67b20dc P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b890fcdb46dc4597bd9991906433c391, State: Initialized, Role: FOLLOWER
I20260807 13:50:30.700874 26478 raft_consensus.cc:359] T 756b98adc32f484180185464f67b20dc P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:30.701072 26478 raft_consensus.cc:385] T 756b98adc32f484180185464f67b20dc P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:30.701215 26478 raft_consensus.cc:740] T 756b98adc32f484180185464f67b20dc P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8f3cec39fb4964a4fccfd5baa4077b, State: Initialized, Role: FOLLOWER
I20260807 13:50:30.701287 26484 consensus_queue.cc:260] T 756b98adc32f484180185464f67b20dc P b890fcdb46dc4597bd9991906433c391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:30.701545 26478 consensus_queue.cc:260] T 756b98adc32f484180185464f67b20dc P fe8f3cec39fb4964a4fccfd5baa4077b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:30.702169 26484 ts_tablet_manager.cc:1434] T 756b98adc32f484180185464f67b20dc P b890fcdb46dc4597bd9991906433c391: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 13:50:30.702561 26486 tablet_bootstrap.cc:492] T eea163000bab4b00b94290f685600b8f P c8d4866795004103a4b0243906fe4d60: No bootstrap required, opened a new log
I20260807 13:50:30.702720 26486 ts_tablet_manager.cc:1403] T eea163000bab4b00b94290f685600b8f P c8d4866795004103a4b0243906fe4d60: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.000s
I20260807 13:50:30.703914 26478 ts_tablet_manager.cc:1434] T 756b98adc32f484180185464f67b20dc P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260807 13:50:30.704229 26486 raft_consensus.cc:359] T eea163000bab4b00b94290f685600b8f P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:30.704484 26486 raft_consensus.cc:385] T eea163000bab4b00b94290f685600b8f P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:30.704644 26486 raft_consensus.cc:740] T eea163000bab4b00b94290f685600b8f P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8d4866795004103a4b0243906fe4d60, State: Initialized, Role: FOLLOWER
I20260807 13:50:30.704901 26486 consensus_queue.cc:260] T eea163000bab4b00b94290f685600b8f P c8d4866795004103a4b0243906fe4d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:30.705575 26486 ts_tablet_manager.cc:1434] T eea163000bab4b00b94290f685600b8f P c8d4866795004103a4b0243906fe4d60: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 13:50:30.705885 26486 tablet_bootstrap.cc:492] T b1a6f114c1fa4d1a98841a108196ba1e P c8d4866795004103a4b0243906fe4d60: Bootstrap starting.
I20260807 13:50:30.707867 26486 tablet_bootstrap.cc:654] T b1a6f114c1fa4d1a98841a108196ba1e P c8d4866795004103a4b0243906fe4d60: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:30.710595 26486 tablet_bootstrap.cc:492] T b1a6f114c1fa4d1a98841a108196ba1e P c8d4866795004103a4b0243906fe4d60: No bootstrap required, opened a new log
I20260807 13:50:30.710778 26486 ts_tablet_manager.cc:1403] T b1a6f114c1fa4d1a98841a108196ba1e P c8d4866795004103a4b0243906fe4d60: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 13:50:30.711444 26486 raft_consensus.cc:359] T b1a6f114c1fa4d1a98841a108196ba1e P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:30.711612 26486 raft_consensus.cc:385] T b1a6f114c1fa4d1a98841a108196ba1e P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:30.711669 26486 raft_consensus.cc:740] T b1a6f114c1fa4d1a98841a108196ba1e P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8d4866795004103a4b0243906fe4d60, State: Initialized, Role: FOLLOWER
I20260807 13:50:30.711858 26486 consensus_queue.cc:260] T b1a6f114c1fa4d1a98841a108196ba1e P c8d4866795004103a4b0243906fe4d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:30.712329 26486 ts_tablet_manager.cc:1434] T b1a6f114c1fa4d1a98841a108196ba1e P c8d4866795004103a4b0243906fe4d60: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 13:50:30.718134 26477 tablet_bootstrap.cc:492] T eea163000bab4b00b94290f685600b8f P 4d09f7af7d9d4d07bfb2114f45e9e8a4: No bootstrap required, opened a new log
I20260807 13:50:30.718205 26487 tablet_bootstrap.cc:492] T b1a6f114c1fa4d1a98841a108196ba1e P d6d3ef3a235844cbbce1370e3aeb809f: No bootstrap required, opened a new log
I20260807 13:50:30.718355 26487 ts_tablet_manager.cc:1403] T b1a6f114c1fa4d1a98841a108196ba1e P d6d3ef3a235844cbbce1370e3aeb809f: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.000s
I20260807 13:50:30.718361 26477 ts_tablet_manager.cc:1403] T eea163000bab4b00b94290f685600b8f P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.003s
I20260807 13:50:30.719245 26477 raft_consensus.cc:359] T eea163000bab4b00b94290f685600b8f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:30.719244 26487 raft_consensus.cc:359] T b1a6f114c1fa4d1a98841a108196ba1e P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:30.719460 26477 raft_consensus.cc:385] T eea163000bab4b00b94290f685600b8f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:30.719460 26487 raft_consensus.cc:385] T b1a6f114c1fa4d1a98841a108196ba1e P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:30.719576 26487 raft_consensus.cc:740] T b1a6f114c1fa4d1a98841a108196ba1e P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d3ef3a235844cbbce1370e3aeb809f, State: Initialized, Role: FOLLOWER
I20260807 13:50:30.719560 26477 raft_consensus.cc:740] T eea163000bab4b00b94290f685600b8f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Initialized, Role: FOLLOWER
I20260807 13:50:30.719827 26487 consensus_queue.cc:260] T b1a6f114c1fa4d1a98841a108196ba1e P d6d3ef3a235844cbbce1370e3aeb809f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:30.719827 26477 consensus_queue.cc:260] T eea163000bab4b00b94290f685600b8f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:30.720530 26487 ts_tablet_manager.cc:1434] T b1a6f114c1fa4d1a98841a108196ba1e P d6d3ef3a235844cbbce1370e3aeb809f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:50:30.720860 26487 tablet_bootstrap.cc:492] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f: Bootstrap starting.
I20260807 13:50:30.721299 26477 ts_tablet_manager.cc:1434] T eea163000bab4b00b94290f685600b8f P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:50:30.721616 26477 tablet_bootstrap.cc:492] T b1a6f114c1fa4d1a98841a108196ba1e P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Bootstrap starting.
I20260807 13:50:30.723500 26477 tablet_bootstrap.cc:654] T b1a6f114c1fa4d1a98841a108196ba1e P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:30.724371 26487 tablet_bootstrap.cc:654] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:30.726091 26489 tablet_bootstrap.cc:492] T 756b98adc32f484180185464f67b20dc P d1d858e0ace34c39a641ede1db85be11: No bootstrap required, opened a new log
I20260807 13:50:30.726313 26489 ts_tablet_manager.cc:1403] T 756b98adc32f484180185464f67b20dc P d1d858e0ace34c39a641ede1db85be11: Time spent bootstrapping tablet: real 0.030s user 0.006s sys 0.000s
I20260807 13:50:30.727270 26489 raft_consensus.cc:359] T 756b98adc32f484180185464f67b20dc P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:30.727480 26489 raft_consensus.cc:385] T 756b98adc32f484180185464f67b20dc P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:30.727591 26489 raft_consensus.cc:740] T 756b98adc32f484180185464f67b20dc P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Initialized, Role: FOLLOWER
I20260807 13:50:30.727854 26489 consensus_queue.cc:260] T 756b98adc32f484180185464f67b20dc P d1d858e0ace34c39a641ede1db85be11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:30.728439 26489 ts_tablet_manager.cc:1434] T 756b98adc32f484180185464f67b20dc P d1d858e0ace34c39a641ede1db85be11: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260807 13:50:30.729044 26487 tablet_bootstrap.cc:492] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f: No bootstrap required, opened a new log
I20260807 13:50:30.729224 26487 ts_tablet_manager.cc:1403] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260807 13:50:30.729945 26487 raft_consensus.cc:359] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:30.730118 26487 raft_consensus.cc:385] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:30.730216 26487 raft_consensus.cc:740] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d3ef3a235844cbbce1370e3aeb809f, State: Initialized, Role: FOLLOWER
I20260807 13:50:30.730486 26487 consensus_queue.cc:260] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:30.730983 26487 ts_tablet_manager.cc:1434] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260807 13:50:30.732609 26477 tablet_bootstrap.cc:492] T b1a6f114c1fa4d1a98841a108196ba1e P 4d09f7af7d9d4d07bfb2114f45e9e8a4: No bootstrap required, opened a new log
I20260807 13:50:30.732807 26477 ts_tablet_manager.cc:1403] T b1a6f114c1fa4d1a98841a108196ba1e P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.002s
I20260807 13:50:30.733716 26477 raft_consensus.cc:359] T b1a6f114c1fa4d1a98841a108196ba1e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:30.733978 26477 raft_consensus.cc:385] T b1a6f114c1fa4d1a98841a108196ba1e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:30.734107 26477 raft_consensus.cc:740] T b1a6f114c1fa4d1a98841a108196ba1e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Initialized, Role: FOLLOWER
I20260807 13:50:30.734391 26477 consensus_queue.cc:260] T b1a6f114c1fa4d1a98841a108196ba1e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:30.734915 26477 ts_tablet_manager.cc:1434] T b1a6f114c1fa4d1a98841a108196ba1e P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:50:30.743896 26389 raft_consensus.cc:493] T 756b98adc32f484180185464f67b20dc P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:30.744097 26389 raft_consensus.cc:515] T 756b98adc32f484180185464f67b20dc P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:30.744876 26389 leader_election.cc:290] T 756b98adc32f484180185464f67b20dc P b890fcdb46dc4597bd9991906433c391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619), d1d858e0ace34c39a641ede1db85be11 (127.23.107.134:46341)
I20260807 13:50:30.745396 25131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756b98adc32f484180185464f67b20dc" candidate_uuid: "b890fcdb46dc4597bd9991906433c391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1d858e0ace34c39a641ede1db85be11" is_pre_election: true
I20260807 13:50:30.745388 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756b98adc32f484180185464f67b20dc" candidate_uuid: "b890fcdb46dc4597bd9991906433c391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" is_pre_election: true
I20260807 13:50:30.745626 25131 raft_consensus.cc:2468] T 756b98adc32f484180185464f67b20dc P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b890fcdb46dc4597bd9991906433c391 in term 0.
I20260807 13:50:30.745656 24425 raft_consensus.cc:2468] T 756b98adc32f484180185464f67b20dc P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b890fcdb46dc4597bd9991906433c391 in term 0.
I20260807 13:50:30.746160 24692 leader_election.cc:304] T 756b98adc32f484180185464f67b20dc P b890fcdb46dc4597bd9991906433c391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: b890fcdb46dc4597bd9991906433c391, d1d858e0ace34c39a641ede1db85be11, fe8f3cec39fb4964a4fccfd5baa4077b; no voters:
I20260807 13:50:30.746498 26389 raft_consensus.cc:2804] T 756b98adc32f484180185464f67b20dc P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:30.746634 26389 raft_consensus.cc:493] T 756b98adc32f484180185464f67b20dc P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:30.746733 26389 raft_consensus.cc:3060] T 756b98adc32f484180185464f67b20dc P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:30.748775 26389 raft_consensus.cc:515] T 756b98adc32f484180185464f67b20dc P b890fcdb46dc4597bd9991906433c391 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:30.749395 26389 leader_election.cc:290] T 756b98adc32f484180185464f67b20dc P b890fcdb46dc4597bd9991906433c391 [CANDIDATE]: Term 1 election: Requested vote from peers fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619), d1d858e0ace34c39a641ede1db85be11 (127.23.107.134:46341)
I20260807 13:50:30.749854 25131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756b98adc32f484180185464f67b20dc" candidate_uuid: "b890fcdb46dc4597bd9991906433c391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1d858e0ace34c39a641ede1db85be11"
I20260807 13:50:30.749861 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756b98adc32f484180185464f67b20dc" candidate_uuid: "b890fcdb46dc4597bd9991906433c391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b"
I20260807 13:50:30.750051 25131 raft_consensus.cc:3060] T 756b98adc32f484180185464f67b20dc P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:30.750100 24425 raft_consensus.cc:3060] T 756b98adc32f484180185464f67b20dc P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:30.752087 24425 raft_consensus.cc:2468] T 756b98adc32f484180185464f67b20dc P fe8f3cec39fb4964a4fccfd5baa4077b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b890fcdb46dc4597bd9991906433c391 in term 1.
I20260807 13:50:30.752130 25131 raft_consensus.cc:2468] T 756b98adc32f484180185464f67b20dc P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b890fcdb46dc4597bd9991906433c391 in term 1.
I20260807 13:50:30.752568 24692 leader_election.cc:304] T 756b98adc32f484180185464f67b20dc P b890fcdb46dc4597bd9991906433c391 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b890fcdb46dc4597bd9991906433c391, fe8f3cec39fb4964a4fccfd5baa4077b; no voters:
I20260807 13:50:30.752940 26389 raft_consensus.cc:2804] T 756b98adc32f484180185464f67b20dc P b890fcdb46dc4597bd9991906433c391 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:30.753099 26389 raft_consensus.cc:697] T 756b98adc32f484180185464f67b20dc P b890fcdb46dc4597bd9991906433c391 [term 1 LEADER]: Becoming Leader. State: Replica: b890fcdb46dc4597bd9991906433c391, State: Running, Role: LEADER
I20260807 13:50:30.753469 26389 consensus_queue.cc:237] T 756b98adc32f484180185464f67b20dc P b890fcdb46dc4597bd9991906433c391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } }
I20260807 13:50:30.756712 24041 catalog_manager.cc:5697] T 756b98adc32f484180185464f67b20dc P b890fcdb46dc4597bd9991906433c391 reported cstate change: term changed from 0 to 1, leader changed from <none> to b890fcdb46dc4597bd9991906433c391 (127.23.107.132). New cstate: current_term: 1 leader_uuid: "b890fcdb46dc4597bd9991906433c391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } health_report { overall_health: UNKNOWN } } }
I20260807 13:50:30.912431 26261 raft_consensus.cc:493] T b1a6f114c1fa4d1a98841a108196ba1e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:30.912668 26261 raft_consensus.cc:515] T b1a6f114c1fa4d1a98841a108196ba1e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:30.913476 26261 leader_election.cc:290] T b1a6f114c1fa4d1a98841a108196ba1e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131), c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641)
I20260807 13:50:30.914228 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a6f114c1fa4d1a98841a108196ba1e" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60" is_pre_election: true
I20260807 13:50:30.914249 24956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a6f114c1fa4d1a98841a108196ba1e" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" is_pre_election: true
I20260807 13:50:30.914487 24956 raft_consensus.cc:2468] T b1a6f114c1fa4d1a98841a108196ba1e P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 0.
I20260807 13:50:30.914518 24600 raft_consensus.cc:2468] T b1a6f114c1fa4d1a98841a108196ba1e P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 0.
I20260807 13:50:30.915067 24152 leader_election.cc:304] T b1a6f114c1fa4d1a98841a108196ba1e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, c8d4866795004103a4b0243906fe4d60; no voters:
I20260807 13:50:30.915421 26261 raft_consensus.cc:2804] T b1a6f114c1fa4d1a98841a108196ba1e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:30.915539 26261 raft_consensus.cc:493] T b1a6f114c1fa4d1a98841a108196ba1e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:30.915716 26261 raft_consensus.cc:3060] T b1a6f114c1fa4d1a98841a108196ba1e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:30.918572 26261 raft_consensus.cc:515] T b1a6f114c1fa4d1a98841a108196ba1e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:30.919593 26261 leader_election.cc:290] T b1a6f114c1fa4d1a98841a108196ba1e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 election: Requested vote from peers d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133:40131), c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641)
I20260807 13:50:30.920042 24956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a6f114c1fa4d1a98841a108196ba1e" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d3ef3a235844cbbce1370e3aeb809f"
I20260807 13:50:30.920259 24956 raft_consensus.cc:3060] T b1a6f114c1fa4d1a98841a108196ba1e P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:30.920567 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a6f114c1fa4d1a98841a108196ba1e" candidate_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60"
I20260807 13:50:30.920789 24600 raft_consensus.cc:3060] T b1a6f114c1fa4d1a98841a108196ba1e P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:30.923475 24956 raft_consensus.cc:2468] T b1a6f114c1fa4d1a98841a108196ba1e P d6d3ef3a235844cbbce1370e3aeb809f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 1.
I20260807 13:50:30.923817 24600 raft_consensus.cc:2468] T b1a6f114c1fa4d1a98841a108196ba1e P c8d4866795004103a4b0243906fe4d60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d09f7af7d9d4d07bfb2114f45e9e8a4 in term 1.
I20260807 13:50:30.923928 24152 leader_election.cc:304] T b1a6f114c1fa4d1a98841a108196ba1e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, d6d3ef3a235844cbbce1370e3aeb809f; no voters:
I20260807 13:50:30.924232 26261 raft_consensus.cc:2804] T b1a6f114c1fa4d1a98841a108196ba1e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:30.924634 26261 raft_consensus.cc:697] T b1a6f114c1fa4d1a98841a108196ba1e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 LEADER]: Becoming Leader. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Running, Role: LEADER
I20260807 13:50:30.924959 26261 consensus_queue.cc:237] T b1a6f114c1fa4d1a98841a108196ba1e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:30.928038 24041 catalog_manager.cc:5697] T b1a6f114c1fa4d1a98841a108196ba1e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129). New cstate: current_term: 1 leader_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } health_report { overall_health: HEALTHY } } }
I20260807 13:50:30.975378 26265 raft_consensus.cc:493] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:30.975580 26265 raft_consensus.cc:515] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:30.976323 26265 leader_election.cc:290] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641), 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973)
I20260807 13:50:30.976853 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea163000bab4b00b94290f685600b8f" candidate_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60" is_pre_election: true
I20260807 13:50:30.977121 24600 raft_consensus.cc:2468] T eea163000bab4b00b94290f685600b8f P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6d3ef3a235844cbbce1370e3aeb809f in term 0.
I20260807 13:50:30.977125 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea163000bab4b00b94290f685600b8f" candidate_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" is_pre_election: true
I20260807 13:50:30.977393 24240 raft_consensus.cc:2468] T eea163000bab4b00b94290f685600b8f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6d3ef3a235844cbbce1370e3aeb809f in term 0.
I20260807 13:50:30.977739 24863 leader_election.cc:304] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8d4866795004103a4b0243906fe4d60, d6d3ef3a235844cbbce1370e3aeb809f; no voters:
I20260807 13:50:30.978178 26265 raft_consensus.cc:2804] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:30.978291 26265 raft_consensus.cc:493] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:30.978372 26265 raft_consensus.cc:3060] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:30.981539 26265 raft_consensus.cc:515] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:30.982249 26265 leader_election.cc:290] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f [CANDIDATE]: Term 1 election: Requested vote from peers c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641), 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973)
I20260807 13:50:30.982746 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea163000bab4b00b94290f685600b8f" candidate_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60"
I20260807 13:50:30.982801 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea163000bab4b00b94290f685600b8f" candidate_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4"
I20260807 13:50:30.982964 24600 raft_consensus.cc:3060] T eea163000bab4b00b94290f685600b8f P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:30.983029 24240 raft_consensus.cc:3060] T eea163000bab4b00b94290f685600b8f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:30.985960 24600 raft_consensus.cc:2468] T eea163000bab4b00b94290f685600b8f P c8d4866795004103a4b0243906fe4d60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6d3ef3a235844cbbce1370e3aeb809f in term 1.
I20260807 13:50:30.987439 24240 raft_consensus.cc:2468] T eea163000bab4b00b94290f685600b8f P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6d3ef3a235844cbbce1370e3aeb809f in term 1.
I20260807 13:50:30.988178 24864 leader_election.cc:304] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, d6d3ef3a235844cbbce1370e3aeb809f; no voters:
I20260807 13:50:30.988518 26265 raft_consensus.cc:2804] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:30.993131 26265 raft_consensus.cc:697] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f [term 1 LEADER]: Becoming Leader. State: Replica: d6d3ef3a235844cbbce1370e3aeb809f, State: Running, Role: LEADER
I20260807 13:50:30.993836 26265 consensus_queue.cc:237] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:30.997736 24041 catalog_manager.cc:5697] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f reported cstate change: term changed from 0 to 1, leader changed from <none> to d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133). New cstate: current_term: 1 leader_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } health_report { overall_health: UNKNOWN } } }
I20260807 13:50:31.335075 26389 consensus_queue.cc:1048] T 756b98adc32f484180185464f67b20dc P b890fcdb46dc4597bd9991906433c391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:31.342456 26512 consensus_queue.cc:1048] T 756b98adc32f484180185464f67b20dc P b890fcdb46dc4597bd9991906433c391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:31.366552 26261 consensus_queue.cc:1048] T b1a6f114c1fa4d1a98841a108196ba1e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:31.373477 26261 consensus_queue.cc:1048] T b1a6f114c1fa4d1a98841a108196ba1e P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:50:31.437417 26507 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:31.437866 26507 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_10'
I20260807 13:50:31.500336 26265 consensus_queue.cc:1048] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:31.512328 26505 consensus_queue.cc:1048] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 307.935 ms
time per row: 0.153967 ms
I20260807 13:50:32.023947 24028 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43984:
name: "rebalance_test_table_11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:50:32.035320 25106 tablet_service.cc:1511] Processing CreateTablet for tablet 8873a0b31fda4a599ba21516205f1d08 (DEFAULT_TABLE table=rebalance_test_table_11 [id=2bd2a1d99fab4cc8a7dfdfd037e2b153]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:32.035889 25106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8873a0b31fda4a599ba21516205f1d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:32.035902 24395 tablet_service.cc:1511] Processing CreateTablet for tablet 8873a0b31fda4a599ba21516205f1d08 (DEFAULT_TABLE table=rebalance_test_table_11 [id=2bd2a1d99fab4cc8a7dfdfd037e2b153]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:32.036448 24395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8873a0b31fda4a599ba21516205f1d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:32.037318 25107 tablet_service.cc:1511] Processing CreateTablet for tablet a5cd607f20de44bfbff21eb6e8faedf5 (DEFAULT_TABLE table=rebalance_test_table_11 [id=2bd2a1d99fab4cc8a7dfdfd037e2b153]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:32.037782 25107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5cd607f20de44bfbff21eb6e8faedf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:32.038731 24211 tablet_service.cc:1511] Processing CreateTablet for tablet 80944a99757c4e25a641c2cc177b30ae (DEFAULT_TABLE table=rebalance_test_table_11 [id=2bd2a1d99fab4cc8a7dfdfd037e2b153]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:32.039197 24211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80944a99757c4e25a641c2cc177b30ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:32.040396 24750 tablet_service.cc:1511] Processing CreateTablet for tablet 8873a0b31fda4a599ba21516205f1d08 (DEFAULT_TABLE table=rebalance_test_table_11 [id=2bd2a1d99fab4cc8a7dfdfd037e2b153]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:32.040870 24750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8873a0b31fda4a599ba21516205f1d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:32.043728 24751 tablet_service.cc:1511] Processing CreateTablet for tablet a5cd607f20de44bfbff21eb6e8faedf5 (DEFAULT_TABLE table=rebalance_test_table_11 [id=2bd2a1d99fab4cc8a7dfdfd037e2b153]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:32.044164 24751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5cd607f20de44bfbff21eb6e8faedf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:32.044767 24927 tablet_service.cc:1511] Processing CreateTablet for tablet 80944a99757c4e25a641c2cc177b30ae (DEFAULT_TABLE table=rebalance_test_table_11 [id=2bd2a1d99fab4cc8a7dfdfd037e2b153]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:32.045204 24927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80944a99757c4e25a641c2cc177b30ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:32.045818 24573 tablet_service.cc:1511] Processing CreateTablet for tablet 80944a99757c4e25a641c2cc177b30ae (DEFAULT_TABLE table=rebalance_test_table_11 [id=2bd2a1d99fab4cc8a7dfdfd037e2b153]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:32.046262 24573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80944a99757c4e25a641c2cc177b30ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:32.051888 24396 tablet_service.cc:1511] Processing CreateTablet for tablet a5cd607f20de44bfbff21eb6e8faedf5 (DEFAULT_TABLE table=rebalance_test_table_11 [id=2bd2a1d99fab4cc8a7dfdfd037e2b153]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:32.052348 24396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5cd607f20de44bfbff21eb6e8faedf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:32.064497 26595 tablet_bootstrap.cc:492] T 8873a0b31fda4a599ba21516205f1d08 P fe8f3cec39fb4964a4fccfd5baa4077b: Bootstrap starting.
I20260807 13:50:32.067087 26594 tablet_bootstrap.cc:492] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f: Bootstrap starting.
I20260807 13:50:32.067480 26595 tablet_bootstrap.cc:654] T 8873a0b31fda4a599ba21516205f1d08 P fe8f3cec39fb4964a4fccfd5baa4077b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:32.070811 26594 tablet_bootstrap.cc:654] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:32.072731 26592 tablet_bootstrap.cc:492] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11: Bootstrap starting.
I20260807 13:50:32.075037 26592 tablet_bootstrap.cc:654] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:32.077116 26598 tablet_bootstrap.cc:492] T 80944a99757c4e25a641c2cc177b30ae P c8d4866795004103a4b0243906fe4d60: Bootstrap starting.
I20260807 13:50:32.077584 26596 tablet_bootstrap.cc:492] T 80944a99757c4e25a641c2cc177b30ae P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Bootstrap starting.
I20260807 13:50:32.077684 26595 tablet_bootstrap.cc:492] T 8873a0b31fda4a599ba21516205f1d08 P fe8f3cec39fb4964a4fccfd5baa4077b: No bootstrap required, opened a new log
I20260807 13:50:32.077889 26595 ts_tablet_manager.cc:1403] T 8873a0b31fda4a599ba21516205f1d08 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.007s
I20260807 13:50:32.078750 26593 tablet_bootstrap.cc:492] T a5cd607f20de44bfbff21eb6e8faedf5 P b890fcdb46dc4597bd9991906433c391: Bootstrap starting.
I20260807 13:50:32.078953 26595 raft_consensus.cc:359] T 8873a0b31fda4a599ba21516205f1d08 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:32.079285 26595 raft_consensus.cc:385] T 8873a0b31fda4a599ba21516205f1d08 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:32.079473 26595 raft_consensus.cc:740] T 8873a0b31fda4a599ba21516205f1d08 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8f3cec39fb4964a4fccfd5baa4077b, State: Initialized, Role: FOLLOWER
I20260807 13:50:32.079896 26595 consensus_queue.cc:260] T 8873a0b31fda4a599ba21516205f1d08 P fe8f3cec39fb4964a4fccfd5baa4077b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:32.080149 26598 tablet_bootstrap.cc:654] T 80944a99757c4e25a641c2cc177b30ae P c8d4866795004103a4b0243906fe4d60: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:32.081037 26593 tablet_bootstrap.cc:654] T a5cd607f20de44bfbff21eb6e8faedf5 P b890fcdb46dc4597bd9991906433c391: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:32.084403 26595 ts_tablet_manager.cc:1434] T 8873a0b31fda4a599ba21516205f1d08 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260807 13:50:32.084892 26592 tablet_bootstrap.cc:492] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11: No bootstrap required, opened a new log
I20260807 13:50:32.084921 26596 tablet_bootstrap.cc:654] T 80944a99757c4e25a641c2cc177b30ae P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:32.085516 26592 ts_tablet_manager.cc:1403] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.000s
I20260807 13:50:32.086387 26595 tablet_bootstrap.cc:492] T a5cd607f20de44bfbff21eb6e8faedf5 P fe8f3cec39fb4964a4fccfd5baa4077b: Bootstrap starting.
I20260807 13:50:32.087456 26592 raft_consensus.cc:359] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:32.088393 26592 raft_consensus.cc:385] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:32.088718 26595 tablet_bootstrap.cc:654] T a5cd607f20de44bfbff21eb6e8faedf5 P fe8f3cec39fb4964a4fccfd5baa4077b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:32.088897 26592 raft_consensus.cc:740] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Initialized, Role: FOLLOWER
I20260807 13:50:32.089426 26592 consensus_queue.cc:260] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:32.091498 26594 tablet_bootstrap.cc:492] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f: No bootstrap required, opened a new log
I20260807 13:50:32.091698 26594 ts_tablet_manager.cc:1403] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.005s
I20260807 13:50:32.092844 26594 raft_consensus.cc:359] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:32.093042 26594 raft_consensus.cc:385] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:32.093199 26594 raft_consensus.cc:740] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d3ef3a235844cbbce1370e3aeb809f, State: Initialized, Role: FOLLOWER
I20260807 13:50:32.093566 26594 consensus_queue.cc:260] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:32.094378 26594 ts_tablet_manager.cc:1434] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 13:50:32.096015 26592 ts_tablet_manager.cc:1434] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260807 13:50:32.096339 26592 tablet_bootstrap.cc:492] T 8873a0b31fda4a599ba21516205f1d08 P d1d858e0ace34c39a641ede1db85be11: Bootstrap starting.
I20260807 13:50:32.098158 26592 tablet_bootstrap.cc:654] T 8873a0b31fda4a599ba21516205f1d08 P d1d858e0ace34c39a641ede1db85be11: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:32.099100 26598 tablet_bootstrap.cc:492] T 80944a99757c4e25a641c2cc177b30ae P c8d4866795004103a4b0243906fe4d60: No bootstrap required, opened a new log
I20260807 13:50:32.099327 26598 ts_tablet_manager.cc:1403] T 80944a99757c4e25a641c2cc177b30ae P c8d4866795004103a4b0243906fe4d60: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.005s
I20260807 13:50:32.100296 26598 raft_consensus.cc:359] T 80944a99757c4e25a641c2cc177b30ae P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:32.100531 26598 raft_consensus.cc:385] T 80944a99757c4e25a641c2cc177b30ae P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:32.100637 26598 raft_consensus.cc:740] T 80944a99757c4e25a641c2cc177b30ae P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8d4866795004103a4b0243906fe4d60, State: Initialized, Role: FOLLOWER
I20260807 13:50:32.101548 26598 consensus_queue.cc:260] T 80944a99757c4e25a641c2cc177b30ae P c8d4866795004103a4b0243906fe4d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:32.104202 26598 ts_tablet_manager.cc:1434] T 80944a99757c4e25a641c2cc177b30ae P c8d4866795004103a4b0243906fe4d60: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260807 13:50:32.105808 26592 tablet_bootstrap.cc:492] T 8873a0b31fda4a599ba21516205f1d08 P d1d858e0ace34c39a641ede1db85be11: No bootstrap required, opened a new log
I20260807 13:50:32.106021 26592 ts_tablet_manager.cc:1403] T 8873a0b31fda4a599ba21516205f1d08 P d1d858e0ace34c39a641ede1db85be11: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20260807 13:50:32.106894 26592 raft_consensus.cc:359] T 8873a0b31fda4a599ba21516205f1d08 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:32.107156 26592 raft_consensus.cc:385] T 8873a0b31fda4a599ba21516205f1d08 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:32.107260 26592 raft_consensus.cc:740] T 8873a0b31fda4a599ba21516205f1d08 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Initialized, Role: FOLLOWER
I20260807 13:50:32.107568 26592 consensus_queue.cc:260] T 8873a0b31fda4a599ba21516205f1d08 P d1d858e0ace34c39a641ede1db85be11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:32.108764 26592 ts_tablet_manager.cc:1434] T 8873a0b31fda4a599ba21516205f1d08 P d1d858e0ace34c39a641ede1db85be11: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260807 13:50:32.110345 26593 tablet_bootstrap.cc:492] T a5cd607f20de44bfbff21eb6e8faedf5 P b890fcdb46dc4597bd9991906433c391: No bootstrap required, opened a new log
I20260807 13:50:32.110570 26593 ts_tablet_manager.cc:1403] T a5cd607f20de44bfbff21eb6e8faedf5 P b890fcdb46dc4597bd9991906433c391: Time spent bootstrapping tablet: real 0.032s user 0.000s sys 0.007s
I20260807 13:50:32.111665 26593 raft_consensus.cc:359] T a5cd607f20de44bfbff21eb6e8faedf5 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:32.112355 26593 raft_consensus.cc:385] T a5cd607f20de44bfbff21eb6e8faedf5 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:32.112490 26593 raft_consensus.cc:740] T a5cd607f20de44bfbff21eb6e8faedf5 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b890fcdb46dc4597bd9991906433c391, State: Initialized, Role: FOLLOWER
I20260807 13:50:32.112761 26593 consensus_queue.cc:260] T a5cd607f20de44bfbff21eb6e8faedf5 P b890fcdb46dc4597bd9991906433c391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:32.114763 26593 ts_tablet_manager.cc:1434] T a5cd607f20de44bfbff21eb6e8faedf5 P b890fcdb46dc4597bd9991906433c391: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260807 13:50:32.115295 26593 tablet_bootstrap.cc:492] T 8873a0b31fda4a599ba21516205f1d08 P b890fcdb46dc4597bd9991906433c391: Bootstrap starting.
I20260807 13:50:32.116829 26596 tablet_bootstrap.cc:492] T 80944a99757c4e25a641c2cc177b30ae P 4d09f7af7d9d4d07bfb2114f45e9e8a4: No bootstrap required, opened a new log
I20260807 13:50:32.117060 26596 ts_tablet_manager.cc:1403] T 80944a99757c4e25a641c2cc177b30ae P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent bootstrapping tablet: real 0.040s user 0.007s sys 0.000s
I20260807 13:50:32.119874 26596 raft_consensus.cc:359] T 80944a99757c4e25a641c2cc177b30ae P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:32.120278 26596 raft_consensus.cc:385] T 80944a99757c4e25a641c2cc177b30ae P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:32.120433 26596 raft_consensus.cc:740] T 80944a99757c4e25a641c2cc177b30ae P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d09f7af7d9d4d07bfb2114f45e9e8a4, State: Initialized, Role: FOLLOWER
I20260807 13:50:32.120726 26596 consensus_queue.cc:260] T 80944a99757c4e25a641c2cc177b30ae P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:32.121532 26596 ts_tablet_manager.cc:1434] T 80944a99757c4e25a641c2cc177b30ae P 4d09f7af7d9d4d07bfb2114f45e9e8a4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 13:50:32.124372 26593 tablet_bootstrap.cc:654] T 8873a0b31fda4a599ba21516205f1d08 P b890fcdb46dc4597bd9991906433c391: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:32.124792 26595 tablet_bootstrap.cc:492] T a5cd607f20de44bfbff21eb6e8faedf5 P fe8f3cec39fb4964a4fccfd5baa4077b: No bootstrap required, opened a new log
I20260807 13:50:32.125034 26595 ts_tablet_manager.cc:1403] T a5cd607f20de44bfbff21eb6e8faedf5 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent bootstrapping tablet: real 0.039s user 0.021s sys 0.010s
I20260807 13:50:32.126896 26595 raft_consensus.cc:359] T a5cd607f20de44bfbff21eb6e8faedf5 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:32.127890 26593 tablet_bootstrap.cc:492] T 8873a0b31fda4a599ba21516205f1d08 P b890fcdb46dc4597bd9991906433c391: No bootstrap required, opened a new log
I20260807 13:50:32.128055 26593 ts_tablet_manager.cc:1403] T 8873a0b31fda4a599ba21516205f1d08 P b890fcdb46dc4597bd9991906433c391: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.002s
I20260807 13:50:32.128077 26595 raft_consensus.cc:385] T a5cd607f20de44bfbff21eb6e8faedf5 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:32.128259 26595 raft_consensus.cc:740] T a5cd607f20de44bfbff21eb6e8faedf5 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8f3cec39fb4964a4fccfd5baa4077b, State: Initialized, Role: FOLLOWER
I20260807 13:50:32.128813 26595 consensus_queue.cc:260] T a5cd607f20de44bfbff21eb6e8faedf5 P fe8f3cec39fb4964a4fccfd5baa4077b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:32.128988 26593 raft_consensus.cc:359] T 8873a0b31fda4a599ba21516205f1d08 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:32.129246 26593 raft_consensus.cc:385] T 8873a0b31fda4a599ba21516205f1d08 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:32.129362 26593 raft_consensus.cc:740] T 8873a0b31fda4a599ba21516205f1d08 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b890fcdb46dc4597bd9991906433c391, State: Initialized, Role: FOLLOWER
I20260807 13:50:32.129518 26595 ts_tablet_manager.cc:1434] T a5cd607f20de44bfbff21eb6e8faedf5 P fe8f3cec39fb4964a4fccfd5baa4077b: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260807 13:50:32.129665 26593 consensus_queue.cc:260] T 8873a0b31fda4a599ba21516205f1d08 P b890fcdb46dc4597bd9991906433c391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:32.130280 26593 ts_tablet_manager.cc:1434] T 8873a0b31fda4a599ba21516205f1d08 P b890fcdb46dc4597bd9991906433c391: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 13:50:32.133057 26582 raft_consensus.cc:493] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:32.133237 26582 raft_consensus.cc:515] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:32.134192 26582 leader_election.cc:290] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641), 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973)
I20260807 13:50:32.134872 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80944a99757c4e25a641c2cc177b30ae" candidate_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60" is_pre_election: true
I20260807 13:50:32.135123 24600 raft_consensus.cc:2468] T 80944a99757c4e25a641c2cc177b30ae P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6d3ef3a235844cbbce1370e3aeb809f in term 0.
I20260807 13:50:32.135249 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80944a99757c4e25a641c2cc177b30ae" candidate_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" is_pre_election: true
I20260807 13:50:32.135516 24240 raft_consensus.cc:2468] T 80944a99757c4e25a641c2cc177b30ae P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6d3ef3a235844cbbce1370e3aeb809f in term 0.
I20260807 13:50:32.136035 24864 leader_election.cc:304] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, d6d3ef3a235844cbbce1370e3aeb809f; no voters:
I20260807 13:50:32.136351 26582 raft_consensus.cc:2804] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:32.136499 26582 raft_consensus.cc:493] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:32.136610 26582 raft_consensus.cc:3060] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:32.139448 26582 raft_consensus.cc:515] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:32.140115 26582 leader_election.cc:290] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f [CANDIDATE]: Term 1 election: Requested vote from peers c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641), 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973)
I20260807 13:50:32.140486 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80944a99757c4e25a641c2cc177b30ae" candidate_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d4866795004103a4b0243906fe4d60"
I20260807 13:50:32.140645 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80944a99757c4e25a641c2cc177b30ae" candidate_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4"
I20260807 13:50:32.140694 24600 raft_consensus.cc:3060] T 80944a99757c4e25a641c2cc177b30ae P c8d4866795004103a4b0243906fe4d60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:32.140873 24240 raft_consensus.cc:3060] T 80944a99757c4e25a641c2cc177b30ae P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:32.143668 24240 raft_consensus.cc:2468] T 80944a99757c4e25a641c2cc177b30ae P 4d09f7af7d9d4d07bfb2114f45e9e8a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6d3ef3a235844cbbce1370e3aeb809f in term 1.
I20260807 13:50:32.143759 24600 raft_consensus.cc:2468] T 80944a99757c4e25a641c2cc177b30ae P c8d4866795004103a4b0243906fe4d60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6d3ef3a235844cbbce1370e3aeb809f in term 1.
I20260807 13:50:32.144292 24864 leader_election.cc:304] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d09f7af7d9d4d07bfb2114f45e9e8a4, d6d3ef3a235844cbbce1370e3aeb809f; no voters:
I20260807 13:50:32.144630 26582 raft_consensus.cc:2804] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:32.144838 26582 raft_consensus.cc:697] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f [term 1 LEADER]: Becoming Leader. State: Replica: d6d3ef3a235844cbbce1370e3aeb809f, State: Running, Role: LEADER
I20260807 13:50:32.145201 26582 consensus_queue.cc:237] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } }
I20260807 13:50:32.148753 24028 catalog_manager.cc:5697] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f reported cstate change: term changed from 0 to 1, leader changed from <none> to d6d3ef3a235844cbbce1370e3aeb809f (127.23.107.133). New cstate: current_term: 1 leader_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6d3ef3a235844cbbce1370e3aeb809f" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 40131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 } health_report { overall_health: UNKNOWN } } }
I20260807 13:50:32.235105 26380 raft_consensus.cc:493] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:32.235327 26380 raft_consensus.cc:515] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:32.236264 26380 leader_election.cc:290] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619), b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189)
I20260807 13:50:32.236797 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5cd607f20de44bfbff21eb6e8faedf5" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" is_pre_election: true
I20260807 13:50:32.236901 24775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5cd607f20de44bfbff21eb6e8faedf5" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b890fcdb46dc4597bd9991906433c391" is_pre_election: true
I20260807 13:50:32.237061 24425 raft_consensus.cc:2468] T a5cd607f20de44bfbff21eb6e8faedf5 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 0.
I20260807 13:50:32.237110 24775 raft_consensus.cc:2468] T a5cd607f20de44bfbff21eb6e8faedf5 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 0.
I20260807 13:50:32.237591 25049 leader_election.cc:304] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1d858e0ace34c39a641ede1db85be11, fe8f3cec39fb4964a4fccfd5baa4077b; no voters:
I20260807 13:50:32.237906 26380 raft_consensus.cc:2804] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:32.238034 26380 raft_consensus.cc:493] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:32.238150 26380 raft_consensus.cc:3060] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:32.240182 26380 raft_consensus.cc:515] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:32.240782 26380 leader_election.cc:290] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 election: Requested vote from peers fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619), b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189)
I20260807 13:50:32.241143 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5cd607f20de44bfbff21eb6e8faedf5" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b"
I20260807 13:50:32.241333 24425 raft_consensus.cc:3060] T a5cd607f20de44bfbff21eb6e8faedf5 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:32.241387 24775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5cd607f20de44bfbff21eb6e8faedf5" candidate_uuid: "d1d858e0ace34c39a641ede1db85be11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b890fcdb46dc4597bd9991906433c391"
I20260807 13:50:32.241624 24775 raft_consensus.cc:3060] T a5cd607f20de44bfbff21eb6e8faedf5 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:32.244151 24425 raft_consensus.cc:2468] T a5cd607f20de44bfbff21eb6e8faedf5 P fe8f3cec39fb4964a4fccfd5baa4077b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 1.
I20260807 13:50:32.244592 24775 raft_consensus.cc:2468] T a5cd607f20de44bfbff21eb6e8faedf5 P b890fcdb46dc4597bd9991906433c391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1d858e0ace34c39a641ede1db85be11 in term 1.
I20260807 13:50:32.244846 25049 leader_election.cc:304] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1d858e0ace34c39a641ede1db85be11, fe8f3cec39fb4964a4fccfd5baa4077b; no voters:
I20260807 13:50:32.245168 26380 raft_consensus.cc:2804] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:32.245378 26380 raft_consensus.cc:697] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11 [term 1 LEADER]: Becoming Leader. State: Replica: d1d858e0ace34c39a641ede1db85be11, State: Running, Role: LEADER
I20260807 13:50:32.245724 26380 consensus_queue.cc:237] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:32.248919 24028 catalog_manager.cc:5697] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1d858e0ace34c39a641ede1db85be11 (127.23.107.134). New cstate: current_term: 1 leader_uuid: "d1d858e0ace34c39a641ede1db85be11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } health_report { overall_health: UNKNOWN } } }
I20260807 13:50:32.251845 26381 raft_consensus.cc:493] T 8873a0b31fda4a599ba21516205f1d08 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:32.252038 26381 raft_consensus.cc:515] T 8873a0b31fda4a599ba21516205f1d08 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:32.252688 26381 leader_election.cc:290] T 8873a0b31fda4a599ba21516205f1d08 P fe8f3cec39fb4964a4fccfd5baa4077b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1d858e0ace34c39a641ede1db85be11 (127.23.107.134:46341), b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189)
I20260807 13:50:32.253118 25131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8873a0b31fda4a599ba21516205f1d08" candidate_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1d858e0ace34c39a641ede1db85be11" is_pre_election: true
I20260807 13:50:32.253279 24775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8873a0b31fda4a599ba21516205f1d08" candidate_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b890fcdb46dc4597bd9991906433c391" is_pre_election: true
I20260807 13:50:32.253367 25131 raft_consensus.cc:2468] T 8873a0b31fda4a599ba21516205f1d08 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe8f3cec39fb4964a4fccfd5baa4077b in term 0.
I20260807 13:50:32.253562 24775 raft_consensus.cc:2468] T 8873a0b31fda4a599ba21516205f1d08 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe8f3cec39fb4964a4fccfd5baa4077b in term 0.
I20260807 13:50:32.253924 24339 leader_election.cc:304] T 8873a0b31fda4a599ba21516205f1d08 P fe8f3cec39fb4964a4fccfd5baa4077b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1d858e0ace34c39a641ede1db85be11, fe8f3cec39fb4964a4fccfd5baa4077b; no voters:
I20260807 13:50:32.254190 26381 raft_consensus.cc:2804] T 8873a0b31fda4a599ba21516205f1d08 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:32.254319 26381 raft_consensus.cc:493] T 8873a0b31fda4a599ba21516205f1d08 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:32.254416 26381 raft_consensus.cc:3060] T 8873a0b31fda4a599ba21516205f1d08 P fe8f3cec39fb4964a4fccfd5baa4077b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:32.256394 26381 raft_consensus.cc:515] T 8873a0b31fda4a599ba21516205f1d08 P fe8f3cec39fb4964a4fccfd5baa4077b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:32.256987 26381 leader_election.cc:290] T 8873a0b31fda4a599ba21516205f1d08 P fe8f3cec39fb4964a4fccfd5baa4077b [CANDIDATE]: Term 1 election: Requested vote from peers d1d858e0ace34c39a641ede1db85be11 (127.23.107.134:46341), b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189)
I20260807 13:50:32.257411 25131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8873a0b31fda4a599ba21516205f1d08" candidate_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1d858e0ace34c39a641ede1db85be11"
I20260807 13:50:32.257472 24775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8873a0b31fda4a599ba21516205f1d08" candidate_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b890fcdb46dc4597bd9991906433c391"
I20260807 13:50:32.257650 24775 raft_consensus.cc:3060] T 8873a0b31fda4a599ba21516205f1d08 P b890fcdb46dc4597bd9991906433c391 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:32.257654 25131 raft_consensus.cc:3060] T 8873a0b31fda4a599ba21516205f1d08 P d1d858e0ace34c39a641ede1db85be11 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:32.259725 25131 raft_consensus.cc:2468] T 8873a0b31fda4a599ba21516205f1d08 P d1d858e0ace34c39a641ede1db85be11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe8f3cec39fb4964a4fccfd5baa4077b in term 1.
I20260807 13:50:32.259804 24775 raft_consensus.cc:2468] T 8873a0b31fda4a599ba21516205f1d08 P b890fcdb46dc4597bd9991906433c391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe8f3cec39fb4964a4fccfd5baa4077b in term 1.
I20260807 13:50:32.260269 24339 leader_election.cc:304] T 8873a0b31fda4a599ba21516205f1d08 P fe8f3cec39fb4964a4fccfd5baa4077b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b890fcdb46dc4597bd9991906433c391, fe8f3cec39fb4964a4fccfd5baa4077b; no voters:
I20260807 13:50:32.260553 26381 raft_consensus.cc:2804] T 8873a0b31fda4a599ba21516205f1d08 P fe8f3cec39fb4964a4fccfd5baa4077b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:32.261159 26381 raft_consensus.cc:697] T 8873a0b31fda4a599ba21516205f1d08 P fe8f3cec39fb4964a4fccfd5baa4077b [term 1 LEADER]: Becoming Leader. State: Replica: fe8f3cec39fb4964a4fccfd5baa4077b, State: Running, Role: LEADER
I20260807 13:50:32.261513 26381 consensus_queue.cc:237] T 8873a0b31fda4a599ba21516205f1d08 P fe8f3cec39fb4964a4fccfd5baa4077b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } }
I20260807 13:50:32.264251 24028 catalog_manager.cc:5697] T 8873a0b31fda4a599ba21516205f1d08 P fe8f3cec39fb4964a4fccfd5baa4077b reported cstate change: term changed from 0 to 1, leader changed from <none> to fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130). New cstate: current_term: 1 leader_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 } health_report { overall_health: UNKNOWN } } }
I20260807 13:50:32.543319 26582 consensus_queue.cc:1048] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d4866795004103a4b0243906fe4d60" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 46641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:32.550117 26582 consensus_queue.cc:1048] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d09f7af7d9d4d07bfb2114f45e9e8a4" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:50:32.685528 26616 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:32.685876 26616 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260807 13:50:32.697219 26381 consensus_queue.cc:1048] T 8873a0b31fda4a599ba21516205f1d08 P fe8f3cec39fb4964a4fccfd5baa4077b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1d858e0ace34c39a641ede1db85be11" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 46341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:32.699345 26614 consensus_queue.cc:1048] T 8873a0b31fda4a599ba21516205f1d08 P fe8f3cec39fb4964a4fccfd5baa4077b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:32.721011 26612 consensus_queue.cc:1048] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b890fcdb46dc4597bd9991906433c391" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 44189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:32.726600 26380 consensus_queue.cc:1048] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe8f3cec39fb4964a4fccfd5baa4077b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Using table 'rebalance_test_table_11'
INSERT report
rows total: 2000
time total: 311.703 ms
time per row: 0.155851 ms
I20260807 13:50:33.817607 24211 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:50:33.833518 24751 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:50:33.853099 24573 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:50:33.862701 25107 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:50:33.877568 24395 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:50:33.878405 24927 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:50:34.161955 24211 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:50:34.178395 24751 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:50:34.183138 24573 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:50:34.204188 25107 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:50:34.209235 24927 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:50:34.216233 24395 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:50:34.510609 24573 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:50:34.522089 24211 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:50:34.546918 24395 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:50:34.556092 25107 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:50:34.556180 24751 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:50:34.575237 24927 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:50:34.819908 24211 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:50:34.827525 24751 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:50:34.848937 25107 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:50:34.858510 24927 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:50:34.872265 24573 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:50:34.897877 24395 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:50:35.187129 24211 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:50:35.195027 24751 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:50:35.199362 24573 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:50:35.219645 25107 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:50:35.225865 24395 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:50:35.250281 24927 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:50:35.692315 24751 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:50:35.692646 24211 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:50:35.701191 24573 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:50:35.708989 24927 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:50:35.709144 25107 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:50:35.730208 24395 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
390327110c964252a3831f16b119c997 | 127.23.107.190:32953 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
raft_prepare_replacement_before_eviction | true | experimental,advanced | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.23.107.148:40545 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
4d09f7af7d9d4d07bfb2114f45e9e8a4 | 127.23.107.129:39973 | HEALTHY | /A | 9 | 0
b890fcdb46dc4597bd9991906433c391 | 127.23.107.132:44189 | HEALTHY | /B | 6 | 0
c8d4866795004103a4b0243906fe4d60 | 127.23.107.131:46641 | HEALTHY | /B | 4 | 0
d1d858e0ace34c39a641ede1db85be11 | 127.23.107.134:46341 | HEALTHY | /C | 9 | 0
d6d3ef3a235844cbbce1370e3aeb809f | 127.23.107.133:40131 | HEALTHY | /C | 5 | 0
fe8f3cec39fb4964a4fccfd5baa4077b | 127.23.107.130:35619 | HEALTHY | /A | 3 | 0
Tablet Server Location Summary
Location | Count
----------+---------
/C | 2
/A | 2
/B | 2
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
ipki_server_key_size | 768 | experimental | all 6 server(s) checked
local_ip_for_outbound_sockets | 127.23.107.129 | experimental | 127.23.107.129:39973
local_ip_for_outbound_sockets | 127.23.107.130 | experimental | 127.23.107.130:35619
local_ip_for_outbound_sockets | 127.23.107.131 | experimental | 127.23.107.131:46641
local_ip_for_outbound_sockets | 127.23.107.132 | experimental | 127.23.107.132:44189
local_ip_for_outbound_sockets | 127.23.107.133 | experimental | 127.23.107.133:40131
local_ip_for_outbound_sockets | 127.23.107.134 | experimental | 127.23.107.134:46341
never_fsync | true | unsafe,advanced | all 6 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 6 server(s) checked
raft_prepare_replacement_before_eviction | true | experimental,advanced | all 6 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 6 server(s) checked
server_dump_info_format | pb | hidden | all 6 server(s) checked
server_dump_info_path | /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.23.107.129:39973
server_dump_info_path | /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.23.107.130:35619
server_dump_info_path | /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.23.107.131:46641
server_dump_info_path | /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/info.pb | hidden | 127.23.107.132:44189
server_dump_info_path | /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/info.pb | hidden | 127.23.107.133:40131
server_dump_info_path | /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.LocationAwareRebalancingBasicTest.Basic.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/info.pb | hidden | 127.23.107.134:46341
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.23.107.148:40545 | all 6 server(s) checked
time_source | builtin | all 6 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 7 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-------------------------+----+---------+---------------+---------+------------+------------------+-------------
rebalance_test_table_0 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_1 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_10 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_11 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_2 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_3 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_4 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_5 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_6 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_7 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_8 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_9 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 18
First Quartile | 18
Median | 18
Third Quartile | 18
Maximum | 18
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 6
Tables | 12
Tablets | 36
Replicas | 108
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260807 13:50:35.834363 23982 log_verifier.cc:126] Checking tablet 044e19d6fe5142d991949fdc3f9c73d3
I20260807 13:50:35.877939 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 044e19d6fe5142d991949fdc3f9c73d3
I20260807 13:50:35.878125 23982 log_verifier.cc:126] Checking tablet 07b4c24b9efe45f2b6dd8ee4ac31579c
I20260807 13:50:35.918570 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 07b4c24b9efe45f2b6dd8ee4ac31579c
I20260807 13:50:35.918669 23982 log_verifier.cc:126] Checking tablet 14836b0dd1a94ebb9420571ad1a6b3a4
I20260807 13:50:35.958205 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 14836b0dd1a94ebb9420571ad1a6b3a4
I20260807 13:50:35.958307 23982 log_verifier.cc:126] Checking tablet 1ae0536d54d649cea511122997228e77
I20260807 13:50:36.009028 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 1ae0536d54d649cea511122997228e77
I20260807 13:50:36.009155 23982 log_verifier.cc:126] Checking tablet 2196f5d34beb485ea0b595dbe53c025e
I20260807 13:50:36.057780 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 2196f5d34beb485ea0b595dbe53c025e
I20260807 13:50:36.057938 23982 log_verifier.cc:126] Checking tablet 2df3f87f0d47451d9d8efaa9e4d3727d
I20260807 13:50:36.101527 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 2df3f87f0d47451d9d8efaa9e4d3727d
I20260807 13:50:36.101627 23982 log_verifier.cc:126] Checking tablet 2ec480f94022407f8915e21468a4ad30
I20260807 13:50:36.145025 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 2ec480f94022407f8915e21468a4ad30
I20260807 13:50:36.145223 23982 log_verifier.cc:126] Checking tablet 31045028ef8c4da7ab6f78c91ad09438
I20260807 13:50:36.189312 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 31045028ef8c4da7ab6f78c91ad09438
I20260807 13:50:36.189497 23982 log_verifier.cc:126] Checking tablet 31e4357937f74ae9819d42fc0cdcfb71
I20260807 13:50:36.232384 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 31e4357937f74ae9819d42fc0cdcfb71
I20260807 13:50:36.232525 23982 log_verifier.cc:126] Checking tablet 3e647f2b7d7a4177b4ada37eea66d8dd
I20260807 13:50:36.275681 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 3e647f2b7d7a4177b4ada37eea66d8dd
I20260807 13:50:36.275832 23982 log_verifier.cc:126] Checking tablet 51180d8d91ad4e7ca4deee717d7da8d9
I20260807 13:50:36.340476 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 51180d8d91ad4e7ca4deee717d7da8d9
I20260807 13:50:36.340672 23982 log_verifier.cc:126] Checking tablet 51b7e3d8d45545739a2bf1b23b3e2c3f
I20260807 13:50:36.490593 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 51b7e3d8d45545739a2bf1b23b3e2c3f
I20260807 13:50:36.490787 23982 log_verifier.cc:126] Checking tablet 532000bd82914bb99de0af06604aaaa6
I20260807 13:50:36.608464 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 532000bd82914bb99de0af06604aaaa6
I20260807 13:50:36.608584 23982 log_verifier.cc:126] Checking tablet 580c303c25314c439540b482893ec2f2
I20260807 13:50:36.691671 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 580c303c25314c439540b482893ec2f2
I20260807 13:50:36.691790 23982 log_verifier.cc:126] Checking tablet 5ab0e0a3aec1460192bbe02bf37342c1
I20260807 13:50:36.792578 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 5ab0e0a3aec1460192bbe02bf37342c1
I20260807 13:50:36.792699 23982 log_verifier.cc:126] Checking tablet 5bee0994b83f4c8486fa4fa7154787e4
I20260807 13:50:36.923520 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 5bee0994b83f4c8486fa4fa7154787e4
I20260807 13:50:36.923636 23982 log_verifier.cc:126] Checking tablet 5fc5d057ab2d4998b5c9c014802396e3
I20260807 13:50:37.046388 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 5fc5d057ab2d4998b5c9c014802396e3
I20260807 13:50:37.046567 23982 log_verifier.cc:126] Checking tablet 60a54e3cce4941c5bd4055e40aa1e4a3
I20260807 13:50:37.181444 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 60a54e3cce4941c5bd4055e40aa1e4a3
I20260807 13:50:37.181651 23982 log_verifier.cc:126] Checking tablet 60e313c07c85407fabb232ac871b2f16
I20260807 13:50:37.296806 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 60e313c07c85407fabb232ac871b2f16
I20260807 13:50:37.296931 23982 log_verifier.cc:126] Checking tablet 731a37a83f1b4971b0f4e7c44f7e3433
I20260807 13:50:37.399310 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 731a37a83f1b4971b0f4e7c44f7e3433
I20260807 13:50:37.399427 23982 log_verifier.cc:126] Checking tablet 756b98adc32f484180185464f67b20dc
I20260807 13:50:37.516374 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 756b98adc32f484180185464f67b20dc
I20260807 13:50:37.516636 23982 log_verifier.cc:126] Checking tablet 80944a99757c4e25a641c2cc177b30ae
I20260807 13:50:37.624545 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 80944a99757c4e25a641c2cc177b30ae
I20260807 13:50:37.624682 23982 log_verifier.cc:126] Checking tablet 8873a0b31fda4a599ba21516205f1d08
I20260807 13:50:37.736361 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 8873a0b31fda4a599ba21516205f1d08
I20260807 13:50:37.736518 23982 log_verifier.cc:126] Checking tablet 9263c12f7a8e4f0686a803069c498cd2
I20260807 13:50:37.854856 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet 9263c12f7a8e4f0686a803069c498cd2
I20260807 13:50:37.855057 23982 log_verifier.cc:126] Checking tablet a5cd607f20de44bfbff21eb6e8faedf5
I20260807 13:50:37.990551 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet a5cd607f20de44bfbff21eb6e8faedf5
I20260807 13:50:37.990689 23982 log_verifier.cc:126] Checking tablet b1a6f114c1fa4d1a98841a108196ba1e
I20260807 13:50:38.121963 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet b1a6f114c1fa4d1a98841a108196ba1e
I20260807 13:50:38.122154 23982 log_verifier.cc:126] Checking tablet c41e20fc995e483d900d559235f48b32
I20260807 13:50:38.256019 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet c41e20fc995e483d900d559235f48b32
I20260807 13:50:38.256207 23982 log_verifier.cc:126] Checking tablet c82b10494c3e4b63974a9c574543b1ab
I20260807 13:50:38.387938 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet c82b10494c3e4b63974a9c574543b1ab
I20260807 13:50:38.388109 23982 log_verifier.cc:126] Checking tablet d356987d307c4d9da967d8141d92c169
I20260807 13:50:38.559397 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet d356987d307c4d9da967d8141d92c169
I20260807 13:50:38.559602 23982 log_verifier.cc:126] Checking tablet d768072cffca4b74a9b790659eec7a24
I20260807 13:50:38.718391 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet d768072cffca4b74a9b790659eec7a24
I20260807 13:50:38.718600 23982 log_verifier.cc:126] Checking tablet d8b5a7dedd094b9888dd41572e1d6b74
I20260807 13:50:38.878541 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet d8b5a7dedd094b9888dd41572e1d6b74
I20260807 13:50:38.878736 23982 log_verifier.cc:126] Checking tablet eea163000bab4b00b94290f685600b8f
I20260807 13:50:38.977869 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet eea163000bab4b00b94290f685600b8f
I20260807 13:50:38.978068 23982 log_verifier.cc:126] Checking tablet f8a72430e5c948d09418a4ff39bd4db5
I20260807 13:50:39.113292 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet f8a72430e5c948d09418a4ff39bd4db5
I20260807 13:50:39.113564 23982 log_verifier.cc:126] Checking tablet faaa7f569d5e4da78d315dc7ace6e8fc
I20260807 13:50:39.260869 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet faaa7f569d5e4da78d315dc7ace6e8fc
I20260807 13:50:39.261128 23982 log_verifier.cc:126] Checking tablet fb4c905b1bc94ffaa04bf4b7b98d269e
I20260807 13:50:39.372773 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet fb4c905b1bc94ffaa04bf4b7b98d269e
I20260807 13:50:39.372889 23982 log_verifier.cc:126] Checking tablet ff57497da5e34a1988f65e6d07f8a115
I20260807 13:50:39.459532 23982 log_verifier.cc:177] Verified matching terms for 3 ops in tablet ff57497da5e34a1988f65e6d07f8a115
I20260807 13:50:39.495477 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 24127
I20260807 13:50:39.528671 24297 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:50:39.698997 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 24127
W20260807 13:50:39.739636 24513 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.107.129:39973 (error 108)
I20260807 13:50:39.739957 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 24310
W20260807 13:50:39.740049 24019 connection.cc:573] server connection from 127.23.107.129:52281 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 13:50:39.740736 24864 connection.cc:573] server connection from 127.23.107.129:38061 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 13:50:39.742939 24513 connection.cc:573] server connection from 127.23.107.129:37227 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 13:50:39.743418 24513 consensus_peers.cc:597] T 07b4c24b9efe45f2b6dd8ee4ac31579c P c8d4866795004103a4b0243906fe4d60 -> Peer 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973): Couldn't send request to peer 4d09f7af7d9d4d07bfb2114f45e9e8a4. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:50:39.747849 24480 generic_service.cc:196] Checking for leaks (request via RPC)
W20260807 13:50:39.779605 24864 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.107.129:39973: connect: Connection refused (error 111)
W20260807 13:50:39.781666 24864 consensus_peers.cc:597] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f -> Peer 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973): Couldn't send request to peer 4d09f7af7d9d4d07bfb2114f45e9e8a4. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:50:39.791296 24513 consensus_peers.cc:597] T 5ab0e0a3aec1460192bbe02bf37342c1 P c8d4866795004103a4b0243906fe4d60 -> Peer 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973): Couldn't send request to peer 4d09f7af7d9d4d07bfb2114f45e9e8a4. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:50:39.873438 24864 consensus_peers.cc:597] T fb4c905b1bc94ffaa04bf4b7b98d269e P d6d3ef3a235844cbbce1370e3aeb809f -> Peer 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973): Couldn't send request to peer 4d09f7af7d9d4d07bfb2114f45e9e8a4. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:50:39.882251 24864 consensus_peers.cc:597] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f -> Peer 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973): Couldn't send request to peer 4d09f7af7d9d4d07bfb2114f45e9e8a4. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:50:39.905828 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 24310
W20260807 13:50:39.937939 24513 consensus_peers.cc:597] T 2df3f87f0d47451d9d8efaa9e4d3727d P c8d4866795004103a4b0243906fe4d60 -> Peer 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973): Couldn't send request to peer 4d09f7af7d9d4d07bfb2114f45e9e8a4. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:50:39.940691 24688 connection.cc:573] server connection from 127.23.107.130:52345 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 13:50:39.940713 25048 connection.cc:573] server connection from 127.23.107.130:53299 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 13:50:39.941746 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 24490
I20260807 13:50:39.948033 24659 generic_service.cc:196] Checking for leaks (request via RPC)
W20260807 13:50:39.960397 25049 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.107.130:35619: connect: Connection refused (error 111)
W20260807 13:50:39.962363 25049 consensus_peers.cc:597] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11 -> Peer fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619): Couldn't send request to peer fe8f3cec39fb4964a4fccfd5baa4077b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:35619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:50:39.962556 25049 consensus_peers.cc:597] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11 -> Peer fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619): Couldn't send request to peer fe8f3cec39fb4964a4fccfd5baa4077b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:35619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:50:39.989862 24864 consensus_peers.cc:597] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f -> Peer 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973): Couldn't send request to peer 4d09f7af7d9d4d07bfb2114f45e9e8a4. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:50:39.999343 24692 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.107.130:35619: connect: Connection refused (error 111)
W20260807 13:50:40.001219 24692 consensus_peers.cc:597] T 756b98adc32f484180185464f67b20dc P b890fcdb46dc4597bd9991906433c391 -> Peer fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619): Couldn't send request to peer fe8f3cec39fb4964a4fccfd5baa4077b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:35619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:50:40.019351 24692 consensus_peers.cc:597] T 9263c12f7a8e4f0686a803069c498cd2 P b890fcdb46dc4597bd9991906433c391 -> Peer fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619): Couldn't send request to peer fe8f3cec39fb4964a4fccfd5baa4077b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:35619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:50:40.047403 24864 consensus_peers.cc:597] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f -> Peer 4d09f7af7d9d4d07bfb2114f45e9e8a4 (127.23.107.129:39973): Couldn't send request to peer 4d09f7af7d9d4d07bfb2114f45e9e8a4. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:50:40.055491 25049 consensus_peers.cc:597] T 2196f5d34beb485ea0b595dbe53c025e P d1d858e0ace34c39a641ede1db85be11 -> Peer fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619): Couldn't send request to peer fe8f3cec39fb4964a4fccfd5baa4077b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:35619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:50:40.089531 24692 consensus_peers.cc:597] T c41e20fc995e483d900d559235f48b32 P b890fcdb46dc4597bd9991906433c391 -> Peer fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619): Couldn't send request to peer fe8f3cec39fb4964a4fccfd5baa4077b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:35619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:50:40.112191 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 24490
W20260807 13:50:40.124747 25049 consensus_peers.cc:597] T 1ae0536d54d649cea511122997228e77 P d1d858e0ace34c39a641ede1db85be11 -> Peer fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619): Couldn't send request to peer fe8f3cec39fb4964a4fccfd5baa4077b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:35619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:50:40.150120 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 24669
I20260807 13:50:40.157246 24830 generic_service.cc:196] Checking for leaks (request via RPC)
W20260807 13:50:40.226331 24863 consensus_peers.cc:597] T 2ec480f94022407f8915e21468a4ad30 P d6d3ef3a235844cbbce1370e3aeb809f -> Peer c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641): Couldn't send request to peer c8d4866795004103a4b0243906fe4d60. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:46641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:50:40.230765 25049 consensus_peers.cc:597] T 60a54e3cce4941c5bd4055e40aa1e4a3 P d1d858e0ace34c39a641ede1db85be11 -> Peer fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619): Couldn't send request to peer fe8f3cec39fb4964a4fccfd5baa4077b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:35619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:50:40.231669 24863 consensus_peers.cc:597] T 80944a99757c4e25a641c2cc177b30ae P d6d3ef3a235844cbbce1370e3aeb809f -> Peer c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641): Couldn't send request to peer c8d4866795004103a4b0243906fe4d60. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:46641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:50:40.242973 24863 consensus_peers.cc:597] T eea163000bab4b00b94290f685600b8f P d6d3ef3a235844cbbce1370e3aeb809f -> Peer c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641): Couldn't send request to peer c8d4866795004103a4b0243906fe4d60. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:46641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:50:40.248761 25049 consensus_peers.cc:597] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11 -> Peer fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619): Couldn't send request to peer fe8f3cec39fb4964a4fccfd5baa4077b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:35619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:50:40.249878 25049 consensus_peers.cc:597] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11 -> Peer fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619): Couldn't send request to peer fe8f3cec39fb4964a4fccfd5baa4077b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:35619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:50:40.310981 24863 consensus_peers.cc:597] T 5bee0994b83f4c8486fa4fa7154787e4 P d6d3ef3a235844cbbce1370e3aeb809f -> Peer c8d4866795004103a4b0243906fe4d60 (127.23.107.131:46641): Couldn't send request to peer c8d4866795004103a4b0243906fe4d60. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:46641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:50:40.314312 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 24669
W20260807 13:50:40.351398 25047 connection.cc:573] client connection to 127.23.107.132:44189 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 13:50:40.351873 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 24841
W20260807 13:50:40.352645 25047 consensus_peers.cc:597] T 580c303c25314c439540b482893ec2f2 P d1d858e0ace34c39a641ede1db85be11 -> Peer b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189): Couldn't send request to peer b890fcdb46dc4597bd9991906433c391. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:44189: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:50:40.352806 25047 consensus_peers.cc:597] T c82b10494c3e4b63974a9c574543b1ab P d1d858e0ace34c39a641ede1db85be11 -> Peer b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189): Couldn't send request to peer b890fcdb46dc4597bd9991906433c391. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:44189: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:50:40.352912 25047 consensus_peers.cc:597] T 51180d8d91ad4e7ca4deee717d7da8d9 P d1d858e0ace34c39a641ede1db85be11 -> Peer b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189): Couldn't send request to peer b890fcdb46dc4597bd9991906433c391. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:44189: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:50:40.353017 25047 consensus_peers.cc:597] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11 -> Peer b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189): Couldn't send request to peer b890fcdb46dc4597bd9991906433c391. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:44189: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:50:40.361964 25009 generic_service.cc:196] Checking for leaks (request via RPC)
W20260807 13:50:40.376570 25049 consensus_peers.cc:597] T 31e4357937f74ae9819d42fc0cdcfb71 P d1d858e0ace34c39a641ede1db85be11 -> Peer fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619): Couldn't send request to peer fe8f3cec39fb4964a4fccfd5baa4077b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:35619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:50:40.427495 25049 consensus_peers.cc:597] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11 -> Peer fe8f3cec39fb4964a4fccfd5baa4077b (127.23.107.130:35619): Couldn't send request to peer fe8f3cec39fb4964a4fccfd5baa4077b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:35619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:50:40.477591 25047 consensus_peers.cc:597] T a5cd607f20de44bfbff21eb6e8faedf5 P d1d858e0ace34c39a641ede1db85be11 -> Peer b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189): Couldn't send request to peer b890fcdb46dc4597bd9991906433c391. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:44189: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:50:40.489873 25047 consensus_peers.cc:597] T f8a72430e5c948d09418a4ff39bd4db5 P d1d858e0ace34c39a641ede1db85be11 -> Peer b890fcdb46dc4597bd9991906433c391 (127.23.107.132:44189): Couldn't send request to peer b890fcdb46dc4597bd9991906433c391. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:44189: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:50:40.515808 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 24841
I20260807 13:50:40.551541 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 25020
I20260807 13:50:40.558764 25191 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:50:40.717687 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 25020
I20260807 13:50:40.754740 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 23997
I20260807 13:50:40.756102 24084 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:50:40.926290 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 23997
2026-08-07T13:50:40Z chronyd exiting
[ OK ] LocationAwareRebalancingBasicTest.Basic (30814 ms)
[----------] 1 test from LocationAwareRebalancingBasicTest (30814 ms total)
[----------] 1 test from RebalanceStartCriteriaTest
[ RUN ] RebalanceStartCriteriaTest.UnknownIgnoredTServer/0
I20260807 13:50:41.122126 23982 ts_itest-base.cc:115] Starting cluster with:
I20260807 13:50:41.122216 23982 ts_itest-base.cc:116] --------------
I20260807 13:50:41.122273 23982 ts_itest-base.cc:117] 5 tablet servers
I20260807 13:50:41.122344 23982 ts_itest-base.cc:118] 3 replicas per TS
I20260807 13:50:41.122402 23982 ts_itest-base.cc:119] --------------
2026-08-07T13:50:41Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-07T13:50:41Z Disabled control of system clock
I20260807 13:50:41.175249 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.107.190:37631
--webserver_interface=127.23.107.190
--webserver_port=0
--builtin_ntp_servers=127.23.107.148:37255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.107.190:37631
--raft_prepare_replacement_before_eviction=false
--enable_range_replica_placement=false with env {}
W20260807 13:50:41.547099 27112 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:41.547520 27112 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:50:41.547675 27112 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:50:41.556355 27112 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:50:41.556531 27112 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 13:50:41.556664 27112 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:50:41.556768 27112 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 13:50:41.556888 27112 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260807 13:50:41.567361 27112 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:37255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal
--enable_range_replica_placement=false
--ipki_ca_key_size=768
--master_addresses=127.23.107.190:37631
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.107.190:37631
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.23.107.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:50:41.569172 27112 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:50:41.571230 27112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:50:41.580534 27117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:41.580716 27118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:41.581494 27123 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:50:41.582413 27112 server_base.cc:1061] running on GCE node
I20260807 13:50:41.583315 27112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:50:41.584823 27112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:50:41.586097 27112 hybrid_clock.cc:648] HybridClock initialized: now 1786110641586026 us; error 47 us; skew 500 ppm
I20260807 13:50:41.586459 27112 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:50:41.588706 27112 webserver.cc:533] Webserver started at http://127.23.107.190:40565/ using document root <none> and password file <none>
I20260807 13:50:41.589599 27112 fs_manager.cc:362] Metadata directory not provided
I20260807 13:50:41.589748 27112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:50:41.590101 27112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:50:41.592875 27112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "241f3738155a4a0f9c925e6dc6dff228"
format_stamp: "Formatted at 2026-08-07 13:50:41 on dist-test-slave-bw88"
I20260807 13:50:41.593737 27112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "241f3738155a4a0f9c925e6dc6dff228"
format_stamp: "Formatted at 2026-08-07 13:50:41 on dist-test-slave-bw88"
I20260807 13:50:41.599339 27112 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260807 13:50:41.603068 27131 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:41.604493 27112 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 13:50:41.604686 27112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal
uuid: "241f3738155a4a0f9c925e6dc6dff228"
format_stamp: "Formatted at 2026-08-07 13:50:41 on dist-test-slave-bw88"
I20260807 13:50:41.604892 27112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:50:41.621847 27112 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:50:41.622748 27112 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:50:41.623067 27112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:50:41.643726 27112 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.190:37631
I20260807 13:50:41.643750 27203 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.190:37631 every 8 connection(s)
I20260807 13:50:41.645463 27112 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260807 13:50:41.646513 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 27112
I20260807 13:50:41.646798 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260807 13:50:41.650744 27204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:41.663725 27204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 241f3738155a4a0f9c925e6dc6dff228: Bootstrap starting.
I20260807 13:50:41.668221 27204 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 241f3738155a4a0f9c925e6dc6dff228: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:41.669317 27204 log.cc:826] T 00000000000000000000000000000000 P 241f3738155a4a0f9c925e6dc6dff228: Log is configured to *not* fsync() on all Append() calls
I20260807 13:50:41.672585 27204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 241f3738155a4a0f9c925e6dc6dff228: No bootstrap required, opened a new log
I20260807 13:50:41.678360 27204 raft_consensus.cc:359] T 00000000000000000000000000000000 P 241f3738155a4a0f9c925e6dc6dff228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "241f3738155a4a0f9c925e6dc6dff228" member_type: VOTER last_known_addr { host: "127.23.107.190" port: 37631 } }
I20260807 13:50:41.678761 27204 raft_consensus.cc:385] T 00000000000000000000000000000000 P 241f3738155a4a0f9c925e6dc6dff228 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:41.678893 27204 raft_consensus.cc:740] T 00000000000000000000000000000000 P 241f3738155a4a0f9c925e6dc6dff228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 241f3738155a4a0f9c925e6dc6dff228, State: Initialized, Role: FOLLOWER
I20260807 13:50:41.679590 27204 consensus_queue.cc:260] T 00000000000000000000000000000000 P 241f3738155a4a0f9c925e6dc6dff228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "241f3738155a4a0f9c925e6dc6dff228" member_type: VOTER last_known_addr { host: "127.23.107.190" port: 37631 } }
I20260807 13:50:41.679826 27204 raft_consensus.cc:399] T 00000000000000000000000000000000 P 241f3738155a4a0f9c925e6dc6dff228 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 13:50:41.679977 27204 raft_consensus.cc:493] T 00000000000000000000000000000000 P 241f3738155a4a0f9c925e6dc6dff228 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 13:50:41.680171 27204 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 241f3738155a4a0f9c925e6dc6dff228 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:41.682731 27204 raft_consensus.cc:515] T 00000000000000000000000000000000 P 241f3738155a4a0f9c925e6dc6dff228 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "241f3738155a4a0f9c925e6dc6dff228" member_type: VOTER last_known_addr { host: "127.23.107.190" port: 37631 } }
I20260807 13:50:41.683267 27204 leader_election.cc:304] T 00000000000000000000000000000000 P 241f3738155a4a0f9c925e6dc6dff228 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 241f3738155a4a0f9c925e6dc6dff228; no voters:
I20260807 13:50:41.683924 27204 leader_election.cc:290] T 00000000000000000000000000000000 P 241f3738155a4a0f9c925e6dc6dff228 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 13:50:41.684098 27210 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 241f3738155a4a0f9c925e6dc6dff228 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:41.684854 27210 raft_consensus.cc:697] T 00000000000000000000000000000000 P 241f3738155a4a0f9c925e6dc6dff228 [term 1 LEADER]: Becoming Leader. State: Replica: 241f3738155a4a0f9c925e6dc6dff228, State: Running, Role: LEADER
I20260807 13:50:41.685518 27210 consensus_queue.cc:237] T 00000000000000000000000000000000 P 241f3738155a4a0f9c925e6dc6dff228 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "241f3738155a4a0f9c925e6dc6dff228" member_type: VOTER last_known_addr { host: "127.23.107.190" port: 37631 } }
I20260807 13:50:41.686410 27204 sys_catalog.cc:565] T 00000000000000000000000000000000 P 241f3738155a4a0f9c925e6dc6dff228 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 13:50:41.688845 27211 sys_catalog.cc:455] T 00000000000000000000000000000000 P 241f3738155a4a0f9c925e6dc6dff228 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "241f3738155a4a0f9c925e6dc6dff228" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "241f3738155a4a0f9c925e6dc6dff228" member_type: VOTER last_known_addr { host: "127.23.107.190" port: 37631 } } }
I20260807 13:50:41.689301 27212 sys_catalog.cc:455] T 00000000000000000000000000000000 P 241f3738155a4a0f9c925e6dc6dff228 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 241f3738155a4a0f9c925e6dc6dff228. Latest consensus state: current_term: 1 leader_uuid: "241f3738155a4a0f9c925e6dc6dff228" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "241f3738155a4a0f9c925e6dc6dff228" member_type: VOTER last_known_addr { host: "127.23.107.190" port: 37631 } } }
I20260807 13:50:41.689756 27212 sys_catalog.cc:458] T 00000000000000000000000000000000 P 241f3738155a4a0f9c925e6dc6dff228 [sys.catalog]: This master's current role is: LEADER
I20260807 13:50:41.691470 27211 sys_catalog.cc:458] T 00000000000000000000000000000000 P 241f3738155a4a0f9c925e6dc6dff228 [sys.catalog]: This master's current role is: LEADER
I20260807 13:50:41.694319 27219 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260807 13:50:41.700268 27219 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260807 13:50:41.709254 27219 catalog_manager.cc:1383] Generated new cluster ID: 183a957fdad54b8dbd99798d5a83f448
I20260807 13:50:41.709422 27219 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260807 13:50:41.727329 27219 catalog_manager.cc:1406] Generated new certificate authority record
I20260807 13:50:41.728820 27219 catalog_manager.cc:1540] Loading token signing keys...
I20260807 13:50:41.740114 27219 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 241f3738155a4a0f9c925e6dc6dff228: Generated new TSK 0
I20260807 13:50:41.740957 27219 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260807 13:50:41.757707 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.129:0
--local_ip_for_outbound_sockets=127.23.107.129
--webserver_interface=127.23.107.129
--webserver_port=0
--tserver_master_addrs=127.23.107.190:37631
--builtin_ntp_servers=127.23.107.148:37255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
W20260807 13:50:42.150981 27232 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:42.151491 27232 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:50:42.151697 27232 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:50:42.163388 27232 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:50:42.163553 27232 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:50:42.163746 27232 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.129
I20260807 13:50:42.174750 27232 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:37255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.23.107.129
--webserver_port=0
--tserver_master_addrs=127.23.107.190:37631
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.129
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:50:42.176648 27232 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:50:42.178867 27232 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:50:42.190241 27238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:42.190287 27242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:42.192075 27239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:50:42.193881 27232 server_base.cc:1061] running on GCE node
I20260807 13:50:42.194772 27232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:50:42.196010 27232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:50:42.197270 27232 hybrid_clock.cc:648] HybridClock initialized: now 1786110642197196 us; error 36 us; skew 500 ppm
I20260807 13:50:42.197701 27232 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:50:42.200369 27232 webserver.cc:533] Webserver started at http://127.23.107.129:39111/ using document root <none> and password file <none>
I20260807 13:50:42.201318 27232 fs_manager.cc:362] Metadata directory not provided
I20260807 13:50:42.201508 27232 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:50:42.201874 27232 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:50:42.204663 27232 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "d63ac7a0020845078a0d4e3b6ee24d13"
format_stamp: "Formatted at 2026-08-07 13:50:42 on dist-test-slave-bw88"
I20260807 13:50:42.205575 27232 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "d63ac7a0020845078a0d4e3b6ee24d13"
format_stamp: "Formatted at 2026-08-07 13:50:42 on dist-test-slave-bw88"
I20260807 13:50:42.211970 27232 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 13:50:42.216415 27255 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:42.218138 27232 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260807 13:50:42.218343 27232 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "d63ac7a0020845078a0d4e3b6ee24d13"
format_stamp: "Formatted at 2026-08-07 13:50:42 on dist-test-slave-bw88"
I20260807 13:50:42.218606 27232 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:50:42.242497 27232 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:50:42.243830 27232 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:50:42.244242 27232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:50:42.245759 27232 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:50:42.248621 27232 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:50:42.248754 27232 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:42.248903 27232 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:50:42.249010 27232 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:42.300877 27405 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.129:39631 every 8 connection(s)
I20260807 13:50:42.301292 27232 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.129:39631
I20260807 13:50:42.303675 27232 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260807 13:50:42.305116 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 27232
I20260807 13:50:42.305395 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260807 13:50:42.309875 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.130:0
--local_ip_for_outbound_sockets=127.23.107.130
--webserver_interface=127.23.107.130
--webserver_port=0
--tserver_master_addrs=127.23.107.190:37631
--builtin_ntp_servers=127.23.107.148:37255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260807 13:50:42.323674 27406 heartbeater.cc:344] Connected to a master server at 127.23.107.190:37631
I20260807 13:50:42.324163 27406 heartbeater.cc:461] Registering TS with master...
I20260807 13:50:42.325367 27406 heartbeater.cc:507] Master 127.23.107.190:37631 requested a full tablet report, sending...
I20260807 13:50:42.327975 27155 ts_manager.cc:194] Registered new tserver with Master: d63ac7a0020845078a0d4e3b6ee24d13 (127.23.107.129:39631)
I20260807 13:50:42.330526 27155 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.129:57451
W20260807 13:50:42.681577 27410 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:42.681923 27410 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:50:42.682006 27410 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:50:42.690685 27410 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:50:42.690797 27410 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:50:42.690920 27410 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.130
I20260807 13:50:42.702385 27410 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:37255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.23.107.130
--webserver_port=0
--tserver_master_addrs=127.23.107.190:37631
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.130
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:50:42.704056 27410 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:50:42.705991 27410 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:50:42.716274 27418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:42.716212 27420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:42.717041 27422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:50:42.718632 27410 server_base.cc:1061] running on GCE node
I20260807 13:50:42.719218 27410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:50:42.720187 27410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:50:42.721499 27410 hybrid_clock.cc:648] HybridClock initialized: now 1786110642721407 us; error 35 us; skew 500 ppm
I20260807 13:50:42.721810 27410 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:50:42.724011 27410 webserver.cc:533] Webserver started at http://127.23.107.130:38151/ using document root <none> and password file <none>
I20260807 13:50:42.724957 27410 fs_manager.cc:362] Metadata directory not provided
I20260807 13:50:42.725111 27410 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:50:42.725690 27410 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:50:42.728344 27410 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "5831d81101a9443ab79fc68c436daa29"
format_stamp: "Formatted at 2026-08-07 13:50:42 on dist-test-slave-bw88"
I20260807 13:50:42.729146 27410 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "5831d81101a9443ab79fc68c436daa29"
format_stamp: "Formatted at 2026-08-07 13:50:42 on dist-test-slave-bw88"
I20260807 13:50:42.734839 27410 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 13:50:42.738533 27431 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:42.739918 27410 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 13:50:42.740114 27410 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "5831d81101a9443ab79fc68c436daa29"
format_stamp: "Formatted at 2026-08-07 13:50:42 on dist-test-slave-bw88"
I20260807 13:50:42.740289 27410 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:50:42.765231 27410 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:50:42.766225 27410 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:50:42.766541 27410 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:50:42.767593 27410 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:50:42.769358 27410 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:50:42.769438 27410 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260807 13:50:42.769626 27410 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:50:42.769680 27410 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:42.806246 27410 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.130:39851
I20260807 13:50:42.806296 27578 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.130:39851 every 8 connection(s)
I20260807 13:50:42.807746 27410 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260807 13:50:42.808450 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 27410
I20260807 13:50:42.808682 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260807 13:50:42.812729 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.131:0
--local_ip_for_outbound_sockets=127.23.107.131
--webserver_interface=127.23.107.131
--webserver_port=0
--tserver_master_addrs=127.23.107.190:37631
--builtin_ntp_servers=127.23.107.148:37255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260807 13:50:42.822566 27579 heartbeater.cc:344] Connected to a master server at 127.23.107.190:37631
I20260807 13:50:42.822942 27579 heartbeater.cc:461] Registering TS with master...
I20260807 13:50:42.823747 27579 heartbeater.cc:507] Master 127.23.107.190:37631 requested a full tablet report, sending...
I20260807 13:50:42.825850 27155 ts_manager.cc:194] Registered new tserver with Master: 5831d81101a9443ab79fc68c436daa29 (127.23.107.130:39851)
I20260807 13:50:42.826678 27155 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.130:59003
W20260807 13:50:43.190415 27583 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:43.190770 27583 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:50:43.190924 27583 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:50:43.199971 27583 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:50:43.200078 27583 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:50:43.200271 27583 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.131
I20260807 13:50:43.210794 27583 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:37255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.23.107.131
--webserver_port=0
--tserver_master_addrs=127.23.107.190:37631
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.131
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:50:43.212607 27583 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:50:43.214649 27583 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:50:43.224901 27589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:43.224825 27588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:43.226100 27591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:50:43.226367 27583 server_base.cc:1061] running on GCE node
I20260807 13:50:43.227034 27583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:50:43.228047 27583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:50:43.229296 27583 hybrid_clock.cc:648] HybridClock initialized: now 1786110643229211 us; error 60 us; skew 500 ppm
I20260807 13:50:43.229668 27583 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:50:43.231987 27583 webserver.cc:533] Webserver started at http://127.23.107.131:36327/ using document root <none> and password file <none>
I20260807 13:50:43.232785 27583 fs_manager.cc:362] Metadata directory not provided
I20260807 13:50:43.232947 27583 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:50:43.233321 27583 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:50:43.235867 27583 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "2fee26c306ed4ce7a57cfb242fe1b782"
format_stamp: "Formatted at 2026-08-07 13:50:43 on dist-test-slave-bw88"
I20260807 13:50:43.236694 27583 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "2fee26c306ed4ce7a57cfb242fe1b782"
format_stamp: "Formatted at 2026-08-07 13:50:43 on dist-test-slave-bw88"
I20260807 13:50:43.242660 27583 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.006s sys 0.002s
I20260807 13:50:43.246321 27600 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:43.247720 27583 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 13:50:43.247933 27583 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "2fee26c306ed4ce7a57cfb242fe1b782"
format_stamp: "Formatted at 2026-08-07 13:50:43 on dist-test-slave-bw88"
I20260807 13:50:43.248152 27583 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:50:43.294529 27583 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:50:43.295477 27583 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:50:43.295807 27583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:50:43.296909 27583 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:50:43.298750 27583 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:50:43.298871 27583 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:43.299032 27583 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:50:43.299106 27583 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:43.333637 27406 heartbeater.cc:499] Master 127.23.107.190:37631 was elected leader, sending a full tablet report...
I20260807 13:50:43.336006 27583 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.131:39919
I20260807 13:50:43.336097 27735 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.131:39919 every 8 connection(s)
I20260807 13:50:43.337637 27583 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260807 13:50:43.338250 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 27583
I20260807 13:50:43.338450 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260807 13:50:43.341965 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.132:0
--local_ip_for_outbound_sockets=127.23.107.132
--webserver_interface=127.23.107.132
--webserver_port=0
--tserver_master_addrs=127.23.107.190:37631
--builtin_ntp_servers=127.23.107.148:37255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260807 13:50:43.352471 27736 heartbeater.cc:344] Connected to a master server at 127.23.107.190:37631
I20260807 13:50:43.352880 27736 heartbeater.cc:461] Registering TS with master...
I20260807 13:50:43.353988 27736 heartbeater.cc:507] Master 127.23.107.190:37631 requested a full tablet report, sending...
I20260807 13:50:43.355737 27155 ts_manager.cc:194] Registered new tserver with Master: 2fee26c306ed4ce7a57cfb242fe1b782 (127.23.107.131:39919)
I20260807 13:50:43.356586 27155 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.131:39647
W20260807 13:50:43.716864 27740 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:43.717201 27740 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:50:43.717371 27740 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:50:43.726097 27740 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:50:43.726207 27740 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:50:43.726398 27740 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.132
I20260807 13:50:43.736701 27740 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:37255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.23.107.132
--webserver_port=0
--tserver_master_addrs=127.23.107.190:37631
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.132
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:50:43.738511 27740 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:50:43.740476 27740 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:50:43.751391 27747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:43.751417 27748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:43.752132 27751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:50:43.752698 27740 server_base.cc:1061] running on GCE node
I20260807 13:50:43.753464 27740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:50:43.754484 27740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:50:43.755769 27740 hybrid_clock.cc:648] HybridClock initialized: now 1786110643755699 us; error 40 us; skew 500 ppm
I20260807 13:50:43.756207 27740 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:50:43.758656 27740 webserver.cc:533] Webserver started at http://127.23.107.132:44761/ using document root <none> and password file <none>
I20260807 13:50:43.759481 27740 fs_manager.cc:362] Metadata directory not provided
I20260807 13:50:43.759651 27740 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:50:43.760033 27740 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:50:43.762694 27740 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "659412822e5a422eae0b42858d37af00"
format_stamp: "Formatted at 2026-08-07 13:50:43 on dist-test-slave-bw88"
I20260807 13:50:43.763500 27740 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "659412822e5a422eae0b42858d37af00"
format_stamp: "Formatted at 2026-08-07 13:50:43 on dist-test-slave-bw88"
I20260807 13:50:43.769246 27740 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 13:50:43.772886 27758 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:43.774535 27740 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 13:50:43.774770 27740 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "659412822e5a422eae0b42858d37af00"
format_stamp: "Formatted at 2026-08-07 13:50:43 on dist-test-slave-bw88"
I20260807 13:50:43.775010 27740 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:50:43.797652 27740 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:50:43.798580 27740 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:50:43.798918 27740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:50:43.799968 27740 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:50:43.801868 27740 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:50:43.801988 27740 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:43.802138 27740 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:50:43.802212 27740 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:43.829500 27579 heartbeater.cc:499] Master 127.23.107.190:37631 was elected leader, sending a full tablet report...
I20260807 13:50:43.840929 27740 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.132:32819
I20260807 13:50:43.841022 27895 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.132:32819 every 8 connection(s)
I20260807 13:50:43.842562 27740 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20260807 13:50:43.847323 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 27740
I20260807 13:50:43.847576 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20260807 13:50:43.851748 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.133:0
--local_ip_for_outbound_sockets=127.23.107.133
--webserver_interface=127.23.107.133
--webserver_port=0
--tserver_master_addrs=127.23.107.190:37631
--builtin_ntp_servers=127.23.107.148:37255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260807 13:50:43.858007 27896 heartbeater.cc:344] Connected to a master server at 127.23.107.190:37631
I20260807 13:50:43.858436 27896 heartbeater.cc:461] Registering TS with master...
I20260807 13:50:43.859422 27896 heartbeater.cc:507] Master 127.23.107.190:37631 requested a full tablet report, sending...
I20260807 13:50:43.861109 27155 ts_manager.cc:194] Registered new tserver with Master: 659412822e5a422eae0b42858d37af00 (127.23.107.132:32819)
I20260807 13:50:43.861997 27155 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.132:34563
W20260807 13:50:44.223594 27901 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:44.223905 27901 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:50:44.223980 27901 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:50:44.232685 27901 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:50:44.232791 27901 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:50:44.232914 27901 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.133
I20260807 13:50:44.243120 27901 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:37255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.133:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.23.107.133
--webserver_port=0
--tserver_master_addrs=127.23.107.190:37631
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.133
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:50:44.244834 27901 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:50:44.246814 27901 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:50:44.256976 27910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:44.257140 27908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:44.257727 27912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:50:44.258906 27901 server_base.cc:1061] running on GCE node
I20260807 13:50:44.259469 27901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:50:44.260423 27901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:50:44.261678 27901 hybrid_clock.cc:648] HybridClock initialized: now 1786110644261590 us; error 43 us; skew 500 ppm
I20260807 13:50:44.262065 27901 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:50:44.264467 27901 webserver.cc:533] Webserver started at http://127.23.107.133:46855/ using document root <none> and password file <none>
I20260807 13:50:44.265328 27901 fs_manager.cc:362] Metadata directory not provided
I20260807 13:50:44.265568 27901 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:50:44.265976 27901 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:50:44.268694 27901 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/instance:
uuid: "4f6109e2e570482aa03470f082047a4e"
format_stamp: "Formatted at 2026-08-07 13:50:44 on dist-test-slave-bw88"
I20260807 13:50:44.269647 27901 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal/instance:
uuid: "4f6109e2e570482aa03470f082047a4e"
format_stamp: "Formatted at 2026-08-07 13:50:44 on dist-test-slave-bw88"
I20260807 13:50:44.275970 27901 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 13:50:44.279827 27920 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:44.281572 27901 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 13:50:44.281744 27901 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "4f6109e2e570482aa03470f082047a4e"
format_stamp: "Formatted at 2026-08-07 13:50:44 on dist-test-slave-bw88"
I20260807 13:50:44.281939 27901 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:50:44.305532 27901 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:50:44.306473 27901 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:50:44.306761 27901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:50:44.307896 27901 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:50:44.310014 27901 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:50:44.310104 27901 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:44.310214 27901 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:50:44.310304 27901 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:44.360034 27736 heartbeater.cc:499] Master 127.23.107.190:37631 was elected leader, sending a full tablet report...
I20260807 13:50:44.388497 27901 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.133:45223
I20260807 13:50:44.388620 28059 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.133:45223 every 8 connection(s)
I20260807 13:50:44.390621 27901 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20260807 13:50:44.397245 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 27901
I20260807 13:50:44.397508 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceStartCriteriaTest.UnknownIgnoredTServer_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal/instance
I20260807 13:50:44.410547 28060 heartbeater.cc:344] Connected to a master server at 127.23.107.190:37631
I20260807 13:50:44.410996 28060 heartbeater.cc:461] Registering TS with master...
I20260807 13:50:44.412128 28060 heartbeater.cc:507] Master 127.23.107.190:37631 requested a full tablet report, sending...
I20260807 13:50:44.414214 27155 ts_manager.cc:194] Registered new tserver with Master: 4f6109e2e570482aa03470f082047a4e (127.23.107.133:45223)
I20260807 13:50:44.415360 27155 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.133:42035
I20260807 13:50:44.415498 23982 external_mini_cluster.cc:955] 5 TS(s) registered with all masters
I20260807 13:50:44.439366 27155 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33062:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20260807 13:50:44.491350 27816 tablet_service.cc:1511] Processing CreateTablet for tablet c6364bd5699c44099af2c39213513215 (DEFAULT_TABLE table=TestTable [id=c2a8d14c2aa44794b48e28fd91a84b61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:44.493216 27816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6364bd5699c44099af2c39213513215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:44.495601 27495 tablet_service.cc:1511] Processing CreateTablet for tablet c6364bd5699c44099af2c39213513215 (DEFAULT_TABLE table=TestTable [id=c2a8d14c2aa44794b48e28fd91a84b61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:44.497825 27495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6364bd5699c44099af2c39213513215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:44.501713 27657 tablet_service.cc:1511] Processing CreateTablet for tablet c6364bd5699c44099af2c39213513215 (DEFAULT_TABLE table=TestTable [id=c2a8d14c2aa44794b48e28fd91a84b61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:44.503940 27657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6364bd5699c44099af2c39213513215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:44.508867 28086 tablet_bootstrap.cc:492] T c6364bd5699c44099af2c39213513215 P 659412822e5a422eae0b42858d37af00: Bootstrap starting.
I20260807 13:50:44.515254 28086 tablet_bootstrap.cc:654] T c6364bd5699c44099af2c39213513215 P 659412822e5a422eae0b42858d37af00: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:44.518899 28086 log.cc:826] T c6364bd5699c44099af2c39213513215 P 659412822e5a422eae0b42858d37af00: Log is configured to *not* fsync() on all Append() calls
I20260807 13:50:44.520964 28087 tablet_bootstrap.cc:492] T c6364bd5699c44099af2c39213513215 P 5831d81101a9443ab79fc68c436daa29: Bootstrap starting.
I20260807 13:50:44.526607 28089 tablet_bootstrap.cc:492] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782: Bootstrap starting.
I20260807 13:50:44.526789 28086 tablet_bootstrap.cc:492] T c6364bd5699c44099af2c39213513215 P 659412822e5a422eae0b42858d37af00: No bootstrap required, opened a new log
I20260807 13:50:44.527304 28086 ts_tablet_manager.cc:1403] T c6364bd5699c44099af2c39213513215 P 659412822e5a422eae0b42858d37af00: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.007s
I20260807 13:50:44.528565 28087 tablet_bootstrap.cc:654] T c6364bd5699c44099af2c39213513215 P 5831d81101a9443ab79fc68c436daa29: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:44.530907 28089 tablet_bootstrap.cc:654] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:44.531193 28087 log.cc:826] T c6364bd5699c44099af2c39213513215 P 5831d81101a9443ab79fc68c436daa29: Log is configured to *not* fsync() on all Append() calls
I20260807 13:50:44.532944 28089 log.cc:826] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782: Log is configured to *not* fsync() on all Append() calls
I20260807 13:50:44.536938 28089 tablet_bootstrap.cc:492] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782: No bootstrap required, opened a new log
I20260807 13:50:44.537601 28089 ts_tablet_manager.cc:1403] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782: Time spent bootstrapping tablet: real 0.011s user 0.010s sys 0.000s
I20260807 13:50:44.540477 28086 raft_consensus.cc:359] T c6364bd5699c44099af2c39213513215 P 659412822e5a422eae0b42858d37af00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659412822e5a422eae0b42858d37af00" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 32819 } } peers { permanent_uuid: "5831d81101a9443ab79fc68c436daa29" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 39851 } } peers { permanent_uuid: "2fee26c306ed4ce7a57cfb242fe1b782" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 39919 } }
I20260807 13:50:44.541107 28086 raft_consensus.cc:385] T c6364bd5699c44099af2c39213513215 P 659412822e5a422eae0b42858d37af00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:44.541312 28086 raft_consensus.cc:740] T c6364bd5699c44099af2c39213513215 P 659412822e5a422eae0b42858d37af00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 659412822e5a422eae0b42858d37af00, State: Initialized, Role: FOLLOWER
I20260807 13:50:44.541751 28087 tablet_bootstrap.cc:492] T c6364bd5699c44099af2c39213513215 P 5831d81101a9443ab79fc68c436daa29: No bootstrap required, opened a new log
I20260807 13:50:44.542284 28087 ts_tablet_manager.cc:1403] T c6364bd5699c44099af2c39213513215 P 5831d81101a9443ab79fc68c436daa29: Time spent bootstrapping tablet: real 0.022s user 0.009s sys 0.010s
I20260807 13:50:44.542459 28086 consensus_queue.cc:260] T c6364bd5699c44099af2c39213513215 P 659412822e5a422eae0b42858d37af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659412822e5a422eae0b42858d37af00" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 32819 } } peers { permanent_uuid: "5831d81101a9443ab79fc68c436daa29" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 39851 } } peers { permanent_uuid: "2fee26c306ed4ce7a57cfb242fe1b782" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 39919 } }
I20260807 13:50:44.544799 27896 heartbeater.cc:499] Master 127.23.107.190:37631 was elected leader, sending a full tablet report...
I20260807 13:50:44.545756 28086 ts_tablet_manager.cc:1434] T c6364bd5699c44099af2c39213513215 P 659412822e5a422eae0b42858d37af00: Time spent starting tablet: real 0.018s user 0.014s sys 0.006s
I20260807 13:50:44.547855 28089 raft_consensus.cc:359] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659412822e5a422eae0b42858d37af00" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 32819 } } peers { permanent_uuid: "5831d81101a9443ab79fc68c436daa29" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 39851 } } peers { permanent_uuid: "2fee26c306ed4ce7a57cfb242fe1b782" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 39919 } }
I20260807 13:50:44.548391 28089 raft_consensus.cc:385] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:44.548657 28089 raft_consensus.cc:740] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fee26c306ed4ce7a57cfb242fe1b782, State: Initialized, Role: FOLLOWER
I20260807 13:50:44.549523 28089 consensus_queue.cc:260] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659412822e5a422eae0b42858d37af00" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 32819 } } peers { permanent_uuid: "5831d81101a9443ab79fc68c436daa29" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 39851 } } peers { permanent_uuid: "2fee26c306ed4ce7a57cfb242fe1b782" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 39919 } }
I20260807 13:50:44.552412 28089 ts_tablet_manager.cc:1434] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782: Time spent starting tablet: real 0.015s user 0.009s sys 0.004s
I20260807 13:50:44.556198 28087 raft_consensus.cc:359] T c6364bd5699c44099af2c39213513215 P 5831d81101a9443ab79fc68c436daa29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659412822e5a422eae0b42858d37af00" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 32819 } } peers { permanent_uuid: "5831d81101a9443ab79fc68c436daa29" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 39851 } } peers { permanent_uuid: "2fee26c306ed4ce7a57cfb242fe1b782" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 39919 } }
I20260807 13:50:44.556686 28087 raft_consensus.cc:385] T c6364bd5699c44099af2c39213513215 P 5831d81101a9443ab79fc68c436daa29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:44.556915 28087 raft_consensus.cc:740] T c6364bd5699c44099af2c39213513215 P 5831d81101a9443ab79fc68c436daa29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5831d81101a9443ab79fc68c436daa29, State: Initialized, Role: FOLLOWER
I20260807 13:50:44.557880 28087 consensus_queue.cc:260] T c6364bd5699c44099af2c39213513215 P 5831d81101a9443ab79fc68c436daa29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659412822e5a422eae0b42858d37af00" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 32819 } } peers { permanent_uuid: "5831d81101a9443ab79fc68c436daa29" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 39851 } } peers { permanent_uuid: "2fee26c306ed4ce7a57cfb242fe1b782" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 39919 } }
I20260807 13:50:44.560223 28087 ts_tablet_manager.cc:1434] T c6364bd5699c44099af2c39213513215 P 5831d81101a9443ab79fc68c436daa29: Time spent starting tablet: real 0.018s user 0.008s sys 0.007s
W20260807 13:50:44.561110 27581 tablet.cc:2406] T c6364bd5699c44099af2c39213513215 P 5831d81101a9443ab79fc68c436daa29: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 13:50:44.590742 27737 tablet.cc:2406] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 13:50:44.594897 27898 tablet.cc:2406] T c6364bd5699c44099af2c39213513215 P 659412822e5a422eae0b42858d37af00: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 13:50:44.596848 28093 raft_consensus.cc:493] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:44.597129 28093 raft_consensus.cc:515] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659412822e5a422eae0b42858d37af00" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 32819 } } peers { permanent_uuid: "5831d81101a9443ab79fc68c436daa29" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 39851 } } peers { permanent_uuid: "2fee26c306ed4ce7a57cfb242fe1b782" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 39919 } }
I20260807 13:50:44.599045 28093 leader_election.cc:290] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 659412822e5a422eae0b42858d37af00 (127.23.107.132:32819), 5831d81101a9443ab79fc68c436daa29 (127.23.107.130:39851)
I20260807 13:50:44.608755 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6364bd5699c44099af2c39213513215" candidate_uuid: "2fee26c306ed4ce7a57cfb242fe1b782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "659412822e5a422eae0b42858d37af00" is_pre_election: true
I20260807 13:50:44.609301 27841 raft_consensus.cc:2468] T c6364bd5699c44099af2c39213513215 P 659412822e5a422eae0b42858d37af00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fee26c306ed4ce7a57cfb242fe1b782 in term 0.
I20260807 13:50:44.609553 27521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6364bd5699c44099af2c39213513215" candidate_uuid: "2fee26c306ed4ce7a57cfb242fe1b782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5831d81101a9443ab79fc68c436daa29" is_pre_election: true
I20260807 13:50:44.610148 27521 raft_consensus.cc:2468] T c6364bd5699c44099af2c39213513215 P 5831d81101a9443ab79fc68c436daa29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fee26c306ed4ce7a57cfb242fe1b782 in term 0.
I20260807 13:50:44.610299 27606 leader_election.cc:304] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee26c306ed4ce7a57cfb242fe1b782, 659412822e5a422eae0b42858d37af00; no voters:
I20260807 13:50:44.610849 28093 raft_consensus.cc:2804] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:44.611019 28093 raft_consensus.cc:493] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:44.611140 28093 raft_consensus.cc:3060] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:44.613435 28093 raft_consensus.cc:515] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659412822e5a422eae0b42858d37af00" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 32819 } } peers { permanent_uuid: "5831d81101a9443ab79fc68c436daa29" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 39851 } } peers { permanent_uuid: "2fee26c306ed4ce7a57cfb242fe1b782" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 39919 } }
I20260807 13:50:44.614033 28093 leader_election.cc:290] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782 [CANDIDATE]: Term 1 election: Requested vote from peers 659412822e5a422eae0b42858d37af00 (127.23.107.132:32819), 5831d81101a9443ab79fc68c436daa29 (127.23.107.130:39851)
I20260807 13:50:44.614563 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6364bd5699c44099af2c39213513215" candidate_uuid: "2fee26c306ed4ce7a57cfb242fe1b782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "659412822e5a422eae0b42858d37af00"
I20260807 13:50:44.614576 27521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6364bd5699c44099af2c39213513215" candidate_uuid: "2fee26c306ed4ce7a57cfb242fe1b782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5831d81101a9443ab79fc68c436daa29"
I20260807 13:50:44.614765 27521 raft_consensus.cc:3060] T c6364bd5699c44099af2c39213513215 P 5831d81101a9443ab79fc68c436daa29 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:44.614784 27841 raft_consensus.cc:3060] T c6364bd5699c44099af2c39213513215 P 659412822e5a422eae0b42858d37af00 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:44.616991 27521 raft_consensus.cc:2468] T c6364bd5699c44099af2c39213513215 P 5831d81101a9443ab79fc68c436daa29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee26c306ed4ce7a57cfb242fe1b782 in term 1.
I20260807 13:50:44.617031 27841 raft_consensus.cc:2468] T c6364bd5699c44099af2c39213513215 P 659412822e5a422eae0b42858d37af00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fee26c306ed4ce7a57cfb242fe1b782 in term 1.
I20260807 13:50:44.617545 27601 leader_election.cc:304] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fee26c306ed4ce7a57cfb242fe1b782, 5831d81101a9443ab79fc68c436daa29; no voters:
I20260807 13:50:44.617897 28093 raft_consensus.cc:2804] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:44.618543 28093 raft_consensus.cc:697] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782 [term 1 LEADER]: Becoming Leader. State: Replica: 2fee26c306ed4ce7a57cfb242fe1b782, State: Running, Role: LEADER
I20260807 13:50:44.619057 28093 consensus_queue.cc:237] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659412822e5a422eae0b42858d37af00" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 32819 } } peers { permanent_uuid: "5831d81101a9443ab79fc68c436daa29" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 39851 } } peers { permanent_uuid: "2fee26c306ed4ce7a57cfb242fe1b782" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 39919 } }
I20260807 13:50:44.624881 27153 catalog_manager.cc:5697] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fee26c306ed4ce7a57cfb242fe1b782 (127.23.107.131). New cstate: current_term: 1 leader_uuid: "2fee26c306ed4ce7a57cfb242fe1b782" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659412822e5a422eae0b42858d37af00" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 32819 } } peers { permanent_uuid: "5831d81101a9443ab79fc68c436daa29" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 39851 } } peers { permanent_uuid: "2fee26c306ed4ce7a57cfb242fe1b782" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 39919 } } }
I20260807 13:50:44.667945 23982 external_mini_cluster.cc:955] 5 TS(s) registered with all masters
I20260807 13:50:44.670732 23982 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 5831d81101a9443ab79fc68c436daa29 to finish bootstrapping
I20260807 13:50:44.680414 23982 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 2fee26c306ed4ce7a57cfb242fe1b782 to finish bootstrapping
I20260807 13:50:44.688912 23982 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 659412822e5a422eae0b42858d37af00 to finish bootstrapping
I20260807 13:50:45.010133 28093 consensus_queue.cc:1048] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5831d81101a9443ab79fc68c436daa29" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:45.022130 28093 consensus_queue.cc:1048] T c6364bd5699c44099af2c39213513215 P 2fee26c306ed4ce7a57cfb242fe1b782 [LEADER]: Connected to new peer: Peer: permanent_uuid: "659412822e5a422eae0b42858d37af00" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:45.223433 27984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:50:45.228338 27657 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:50:45.240883 27816 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:50:45.246469 27495 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:50:45.253624 27316 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:50:45.418897 28060 heartbeater.cc:499] Master 127.23.107.190:37631 was elected leader, sending a full tablet report...
I20260807 13:50:45.433288 27984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:50:45.443847 27495 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:50:45.444787 27657 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:50:45.445659 27816 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:50:45.450112 27316 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:50:46.126899 27657 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:50:46.135841 27984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:50:46.135988 27316 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:50:46.136926 27495 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:50:46.138866 27816 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:50:46.314200 27657 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:50:46.331274 27316 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:50:46.331815 27495 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:50:46.331893 27816 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:50:46.333990 27984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:50:46.525655 27657 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:50:46.529132 27984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:50:46.537461 27495 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:50:46.537719 27816 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:50:46.537900 27316 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:50:46.720292 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 27232
I20260807 13:50:46.727684 27398 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:50:46.823688 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 27232
I20260807 13:50:46.853127 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 27410
I20260807 13:50:46.854362 27570 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:50:46.957023 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 27410
I20260807 13:50:46.981194 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 27583
I20260807 13:50:46.982393 27728 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:50:47.089875 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 27583
I20260807 13:50:47.117061 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 27740
I20260807 13:50:47.118266 27889 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:50:47.221628 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 27740
I20260807 13:50:47.249751 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 27901
I20260807 13:50:47.256796 28053 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:50:47.353828 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 27901
I20260807 13:50:47.378996 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 27112
I20260807 13:50:47.380321 27198 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:50:47.504365 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 27112
2026-08-07T13:50:47Z chronyd exiting
[ OK ] RebalanceStartCriteriaTest.UnknownIgnoredTServer/0 (6438 ms)
[----------] 1 test from RebalanceStartCriteriaTest (6438 ms total)
[----------] 1 test from RebalanceParamTest
[ RUN ] RebalanceParamTest.Rebalance/2
I20260807 13:50:47.560985 23982 ts_itest-base.cc:115] Starting cluster with:
I20260807 13:50:47.561076 23982 ts_itest-base.cc:116] --------------
I20260807 13:50:47.561118 23982 ts_itest-base.cc:117] 7 tablet servers
I20260807 13:50:47.561187 23982 ts_itest-base.cc:118] 2 replicas per TS
I20260807 13:50:47.561228 23982 ts_itest-base.cc:119] --------------
2026-08-07T13:50:47Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-07T13:50:47Z Disabled control of system clock
I20260807 13:50:47.626392 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.107.190:39563
--webserver_interface=127.23.107.190
--webserver_port=0
--builtin_ntp_servers=127.23.107.148:41209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.107.190:39563
--allow_unsafe_replication_factor
--enable_range_replica_placement=false
--raft_prepare_replacement_before_eviction=false
--tserver_unresponsive_timeout_ms=3000 with env {}
W20260807 13:50:48.005455 28351 flags.cc:432] Enabled unsafe flag: --allow_unsafe_replication_factor=true
W20260807 13:50:48.005848 28351 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:48.005949 28351 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:50:48.006068 28351 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:50:48.015132 28351 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:50:48.015292 28351 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 13:50:48.015381 28351 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:50:48.015473 28351 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 13:50:48.015539 28351 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260807 13:50:48.026122 28351 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:41209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal
--allow_unsafe_replication_factor=true
--enable_range_replica_placement=false
--ipki_ca_key_size=768
--master_addresses=127.23.107.190:39563
--tserver_unresponsive_timeout_ms=3000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.107.190:39563
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.23.107.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:50:48.027974 28351 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:50:48.030056 28351 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:50:48.038846 28358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:48.038870 28359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:48.040180 28362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:50:48.040786 28351 server_base.cc:1061] running on GCE node
I20260807 13:50:48.041926 28351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:50:48.043459 28351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:50:48.044674 28351 hybrid_clock.cc:648] HybridClock initialized: now 1786110648044628 us; error 41 us; skew 500 ppm
I20260807 13:50:48.045051 28351 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:50:48.047353 28351 webserver.cc:533] Webserver started at http://127.23.107.190:34049/ using document root <none> and password file <none>
I20260807 13:50:48.048171 28351 fs_manager.cc:362] Metadata directory not provided
I20260807 13:50:48.048296 28351 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:50:48.048722 28351 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:50:48.051323 28351 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "5b0e99a8c47049999ab224df5400bc2c"
format_stamp: "Formatted at 2026-08-07 13:50:48 on dist-test-slave-bw88"
I20260807 13:50:48.052199 28351 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "5b0e99a8c47049999ab224df5400bc2c"
format_stamp: "Formatted at 2026-08-07 13:50:48 on dist-test-slave-bw88"
I20260807 13:50:48.058022 28351 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.000s sys 0.007s
I20260807 13:50:48.061702 28372 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:48.063166 28351 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 13:50:48.063359 28351 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal
uuid: "5b0e99a8c47049999ab224df5400bc2c"
format_stamp: "Formatted at 2026-08-07 13:50:48 on dist-test-slave-bw88"
I20260807 13:50:48.063565 28351 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:50:48.080061 28351 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:50:48.081048 28351 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:50:48.081487 28351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:50:48.103952 28351 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.190:39563
I20260807 13:50:48.103973 28438 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.190:39563 every 8 connection(s)
I20260807 13:50:48.105672 28351 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260807 13:50:48.106248 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 28351
I20260807 13:50:48.106554 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260807 13:50:48.111104 28439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:48.121945 28439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b0e99a8c47049999ab224df5400bc2c: Bootstrap starting.
I20260807 13:50:48.125638 28439 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b0e99a8c47049999ab224df5400bc2c: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:48.126966 28439 log.cc:826] T 00000000000000000000000000000000 P 5b0e99a8c47049999ab224df5400bc2c: Log is configured to *not* fsync() on all Append() calls
I20260807 13:50:48.129999 28439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b0e99a8c47049999ab224df5400bc2c: No bootstrap required, opened a new log
I20260807 13:50:48.135787 28439 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5b0e99a8c47049999ab224df5400bc2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b0e99a8c47049999ab224df5400bc2c" member_type: VOTER last_known_addr { host: "127.23.107.190" port: 39563 } }
I20260807 13:50:48.136163 28439 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5b0e99a8c47049999ab224df5400bc2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:48.136303 28439 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5b0e99a8c47049999ab224df5400bc2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b0e99a8c47049999ab224df5400bc2c, State: Initialized, Role: FOLLOWER
I20260807 13:50:48.137019 28439 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b0e99a8c47049999ab224df5400bc2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b0e99a8c47049999ab224df5400bc2c" member_type: VOTER last_known_addr { host: "127.23.107.190" port: 39563 } }
I20260807 13:50:48.137250 28439 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5b0e99a8c47049999ab224df5400bc2c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 13:50:48.137429 28439 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5b0e99a8c47049999ab224df5400bc2c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 13:50:48.137610 28439 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5b0e99a8c47049999ab224df5400bc2c [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:48.139788 28439 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5b0e99a8c47049999ab224df5400bc2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b0e99a8c47049999ab224df5400bc2c" member_type: VOTER last_known_addr { host: "127.23.107.190" port: 39563 } }
I20260807 13:50:48.140319 28439 leader_election.cc:304] T 00000000000000000000000000000000 P 5b0e99a8c47049999ab224df5400bc2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5b0e99a8c47049999ab224df5400bc2c; no voters:
I20260807 13:50:48.141043 28439 leader_election.cc:290] T 00000000000000000000000000000000 P 5b0e99a8c47049999ab224df5400bc2c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 13:50:48.141211 28445 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5b0e99a8c47049999ab224df5400bc2c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:48.141970 28445 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5b0e99a8c47049999ab224df5400bc2c [term 1 LEADER]: Becoming Leader. State: Replica: 5b0e99a8c47049999ab224df5400bc2c, State: Running, Role: LEADER
I20260807 13:50:48.142656 28445 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b0e99a8c47049999ab224df5400bc2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b0e99a8c47049999ab224df5400bc2c" member_type: VOTER last_known_addr { host: "127.23.107.190" port: 39563 } }
I20260807 13:50:48.143913 28439 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5b0e99a8c47049999ab224df5400bc2c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 13:50:48.145851 28447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b0e99a8c47049999ab224df5400bc2c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5b0e99a8c47049999ab224df5400bc2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b0e99a8c47049999ab224df5400bc2c" member_type: VOTER last_known_addr { host: "127.23.107.190" port: 39563 } } }
I20260807 13:50:48.146194 28447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b0e99a8c47049999ab224df5400bc2c [sys.catalog]: This master's current role is: LEADER
I20260807 13:50:48.146917 28446 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b0e99a8c47049999ab224df5400bc2c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b0e99a8c47049999ab224df5400bc2c. Latest consensus state: current_term: 1 leader_uuid: "5b0e99a8c47049999ab224df5400bc2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b0e99a8c47049999ab224df5400bc2c" member_type: VOTER last_known_addr { host: "127.23.107.190" port: 39563 } } }
I20260807 13:50:48.147352 28446 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b0e99a8c47049999ab224df5400bc2c [sys.catalog]: This master's current role is: LEADER
I20260807 13:50:48.147890 28452 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260807 13:50:48.155341 28452 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260807 13:50:48.164955 28452 catalog_manager.cc:1383] Generated new cluster ID: 3cc111d5a85b4b9f95fa2c54c9dcbbd4
I20260807 13:50:48.165104 28452 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260807 13:50:48.177461 28452 catalog_manager.cc:1406] Generated new certificate authority record
I20260807 13:50:48.179219 28452 catalog_manager.cc:1540] Loading token signing keys...
I20260807 13:50:48.195952 28452 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5b0e99a8c47049999ab224df5400bc2c: Generated new TSK 0
I20260807 13:50:48.196892 28452 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260807 13:50:48.212621 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.129:0
--local_ip_for_outbound_sockets=127.23.107.129
--webserver_interface=127.23.107.129
--webserver_port=0
--tserver_master_addrs=127.23.107.190:39563
--builtin_ntp_servers=127.23.107.148:41209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
W20260807 13:50:48.588853 28467 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:48.589231 28467 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:50:48.589394 28467 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:50:48.597841 28467 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:50:48.597951 28467 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:50:48.598157 28467 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.129
I20260807 13:50:48.608651 28467 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:41209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.23.107.129
--webserver_port=0
--tserver_master_addrs=127.23.107.190:39563
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.129
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:50:48.610543 28467 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:50:48.612526 28467 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:50:48.622781 28473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:48.623168 28475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:48.624061 28479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:50:48.625232 28467 server_base.cc:1061] running on GCE node
I20260807 13:50:48.626004 28467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:50:48.627055 28467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:50:48.628288 28467 hybrid_clock.cc:648] HybridClock initialized: now 1786110648628216 us; error 38 us; skew 500 ppm
I20260807 13:50:48.628688 28467 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:50:48.631039 28467 webserver.cc:533] Webserver started at http://127.23.107.129:40039/ using document root <none> and password file <none>
I20260807 13:50:48.631858 28467 fs_manager.cc:362] Metadata directory not provided
I20260807 13:50:48.631966 28467 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:50:48.632294 28467 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:50:48.634941 28467 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "0ea2e5a5c2b0429985eb26f907033c9b"
format_stamp: "Formatted at 2026-08-07 13:50:48 on dist-test-slave-bw88"
I20260807 13:50:48.635735 28467 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "0ea2e5a5c2b0429985eb26f907033c9b"
format_stamp: "Formatted at 2026-08-07 13:50:48 on dist-test-slave-bw88"
I20260807 13:50:48.641795 28467 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.005s sys 0.002s
I20260807 13:50:48.645605 28488 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:48.647307 28467 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 13:50:48.647501 28467 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "0ea2e5a5c2b0429985eb26f907033c9b"
format_stamp: "Formatted at 2026-08-07 13:50:48 on dist-test-slave-bw88"
I20260807 13:50:48.647789 28467 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:50:48.674345 28467 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:50:48.675293 28467 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:50:48.675580 28467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:50:48.676597 28467 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:50:48.678395 28467 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:50:48.678478 28467 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:48.678571 28467 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:50:48.678615 28467 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:48.715118 28467 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.129:37223
I20260807 13:50:48.715231 28634 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.129:37223 every 8 connection(s)
I20260807 13:50:48.717229 28467 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260807 13:50:48.723397 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 28467
I20260807 13:50:48.723650 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260807 13:50:48.727711 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.130:0
--local_ip_for_outbound_sockets=127.23.107.130
--webserver_interface=127.23.107.130
--webserver_port=0
--tserver_master_addrs=127.23.107.190:39563
--builtin_ntp_servers=127.23.107.148:41209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260807 13:50:48.734308 28635 heartbeater.cc:344] Connected to a master server at 127.23.107.190:39563
I20260807 13:50:48.734783 28635 heartbeater.cc:461] Registering TS with master...
I20260807 13:50:48.735862 28635 heartbeater.cc:507] Master 127.23.107.190:39563 requested a full tablet report, sending...
I20260807 13:50:48.738484 28397 ts_manager.cc:194] Registered new tserver with Master: 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223)
I20260807 13:50:48.740164 28397 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.129:50815
W20260807 13:50:49.107121 28642 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:49.107419 28642 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:50:49.107575 28642 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:50:49.116601 28642 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:50:49.116724 28642 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:50:49.116925 28642 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.130
I20260807 13:50:49.127385 28642 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:41209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.23.107.130
--webserver_port=0
--tserver_master_addrs=127.23.107.190:39563
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.130
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:50:49.129478 28642 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:50:49.131476 28642 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:50:49.141770 28648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:49.141805 28649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:49.142179 28652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:50:49.143548 28642 server_base.cc:1061] running on GCE node
I20260807 13:50:49.144142 28642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:50:49.145212 28642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:50:49.146489 28642 hybrid_clock.cc:648] HybridClock initialized: now 1786110649146391 us; error 72 us; skew 500 ppm
I20260807 13:50:49.146811 28642 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:50:49.149140 28642 webserver.cc:533] Webserver started at http://127.23.107.130:38269/ using document root <none> and password file <none>
I20260807 13:50:49.150054 28642 fs_manager.cc:362] Metadata directory not provided
I20260807 13:50:49.150205 28642 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:50:49.150591 28642 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:50:49.153223 28642 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "9da72b03880d4414b034964abe86d4fe"
format_stamp: "Formatted at 2026-08-07 13:50:49 on dist-test-slave-bw88"
I20260807 13:50:49.154132 28642 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "9da72b03880d4414b034964abe86d4fe"
format_stamp: "Formatted at 2026-08-07 13:50:49 on dist-test-slave-bw88"
I20260807 13:50:49.159760 28642 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 13:50:49.163717 28659 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:49.165149 28642 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 13:50:49.165385 28642 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "9da72b03880d4414b034964abe86d4fe"
format_stamp: "Formatted at 2026-08-07 13:50:49 on dist-test-slave-bw88"
I20260807 13:50:49.165618 28642 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:50:49.185853 28642 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:50:49.186769 28642 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:50:49.187093 28642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:50:49.188126 28642 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:50:49.189945 28642 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:50:49.190055 28642 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:49.190213 28642 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:50:49.190295 28642 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:49.227560 28642 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.130:43223
I20260807 13:50:49.227624 28805 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.130:43223 every 8 connection(s)
I20260807 13:50:49.229261 28642 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260807 13:50:49.232961 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 28642
I20260807 13:50:49.233204 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260807 13:50:49.236467 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.131:0
--local_ip_for_outbound_sockets=127.23.107.131
--webserver_interface=127.23.107.131
--webserver_port=0
--tserver_master_addrs=127.23.107.190:39563
--builtin_ntp_servers=127.23.107.148:41209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260807 13:50:49.244494 28806 heartbeater.cc:344] Connected to a master server at 127.23.107.190:39563
I20260807 13:50:49.245007 28806 heartbeater.cc:461] Registering TS with master...
I20260807 13:50:49.245977 28806 heartbeater.cc:507] Master 127.23.107.190:39563 requested a full tablet report, sending...
I20260807 13:50:49.247673 28397 ts_manager.cc:194] Registered new tserver with Master: 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223)
I20260807 13:50:49.248814 28397 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.130:35891
W20260807 13:50:49.609580 28809 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:49.609920 28809 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:50:49.610010 28809 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:50:49.618666 28809 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:50:49.618795 28809 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:50:49.618928 28809 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.131
I20260807 13:50:49.629732 28809 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:41209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.23.107.131
--webserver_port=0
--tserver_master_addrs=127.23.107.190:39563
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.131
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:50:49.631455 28809 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:50:49.633395 28809 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:50:49.643922 28816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:49.643961 28817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:49.644850 28820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:50:49.645464 28809 server_base.cc:1061] running on GCE node
I20260807 13:50:49.646116 28809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:50:49.647153 28809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:50:49.648460 28809 hybrid_clock.cc:648] HybridClock initialized: now 1786110649648337 us; error 61 us; skew 500 ppm
I20260807 13:50:49.648814 28809 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:50:49.651384 28809 webserver.cc:533] Webserver started at http://127.23.107.131:33687/ using document root <none> and password file <none>
I20260807 13:50:49.652227 28809 fs_manager.cc:362] Metadata directory not provided
I20260807 13:50:49.652390 28809 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:50:49.652773 28809 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:50:49.655593 28809 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "c11aeb9ac7f04cceb63233785ce00503"
format_stamp: "Formatted at 2026-08-07 13:50:49 on dist-test-slave-bw88"
I20260807 13:50:49.656420 28809 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "c11aeb9ac7f04cceb63233785ce00503"
format_stamp: "Formatted at 2026-08-07 13:50:49 on dist-test-slave-bw88"
I20260807 13:50:49.662177 28809 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 13:50:49.665782 28829 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:49.667207 28809 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260807 13:50:49.667405 28809 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "c11aeb9ac7f04cceb63233785ce00503"
format_stamp: "Formatted at 2026-08-07 13:50:49 on dist-test-slave-bw88"
I20260807 13:50:49.667634 28809 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:50:49.687425 28809 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:50:49.688377 28809 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:50:49.688743 28809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:50:49.689798 28809 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:50:49.691557 28809 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:50:49.691671 28809 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:49.691834 28809 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:50:49.691910 28809 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:49.739817 28809 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.131:41571
I20260807 13:50:49.739877 28976 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.131:41571 every 8 connection(s)
I20260807 13:50:49.741683 28809 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260807 13:50:49.742489 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 28809
I20260807 13:50:49.742708 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260807 13:50:49.743482 28635 heartbeater.cc:499] Master 127.23.107.190:39563 was elected leader, sending a full tablet report...
I20260807 13:50:49.747145 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.132:0
--local_ip_for_outbound_sockets=127.23.107.132
--webserver_interface=127.23.107.132
--webserver_port=0
--tserver_master_addrs=127.23.107.190:39563
--builtin_ntp_servers=127.23.107.148:41209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260807 13:50:49.761961 28977 heartbeater.cc:344] Connected to a master server at 127.23.107.190:39563
I20260807 13:50:49.762373 28977 heartbeater.cc:461] Registering TS with master...
I20260807 13:50:49.763221 28977 heartbeater.cc:507] Master 127.23.107.190:39563 requested a full tablet report, sending...
I20260807 13:50:49.765002 28394 ts_manager.cc:194] Registered new tserver with Master: c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571)
I20260807 13:50:49.765983 28394 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.131:41959
W20260807 13:50:50.123751 28983 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:50.124099 28983 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:50:50.124176 28983 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:50:50.132813 28983 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:50:50.132921 28983 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:50:50.133056 28983 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.132
I20260807 13:50:50.143697 28983 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:41209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.23.107.132
--webserver_port=0
--tserver_master_addrs=127.23.107.190:39563
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.132
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:50:50.145440 28983 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:50:50.147430 28983 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:50:50.157835 28990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:50.157788 28995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:50.157881 28991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:50:50.159098 28983 server_base.cc:1061] running on GCE node
I20260807 13:50:50.159693 28983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:50:50.160718 28983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:50:50.161971 28983 hybrid_clock.cc:648] HybridClock initialized: now 1786110650161901 us; error 42 us; skew 500 ppm
I20260807 13:50:50.162283 28983 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:50:50.164620 28983 webserver.cc:533] Webserver started at http://127.23.107.132:38737/ using document root <none> and password file <none>
I20260807 13:50:50.165400 28983 fs_manager.cc:362] Metadata directory not provided
I20260807 13:50:50.165536 28983 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:50:50.165838 28983 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:50:50.168321 28983 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "c45d5217722649e6bdbccee30863591b"
format_stamp: "Formatted at 2026-08-07 13:50:50 on dist-test-slave-bw88"
I20260807 13:50:50.169057 28983 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "c45d5217722649e6bdbccee30863591b"
format_stamp: "Formatted at 2026-08-07 13:50:50 on dist-test-slave-bw88"
I20260807 13:50:50.175026 28983 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260807 13:50:50.178535 29004 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:50.179960 28983 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 13:50:50.180157 28983 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "c45d5217722649e6bdbccee30863591b"
format_stamp: "Formatted at 2026-08-07 13:50:50 on dist-test-slave-bw88"
I20260807 13:50:50.180368 28983 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:50:50.199560 28983 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:50:50.200491 28983 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:50:50.200834 28983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:50:50.201903 28983 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:50:50.203697 28983 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:50:50.203824 28983 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:50.203977 28983 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:50:50.204082 28983 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:50.240877 28983 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.132:34213
I20260807 13:50:50.240924 29143 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.132:34213 every 8 connection(s)
I20260807 13:50:50.242519 28983 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20260807 13:50:50.245183 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 28983
I20260807 13:50:50.245440 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20260807 13:50:50.249446 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.133:0
--local_ip_for_outbound_sockets=127.23.107.133
--webserver_interface=127.23.107.133
--webserver_port=0
--tserver_master_addrs=127.23.107.190:39563
--builtin_ntp_servers=127.23.107.148:41209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260807 13:50:50.251786 28806 heartbeater.cc:499] Master 127.23.107.190:39563 was elected leader, sending a full tablet report...
I20260807 13:50:50.258335 29145 heartbeater.cc:344] Connected to a master server at 127.23.107.190:39563
I20260807 13:50:50.258718 29145 heartbeater.cc:461] Registering TS with master...
I20260807 13:50:50.259529 29145 heartbeater.cc:507] Master 127.23.107.190:39563 requested a full tablet report, sending...
I20260807 13:50:50.261117 28394 ts_manager.cc:194] Registered new tserver with Master: c45d5217722649e6bdbccee30863591b (127.23.107.132:34213)
I20260807 13:50:50.262311 28394 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.132:49443
W20260807 13:50:50.646313 29148 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:50.646668 29148 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:50:50.646822 29148 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:50:50.655673 29148 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:50:50.655787 29148 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:50:50.655975 29148 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.133
I20260807 13:50:50.666700 29148 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:41209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.133:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.23.107.133
--webserver_port=0
--tserver_master_addrs=127.23.107.190:39563
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.133
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:50:50.668485 29148 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:50:50.670560 29148 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:50:50.680951 29155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:50.680900 29153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:50.681499 29157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:50:50.682286 29148 server_base.cc:1061] running on GCE node
I20260807 13:50:50.682992 29148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:50:50.684026 29148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:50:50.685304 29148 hybrid_clock.cc:648] HybridClock initialized: now 1786110650685230 us; error 44 us; skew 500 ppm
I20260807 13:50:50.685699 29148 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:50:50.688090 29148 webserver.cc:533] Webserver started at http://127.23.107.133:33709/ using document root <none> and password file <none>
I20260807 13:50:50.688894 29148 fs_manager.cc:362] Metadata directory not provided
I20260807 13:50:50.689056 29148 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:50:50.689529 29148 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:50:50.692062 29148 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/instance:
uuid: "ed5ae0647048435da282261048c04db2"
format_stamp: "Formatted at 2026-08-07 13:50:50 on dist-test-slave-bw88"
I20260807 13:50:50.692874 29148 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal/instance:
uuid: "ed5ae0647048435da282261048c04db2"
format_stamp: "Formatted at 2026-08-07 13:50:50 on dist-test-slave-bw88"
I20260807 13:50:50.698828 29148 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.006s sys 0.002s
I20260807 13:50:50.702732 29164 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:50.704331 29148 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 13:50:50.704578 29148 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "ed5ae0647048435da282261048c04db2"
format_stamp: "Formatted at 2026-08-07 13:50:50 on dist-test-slave-bw88"
I20260807 13:50:50.704838 29148 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:50:50.729454 29148 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:50:50.730559 29148 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:50:50.730870 29148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:50:50.731966 29148 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:50:50.733949 29148 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:50:50.734038 29148 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:50.734143 29148 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:50:50.734236 29148 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:50.768893 28977 heartbeater.cc:499] Master 127.23.107.190:39563 was elected leader, sending a full tablet report...
I20260807 13:50:50.776854 29148 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.133:34943
I20260807 13:50:50.776896 29308 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.133:34943 every 8 connection(s)
I20260807 13:50:50.778645 29148 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20260807 13:50:50.787040 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 29148
I20260807 13:50:50.787235 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal/instance
I20260807 13:50:50.790938 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.134:0
--local_ip_for_outbound_sockets=127.23.107.134
--webserver_interface=127.23.107.134
--webserver_port=0
--tserver_master_addrs=127.23.107.190:39563
--builtin_ntp_servers=127.23.107.148:41209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260807 13:50:50.797390 29309 heartbeater.cc:344] Connected to a master server at 127.23.107.190:39563
I20260807 13:50:50.797801 29309 heartbeater.cc:461] Registering TS with master...
I20260807 13:50:50.798643 29309 heartbeater.cc:507] Master 127.23.107.190:39563 requested a full tablet report, sending...
I20260807 13:50:50.800239 28394 ts_manager.cc:194] Registered new tserver with Master: ed5ae0647048435da282261048c04db2 (127.23.107.133:34943)
I20260807 13:50:50.801126 28394 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.133:50923
W20260807 13:50:51.168627 29314 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:51.168931 29314 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:50:51.169093 29314 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:50:51.177580 29314 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:50:51.177687 29314 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:50:51.177891 29314 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.134
I20260807 13:50:51.188032 29314 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:41209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.134:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--webserver_interface=127.23.107.134
--webserver_port=0
--tserver_master_addrs=127.23.107.190:39563
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.134
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:50:51.189818 29314 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:50:51.191730 29314 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:50:51.201582 29322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:51.201644 29321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:51.202881 29324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:50:51.203001 29314 server_base.cc:1061] running on GCE node
I20260807 13:50:51.203660 29314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:50:51.204528 29314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:50:51.205757 29314 hybrid_clock.cc:648] HybridClock initialized: now 1786110651205693 us; error 36 us; skew 500 ppm
I20260807 13:50:51.206032 29314 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:50:51.208079 29314 webserver.cc:533] Webserver started at http://127.23.107.134:41797/ using document root <none> and password file <none>
I20260807 13:50:51.208796 29314 fs_manager.cc:362] Metadata directory not provided
I20260807 13:50:51.208899 29314 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:50:51.209214 29314 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:50:51.212028 29314 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/instance:
uuid: "22b9a9a4b1bf44daa35fcecd47b8856a"
format_stamp: "Formatted at 2026-08-07 13:50:51 on dist-test-slave-bw88"
I20260807 13:50:51.212821 29314 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal/instance:
uuid: "22b9a9a4b1bf44daa35fcecd47b8856a"
format_stamp: "Formatted at 2026-08-07 13:50:51 on dist-test-slave-bw88"
I20260807 13:50:51.218303 29314 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 13:50:51.221815 29332 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:51.223197 29314 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260807 13:50:51.223376 29314 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal
uuid: "22b9a9a4b1bf44daa35fcecd47b8856a"
format_stamp: "Formatted at 2026-08-07 13:50:51 on dist-test-slave-bw88"
I20260807 13:50:51.223582 29314 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:50:51.237550 29314 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:50:51.238420 29314 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:50:51.238734 29314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:50:51.239760 29314 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:50:51.241634 29314 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:50:51.241743 29314 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:51.241890 29314 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:50:51.241963 29314 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:51.265491 29145 heartbeater.cc:499] Master 127.23.107.190:39563 was elected leader, sending a full tablet report...
I20260807 13:50:51.279628 29314 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.134:41561
I20260807 13:50:51.279666 29476 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.134:41561 every 8 connection(s)
I20260807 13:50:51.281137 29314 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/info.pb
I20260807 13:50:51.284232 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 29314
I20260807 13:50:51.284462 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal/instance
I20260807 13:50:51.288564 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.135:0
--local_ip_for_outbound_sockets=127.23.107.135
--webserver_interface=127.23.107.135
--webserver_port=0
--tserver_master_addrs=127.23.107.190:39563
--builtin_ntp_servers=127.23.107.148:41209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260807 13:50:51.297555 29477 heartbeater.cc:344] Connected to a master server at 127.23.107.190:39563
I20260807 13:50:51.298028 29477 heartbeater.cc:461] Registering TS with master...
I20260807 13:50:51.299146 29477 heartbeater.cc:507] Master 127.23.107.190:39563 requested a full tablet report, sending...
I20260807 13:50:51.301050 28394 ts_manager.cc:194] Registered new tserver with Master: 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134:41561)
I20260807 13:50:51.302291 28394 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.134:54027
W20260807 13:50:51.654768 29481 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:51.655110 29481 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:50:51.655185 29481 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:50:51.663724 29481 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:50:51.663830 29481 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:50:51.664014 29481 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.135
I20260807 13:50:51.674362 29481 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:41209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.135:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--webserver_interface=127.23.107.135
--webserver_port=0
--tserver_master_addrs=127.23.107.190:39563
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.135
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:50:51.676018 29481 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:50:51.677943 29481 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:50:51.690172 29486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:51.690559 29487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:50:51.691181 29489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:50:51.692353 29481 server_base.cc:1061] running on GCE node
I20260807 13:50:51.692919 29481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:50:51.694000 29481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:50:51.695214 29481 hybrid_clock.cc:648] HybridClock initialized: now 1786110651695131 us; error 57 us; skew 500 ppm
I20260807 13:50:51.695494 29481 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:50:51.697834 29481 webserver.cc:533] Webserver started at http://127.23.107.135:34967/ using document root <none> and password file <none>
I20260807 13:50:51.698618 29481 fs_manager.cc:362] Metadata directory not provided
I20260807 13:50:51.698730 29481 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:50:51.699030 29481 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:50:51.701634 29481 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data/instance:
uuid: "f634a7b061e64a7caf1cb02a4731dadc"
format_stamp: "Formatted at 2026-08-07 13:50:51 on dist-test-slave-bw88"
I20260807 13:50:51.702373 29481 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal/instance:
uuid: "f634a7b061e64a7caf1cb02a4731dadc"
format_stamp: "Formatted at 2026-08-07 13:50:51 on dist-test-slave-bw88"
I20260807 13:50:51.707938 29481 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 13:50:51.711604 29499 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:51.713096 29481 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 13:50:51.713294 29481 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal
uuid: "f634a7b061e64a7caf1cb02a4731dadc"
format_stamp: "Formatted at 2026-08-07 13:50:51 on dist-test-slave-bw88"
I20260807 13:50:51.713562 29481 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:50:51.729053 29481 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:50:51.730100 29481 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:50:51.730507 29481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:50:51.731880 29481 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:50:51.734230 29481 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:50:51.734341 29481 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:51.734467 29481 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:50:51.734632 29481 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:50:51.774412 29481 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.135:39559
I20260807 13:50:51.774473 29643 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.135:39559 every 8 connection(s)
I20260807 13:50:51.775985 29481 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data/info.pb
I20260807 13:50:51.783676 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 29481
I20260807 13:50:51.783886 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal/instance
I20260807 13:50:51.790779 29645 heartbeater.cc:344] Connected to a master server at 127.23.107.190:39563
I20260807 13:50:51.791163 29645 heartbeater.cc:461] Registering TS with master...
I20260807 13:50:51.791972 29645 heartbeater.cc:507] Master 127.23.107.190:39563 requested a full tablet report, sending...
I20260807 13:50:51.793558 28394 ts_manager.cc:194] Registered new tserver with Master: f634a7b061e64a7caf1cb02a4731dadc (127.23.107.135:39559)
I20260807 13:50:51.794417 28394 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.135:51345
I20260807 13:50:51.800400 23982 external_mini_cluster.cc:955] 7 TS(s) registered with all masters
I20260807 13:50:51.803812 29309 heartbeater.cc:499] Master 127.23.107.190:39563 was elected leader, sending a full tablet report...
I20260807 13:50:51.817939 28394 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49002:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20260807 13:50:51.849259 29058 tablet_service.cc:1511] Processing CreateTablet for tablet 024803a9deb6450dad724e4b614213e1 (DEFAULT_TABLE table=TestTable [id=57d567cd8ca342c4a0955d6e8a94da97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:51.849259 29392 tablet_service.cc:1511] Processing CreateTablet for tablet 024803a9deb6450dad724e4b614213e1 (DEFAULT_TABLE table=TestTable [id=57d567cd8ca342c4a0955d6e8a94da97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:51.851209 29058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 024803a9deb6450dad724e4b614213e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:51.851231 29392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 024803a9deb6450dad724e4b614213e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:51.865886 29666 tablet_bootstrap.cc:492] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a: Bootstrap starting.
I20260807 13:50:51.865891 29667 tablet_bootstrap.cc:492] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b: Bootstrap starting.
I20260807 13:50:51.870227 29666 tablet_bootstrap.cc:654] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:51.870227 29667 tablet_bootstrap.cc:654] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:51.871763 29666 log.cc:826] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a: Log is configured to *not* fsync() on all Append() calls
I20260807 13:50:51.871762 29667 log.cc:826] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b: Log is configured to *not* fsync() on all Append() calls
I20260807 13:50:51.875340 29667 tablet_bootstrap.cc:492] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b: No bootstrap required, opened a new log
I20260807 13:50:51.875864 29666 tablet_bootstrap.cc:492] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a: No bootstrap required, opened a new log
I20260807 13:50:51.875945 29667 ts_tablet_manager.cc:1403] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260807 13:50:51.876149 29666 ts_tablet_manager.cc:1403] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.003s
I20260807 13:50:51.883814 29667 raft_consensus.cc:359] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:50:51.883814 29666 raft_consensus.cc:359] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:50:51.884246 29666 raft_consensus.cc:385] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:51.884241 29667 raft_consensus.cc:385] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:51.884366 29666 raft_consensus.cc:740] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22b9a9a4b1bf44daa35fcecd47b8856a, State: Initialized, Role: FOLLOWER
I20260807 13:50:51.884363 29667 raft_consensus.cc:740] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45d5217722649e6bdbccee30863591b, State: Initialized, Role: FOLLOWER
I20260807 13:50:51.885133 29666 consensus_queue.cc:260] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:50:51.885134 29667 consensus_queue.cc:260] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:50:51.886425 29477 heartbeater.cc:499] Master 127.23.107.190:39563 was elected leader, sending a full tablet report...
I20260807 13:50:51.887156 29666 ts_tablet_manager.cc:1434] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a: Time spent starting tablet: real 0.011s user 0.011s sys 0.001s
I20260807 13:50:51.887157 29667 ts_tablet_manager.cc:1434] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260807 13:50:51.974751 29671 raft_consensus.cc:493] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:51.975117 29671 raft_consensus.cc:515] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:50:51.976922 29671 leader_election.cc:290] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c45d5217722649e6bdbccee30863591b (127.23.107.132:34213)
I20260807 13:50:51.984007 29081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024803a9deb6450dad724e4b614213e1" candidate_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45d5217722649e6bdbccee30863591b" is_pre_election: true
I20260807 13:50:51.984481 29081 raft_consensus.cc:2468] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22b9a9a4b1bf44daa35fcecd47b8856a in term 0.
I20260807 13:50:51.985172 29337 leader_election.cc:304] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 22b9a9a4b1bf44daa35fcecd47b8856a, c45d5217722649e6bdbccee30863591b; no voters:
I20260807 13:50:51.985611 29671 raft_consensus.cc:2804] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:51.985776 29671 raft_consensus.cc:493] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:51.985886 29671 raft_consensus.cc:3060] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:51.988093 29671 raft_consensus.cc:515] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:50:51.988617 29671 leader_election.cc:290] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [CANDIDATE]: Term 1 election: Requested vote from peers c45d5217722649e6bdbccee30863591b (127.23.107.132:34213)
I20260807 13:50:51.989209 29081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024803a9deb6450dad724e4b614213e1" candidate_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c45d5217722649e6bdbccee30863591b"
I20260807 13:50:51.989440 29081 raft_consensus.cc:3060] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:51.991636 29081 raft_consensus.cc:2468] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22b9a9a4b1bf44daa35fcecd47b8856a in term 1.
I20260807 13:50:51.992185 29337 leader_election.cc:304] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 22b9a9a4b1bf44daa35fcecd47b8856a, c45d5217722649e6bdbccee30863591b; no voters:
I20260807 13:50:51.992535 29671 raft_consensus.cc:2804] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:51.993119 29671 raft_consensus.cc:697] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 LEADER]: Becoming Leader. State: Replica: 22b9a9a4b1bf44daa35fcecd47b8856a, State: Running, Role: LEADER
I20260807 13:50:51.993743 29671 consensus_queue.cc:237] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
W20260807 13:50:51.995496 29146 tablet.cc:2406] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 13:50:51.998466 28394 catalog_manager.cc:5697] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a reported cstate change: term changed from 0 to 1, leader changed from <none> to 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134). New cstate: current_term: 1 leader_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
W20260807 13:50:52.033522 29478 tablet.cc:2406] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 13:50:52.037151 23982 external_mini_cluster.cc:955] 7 TS(s) registered with all masters
I20260807 13:50:52.039577 23982 ts_itest-base.cc:246] Waiting for 1 tablets on tserver c45d5217722649e6bdbccee30863591b to finish bootstrapping
I20260807 13:50:52.048835 23982 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 22b9a9a4b1bf44daa35fcecd47b8856a to finish bootstrapping
I20260807 13:50:52.057755 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 28983
I20260807 13:50:52.058813 29139 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:50:52.152055 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 28983
I20260807 13:50:52.182161 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 29148
I20260807 13:50:52.191511 29301 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:50:52.280149 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 29148
I20260807 13:50:52.304191 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 29314
I20260807 13:50:52.305454 29469 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:50:52.399566 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 29314
I20260807 13:50:52.425664 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 29481
I20260807 13:50:52.434597 29639 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:50:52.519938 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 29481
I20260807 13:50:56.296826 28394 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49002:
name: "rebalance_test_table_0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:50:56.324885 28553 tablet_service.cc:1511] Processing CreateTablet for tablet f9f996c0ec5849d98b1cc0fc83cc51a6 (DEFAULT_TABLE table=rebalance_test_table_0 [id=2f5b82068ed242bcb08a733f8a0d94df]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:56.324877 28895 tablet_service.cc:1511] Processing CreateTablet for tablet f9f996c0ec5849d98b1cc0fc83cc51a6 (DEFAULT_TABLE table=rebalance_test_table_0 [id=2f5b82068ed242bcb08a733f8a0d94df]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:56.325918 28894 tablet_service.cc:1511] Processing CreateTablet for tablet c72c9d7fb3364b2485475585dc6f244a (DEFAULT_TABLE table=rebalance_test_table_0 [id=2f5b82068ed242bcb08a733f8a0d94df]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:56.325619 28725 tablet_service.cc:1511] Processing CreateTablet for tablet be0c7339d6fd43c781879ef4c2c76fbd (DEFAULT_TABLE table=rebalance_test_table_0 [id=2f5b82068ed242bcb08a733f8a0d94df]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:56.326745 28553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9f996c0ec5849d98b1cc0fc83cc51a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:56.326751 28895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9f996c0ec5849d98b1cc0fc83cc51a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:56.326686 28724 tablet_service.cc:1511] Processing CreateTablet for tablet c72c9d7fb3364b2485475585dc6f244a (DEFAULT_TABLE table=rebalance_test_table_0 [id=2f5b82068ed242bcb08a733f8a0d94df]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:56.327204 28894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72c9d7fb3364b2485475585dc6f244a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:56.327344 28551 tablet_service.cc:1511] Processing CreateTablet for tablet be0c7339d6fd43c781879ef4c2c76fbd (DEFAULT_TABLE table=rebalance_test_table_0 [id=2f5b82068ed242bcb08a733f8a0d94df]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:56.327981 28551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be0c7339d6fd43c781879ef4c2c76fbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:56.327250 28725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be0c7339d6fd43c781879ef4c2c76fbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:56.335597 28724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72c9d7fb3364b2485475585dc6f244a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:56.345381 29707 tablet_bootstrap.cc:492] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe: Bootstrap starting.
I20260807 13:50:56.346266 29704 tablet_bootstrap.cc:492] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b: Bootstrap starting.
I20260807 13:50:56.350346 29705 tablet_bootstrap.cc:492] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503: Bootstrap starting.
I20260807 13:50:56.351562 29704 tablet_bootstrap.cc:654] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:56.353183 29704 log.cc:826] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b: Log is configured to *not* fsync() on all Append() calls
I20260807 13:50:56.354077 29707 tablet_bootstrap.cc:654] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:56.354272 29705 tablet_bootstrap.cc:654] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:56.355324 29707 log.cc:826] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe: Log is configured to *not* fsync() on all Append() calls
I20260807 13:50:56.355633 29705 log.cc:826] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503: Log is configured to *not* fsync() on all Append() calls
I20260807 13:50:56.356828 29704 tablet_bootstrap.cc:492] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b: No bootstrap required, opened a new log
I20260807 13:50:56.357162 29704 ts_tablet_manager.cc:1403] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.004s
I20260807 13:50:56.358856 29707 tablet_bootstrap.cc:492] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe: No bootstrap required, opened a new log
I20260807 13:50:56.359145 29707 ts_tablet_manager.cc:1403] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.004s
I20260807 13:50:56.359475 29705 tablet_bootstrap.cc:492] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503: No bootstrap required, opened a new log
I20260807 13:50:56.359752 29705 ts_tablet_manager.cc:1403] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260807 13:50:56.364974 29707 raft_consensus.cc:359] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:56.364998 29704 raft_consensus.cc:359] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:56.365339 29707 raft_consensus.cc:385] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:56.365396 29704 raft_consensus.cc:385] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:56.365513 29704 raft_consensus.cc:740] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ea2e5a5c2b0429985eb26f907033c9b, State: Initialized, Role: FOLLOWER
I20260807 13:50:56.365525 29707 raft_consensus.cc:740] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da72b03880d4414b034964abe86d4fe, State: Initialized, Role: FOLLOWER
I20260807 13:50:56.366222 29707 consensus_queue.cc:260] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:56.366356 29704 consensus_queue.cc:260] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:56.367926 29707 ts_tablet_manager.cc:1434] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe: Time spent starting tablet: real 0.009s user 0.005s sys 0.005s
I20260807 13:50:56.368490 29707 tablet_bootstrap.cc:492] T c72c9d7fb3364b2485475585dc6f244a P 9da72b03880d4414b034964abe86d4fe: Bootstrap starting.
I20260807 13:50:56.370107 29705 raft_consensus.cc:359] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:56.370501 29707 tablet_bootstrap.cc:654] T c72c9d7fb3364b2485475585dc6f244a P 9da72b03880d4414b034964abe86d4fe: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:56.370630 29705 raft_consensus.cc:385] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:56.370836 29705 raft_consensus.cc:740] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c11aeb9ac7f04cceb63233785ce00503, State: Initialized, Role: FOLLOWER
I20260807 13:50:56.372153 29705 consensus_queue.cc:260] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:56.374892 29704 ts_tablet_manager.cc:1434] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b: Time spent starting tablet: real 0.018s user 0.013s sys 0.005s
I20260807 13:50:56.375465 29704 tablet_bootstrap.cc:492] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b: Bootstrap starting.
I20260807 13:50:56.377494 29704 tablet_bootstrap.cc:654] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:56.378204 29705 ts_tablet_manager.cc:1434] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503: Time spent starting tablet: real 0.018s user 0.011s sys 0.004s
I20260807 13:50:56.378719 29705 tablet_bootstrap.cc:492] T f9f996c0ec5849d98b1cc0fc83cc51a6 P c11aeb9ac7f04cceb63233785ce00503: Bootstrap starting.
I20260807 13:50:56.384187 29705 tablet_bootstrap.cc:654] T f9f996c0ec5849d98b1cc0fc83cc51a6 P c11aeb9ac7f04cceb63233785ce00503: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:56.386510 29704 tablet_bootstrap.cc:492] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b: No bootstrap required, opened a new log
I20260807 13:50:56.386698 29704 ts_tablet_manager.cc:1403] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.010s
I20260807 13:50:56.387133 29707 tablet_bootstrap.cc:492] T c72c9d7fb3364b2485475585dc6f244a P 9da72b03880d4414b034964abe86d4fe: No bootstrap required, opened a new log
I20260807 13:50:56.387318 29707 ts_tablet_manager.cc:1403] T c72c9d7fb3364b2485475585dc6f244a P 9da72b03880d4414b034964abe86d4fe: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.009s
I20260807 13:50:56.387709 29705 tablet_bootstrap.cc:492] T f9f996c0ec5849d98b1cc0fc83cc51a6 P c11aeb9ac7f04cceb63233785ce00503: No bootstrap required, opened a new log
I20260807 13:50:56.387861 29705 ts_tablet_manager.cc:1403] T f9f996c0ec5849d98b1cc0fc83cc51a6 P c11aeb9ac7f04cceb63233785ce00503: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.002s
I20260807 13:50:56.387753 29704 raft_consensus.cc:359] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:56.388005 29704 raft_consensus.cc:385] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:56.388130 29704 raft_consensus.cc:740] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ea2e5a5c2b0429985eb26f907033c9b, State: Initialized, Role: FOLLOWER
I20260807 13:50:56.388417 29704 consensus_queue.cc:260] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:56.388418 29707 raft_consensus.cc:359] T c72c9d7fb3364b2485475585dc6f244a P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:56.388615 29707 raft_consensus.cc:385] T c72c9d7fb3364b2485475585dc6f244a P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:56.388724 29707 raft_consensus.cc:740] T c72c9d7fb3364b2485475585dc6f244a P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da72b03880d4414b034964abe86d4fe, State: Initialized, Role: FOLLOWER
I20260807 13:50:56.388845 29705 raft_consensus.cc:359] T f9f996c0ec5849d98b1cc0fc83cc51a6 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:56.389032 29705 raft_consensus.cc:385] T f9f996c0ec5849d98b1cc0fc83cc51a6 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:56.389094 29704 ts_tablet_manager.cc:1434] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260807 13:50:56.389132 29705 raft_consensus.cc:740] T f9f996c0ec5849d98b1cc0fc83cc51a6 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c11aeb9ac7f04cceb63233785ce00503, State: Initialized, Role: FOLLOWER
I20260807 13:50:56.389076 29707 consensus_queue.cc:260] T c72c9d7fb3364b2485475585dc6f244a P 9da72b03880d4414b034964abe86d4fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:56.389665 29707 ts_tablet_manager.cc:1434] T c72c9d7fb3364b2485475585dc6f244a P 9da72b03880d4414b034964abe86d4fe: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260807 13:50:56.389382 29705 consensus_queue.cc:260] T f9f996c0ec5849d98b1cc0fc83cc51a6 P c11aeb9ac7f04cceb63233785ce00503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:56.390502 29705 ts_tablet_manager.cc:1434] T f9f996c0ec5849d98b1cc0fc83cc51a6 P c11aeb9ac7f04cceb63233785ce00503: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
W20260807 13:50:56.476811 28637 tablet.cc:2406] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 13:50:56.487839 28807 tablet.cc:2406] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 13:50:56.499560 28978 tablet.cc:2406] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 13:50:56.587271 29712 raft_consensus.cc:493] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:56.587656 29712 raft_consensus.cc:515] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:56.589434 29712 leader_election.cc:290] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223)
I20260807 13:50:56.590574 29713 raft_consensus.cc:493] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:56.590835 29713 raft_consensus.cc:515] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:56.592571 29713 leader_election.cc:290] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223)
I20260807 13:50:56.598439 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0c7339d6fd43c781879ef4c2c76fbd" candidate_uuid: "9da72b03880d4414b034964abe86d4fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" is_pre_election: true
I20260807 13:50:56.599035 28577 raft_consensus.cc:2468] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da72b03880d4414b034964abe86d4fe in term 0.
I20260807 13:50:56.599822 28663 leader_election.cc:304] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 0ea2e5a5c2b0429985eb26f907033c9b, 9da72b03880d4414b034964abe86d4fe; no voters:
I20260807 13:50:56.600286 29712 raft_consensus.cc:2804] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:56.600576 29712 raft_consensus.cc:493] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:56.600728 29712 raft_consensus.cc:3060] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:56.600906 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0c7339d6fd43c781879ef4c2c76fbd" candidate_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da72b03880d4414b034964abe86d4fe" is_pre_election: true
I20260807 13:50:56.603343 29712 raft_consensus.cc:515] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:56.603814 28749 raft_consensus.cc:2393] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ea2e5a5c2b0429985eb26f907033c9b in current term 1: Already voted for candidate 9da72b03880d4414b034964abe86d4fe in this term.
I20260807 13:50:56.603981 29712 leader_election.cc:290] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe [CANDIDATE]: Term 1 election: Requested vote from peers 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223)
I20260807 13:50:56.604625 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0c7339d6fd43c781879ef4c2c76fbd" candidate_uuid: "9da72b03880d4414b034964abe86d4fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ea2e5a5c2b0429985eb26f907033c9b"
I20260807 13:50:56.604825 28577 raft_consensus.cc:3060] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:56.605309 28493 leader_election.cc:304] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 0ea2e5a5c2b0429985eb26f907033c9b; no voters: 9da72b03880d4414b034964abe86d4fe
I20260807 13:50:56.607928 28577 raft_consensus.cc:2468] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da72b03880d4414b034964abe86d4fe in term 1.
I20260807 13:50:56.608137 29713 raft_consensus.cc:2749] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:50:56.608445 28663 leader_election.cc:304] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 0ea2e5a5c2b0429985eb26f907033c9b, 9da72b03880d4414b034964abe86d4fe; no voters:
I20260807 13:50:56.608851 29712 raft_consensus.cc:2804] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:56.609457 29712 raft_consensus.cc:697] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe [term 1 LEADER]: Becoming Leader. State: Replica: 9da72b03880d4414b034964abe86d4fe, State: Running, Role: LEADER
I20260807 13:50:56.609997 29712 consensus_queue.cc:237] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:56.614120 28394 catalog_manager.cc:5697] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da72b03880d4414b034964abe86d4fe (127.23.107.130). New cstate: current_term: 1 leader_uuid: "9da72b03880d4414b034964abe86d4fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } }
I20260807 13:50:56.625264 29713 raft_consensus.cc:493] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:56.625520 29713 raft_consensus.cc:515] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:56.626216 29713 leader_election.cc:290] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571)
I20260807 13:50:56.632581 28920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f996c0ec5849d98b1cc0fc83cc51a6" candidate_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c11aeb9ac7f04cceb63233785ce00503" is_pre_election: true
I20260807 13:50:56.633078 28920 raft_consensus.cc:2468] T f9f996c0ec5849d98b1cc0fc83cc51a6 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ea2e5a5c2b0429985eb26f907033c9b in term 0.
I20260807 13:50:56.633651 28493 leader_election.cc:304] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 0ea2e5a5c2b0429985eb26f907033c9b, c11aeb9ac7f04cceb63233785ce00503; no voters:
I20260807 13:50:56.633951 29713 raft_consensus.cc:2804] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:56.634080 29713 raft_consensus.cc:493] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:56.634152 29713 raft_consensus.cc:3060] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:56.636224 29713 raft_consensus.cc:515] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:56.636711 29713 leader_election.cc:290] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b [CANDIDATE]: Term 1 election: Requested vote from peers c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571)
I20260807 13:50:56.637313 28920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f996c0ec5849d98b1cc0fc83cc51a6" candidate_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c11aeb9ac7f04cceb63233785ce00503"
I20260807 13:50:56.637559 28920 raft_consensus.cc:3060] T f9f996c0ec5849d98b1cc0fc83cc51a6 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:56.639756 28920 raft_consensus.cc:2468] T f9f996c0ec5849d98b1cc0fc83cc51a6 P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ea2e5a5c2b0429985eb26f907033c9b in term 1.
I20260807 13:50:56.640249 28493 leader_election.cc:304] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 0ea2e5a5c2b0429985eb26f907033c9b, c11aeb9ac7f04cceb63233785ce00503; no voters:
I20260807 13:50:56.640534 29713 raft_consensus.cc:2804] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:56.641026 29713 raft_consensus.cc:697] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 LEADER]: Becoming Leader. State: Replica: 0ea2e5a5c2b0429985eb26f907033c9b, State: Running, Role: LEADER
I20260807 13:50:56.641645 29713 consensus_queue.cc:237] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:56.645843 28394 catalog_manager.cc:5697] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129). New cstate: current_term: 1 leader_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } }
I20260807 13:50:56.659359 29715 raft_consensus.cc:493] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:56.659600 29715 raft_consensus.cc:515] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:56.661257 29715 leader_election.cc:290] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223)
I20260807 13:50:56.667963 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72c9d7fb3364b2485475585dc6f244a" candidate_uuid: "c11aeb9ac7f04cceb63233785ce00503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da72b03880d4414b034964abe86d4fe" is_pre_election: true
I20260807 13:50:56.668237 28749 raft_consensus.cc:2468] T c72c9d7fb3364b2485475585dc6f244a P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c11aeb9ac7f04cceb63233785ce00503 in term 0.
I20260807 13:50:56.668803 28832 leader_election.cc:304] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 9da72b03880d4414b034964abe86d4fe, c11aeb9ac7f04cceb63233785ce00503; no voters:
I20260807 13:50:56.669232 29715 raft_consensus.cc:2804] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:56.669412 29715 raft_consensus.cc:493] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:56.669543 29715 raft_consensus.cc:3060] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:56.671770 29715 raft_consensus.cc:515] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:56.672286 29715 leader_election.cc:290] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [CANDIDATE]: Term 1 election: Requested vote from peers 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223)
I20260807 13:50:56.672835 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72c9d7fb3364b2485475585dc6f244a" candidate_uuid: "c11aeb9ac7f04cceb63233785ce00503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da72b03880d4414b034964abe86d4fe"
I20260807 13:50:56.673036 28749 raft_consensus.cc:3060] T c72c9d7fb3364b2485475585dc6f244a P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:56.675223 28749 raft_consensus.cc:2468] T c72c9d7fb3364b2485475585dc6f244a P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c11aeb9ac7f04cceb63233785ce00503 in term 1.
I20260807 13:50:56.675676 28832 leader_election.cc:304] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 9da72b03880d4414b034964abe86d4fe, c11aeb9ac7f04cceb63233785ce00503; no voters:
I20260807 13:50:56.675994 29715 raft_consensus.cc:2804] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:56.676477 29715 raft_consensus.cc:697] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [term 1 LEADER]: Becoming Leader. State: Replica: c11aeb9ac7f04cceb63233785ce00503, State: Running, Role: LEADER
I20260807 13:50:56.677042 29715 consensus_queue.cc:237] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:56.681599 28394 catalog_manager.cc:5697] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 reported cstate change: term changed from 0 to 1, leader changed from <none> to c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131). New cstate: current_term: 1 leader_uuid: "c11aeb9ac7f04cceb63233785ce00503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } }
I20260807 13:50:57.004639 29712 consensus_queue.cc:1048] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:57.117573 29715 consensus_queue.cc:1048] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:50:57.160184 29732 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:57.160516 29732 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_0'
I20260807 13:50:57.264113 29713 consensus_queue.cc:1048] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 195.482 ms
time per row: 0.0977412 ms
I20260807 13:50:57.576259 28390 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49002:
name: "rebalance_test_table_1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:50:57.586910 28725 tablet_service.cc:1511] Processing CreateTablet for tablet 3da3196623e04606aca463b8847ab6cd (DEFAULT_TABLE table=rebalance_test_table_1 [id=49c4a818a68345dca0cf504531ad490a]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:57.587458 28725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3da3196623e04606aca463b8847ab6cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:57.587409 28551 tablet_service.cc:1511] Processing CreateTablet for tablet 7a7f0c232a674615a2cf5c3c06abd8a8 (DEFAULT_TABLE table=rebalance_test_table_1 [id=49c4a818a68345dca0cf504531ad490a]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:57.587721 28894 tablet_service.cc:1511] Processing CreateTablet for tablet 7a7f0c232a674615a2cf5c3c06abd8a8 (DEFAULT_TABLE table=rebalance_test_table_1 [id=49c4a818a68345dca0cf504531ad490a]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:57.587942 28551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a7f0c232a674615a2cf5c3c06abd8a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:57.588177 28894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a7f0c232a674615a2cf5c3c06abd8a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:57.588630 28895 tablet_service.cc:1511] Processing CreateTablet for tablet c2891223f5fd43979439c00fec9fca3d (DEFAULT_TABLE table=rebalance_test_table_1 [id=49c4a818a68345dca0cf504531ad490a]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:57.589062 28895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2891223f5fd43979439c00fec9fca3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:57.593839 28553 tablet_service.cc:1511] Processing CreateTablet for tablet 3da3196623e04606aca463b8847ab6cd (DEFAULT_TABLE table=rebalance_test_table_1 [id=49c4a818a68345dca0cf504531ad490a]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:57.594080 28724 tablet_service.cc:1511] Processing CreateTablet for tablet c2891223f5fd43979439c00fec9fca3d (DEFAULT_TABLE table=rebalance_test_table_1 [id=49c4a818a68345dca0cf504531ad490a]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:57.594285 28553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3da3196623e04606aca463b8847ab6cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:57.594560 28724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2891223f5fd43979439c00fec9fca3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:57.602393 29800 tablet_bootstrap.cc:492] T c2891223f5fd43979439c00fec9fca3d P 9da72b03880d4414b034964abe86d4fe: Bootstrap starting.
I20260807 13:50:57.604429 29799 tablet_bootstrap.cc:492] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503: Bootstrap starting.
I20260807 13:50:57.605294 29800 tablet_bootstrap.cc:654] T c2891223f5fd43979439c00fec9fca3d P 9da72b03880d4414b034964abe86d4fe: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:57.606650 29799 tablet_bootstrap.cc:654] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:57.607434 29798 tablet_bootstrap.cc:492] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b: Bootstrap starting.
I20260807 13:50:57.609139 29800 tablet_bootstrap.cc:492] T c2891223f5fd43979439c00fec9fca3d P 9da72b03880d4414b034964abe86d4fe: No bootstrap required, opened a new log
I20260807 13:50:57.609310 29800 ts_tablet_manager.cc:1403] T c2891223f5fd43979439c00fec9fca3d P 9da72b03880d4414b034964abe86d4fe: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260807 13:50:57.609879 29798 tablet_bootstrap.cc:654] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:57.610198 29800 raft_consensus.cc:359] T c2891223f5fd43979439c00fec9fca3d P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:57.610378 29800 raft_consensus.cc:385] T c2891223f5fd43979439c00fec9fca3d P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:57.610500 29800 raft_consensus.cc:740] T c2891223f5fd43979439c00fec9fca3d P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da72b03880d4414b034964abe86d4fe, State: Initialized, Role: FOLLOWER
I20260807 13:50:57.610787 29800 consensus_queue.cc:260] T c2891223f5fd43979439c00fec9fca3d P 9da72b03880d4414b034964abe86d4fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:57.611320 29800 ts_tablet_manager.cc:1434] T c2891223f5fd43979439c00fec9fca3d P 9da72b03880d4414b034964abe86d4fe: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:50:57.611622 29800 tablet_bootstrap.cc:492] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe: Bootstrap starting.
I20260807 13:50:57.612114 29798 tablet_bootstrap.cc:492] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b: No bootstrap required, opened a new log
I20260807 13:50:57.612130 29799 tablet_bootstrap.cc:492] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503: No bootstrap required, opened a new log
I20260807 13:50:57.612263 29799 ts_tablet_manager.cc:1403] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260807 13:50:57.612263 29798 ts_tablet_manager.cc:1403] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 13:50:57.613094 29799 raft_consensus.cc:359] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:57.613296 29799 raft_consensus.cc:385] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:57.613411 29799 raft_consensus.cc:740] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c11aeb9ac7f04cceb63233785ce00503, State: Initialized, Role: FOLLOWER
I20260807 13:50:57.613719 29799 consensus_queue.cc:260] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:57.614248 29800 tablet_bootstrap.cc:654] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:57.614444 29799 ts_tablet_manager.cc:1434] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:50:57.614876 29798 raft_consensus.cc:359] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:57.615163 29799 tablet_bootstrap.cc:492] T 7a7f0c232a674615a2cf5c3c06abd8a8 P c11aeb9ac7f04cceb63233785ce00503: Bootstrap starting.
I20260807 13:50:57.615067 29798 raft_consensus.cc:385] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:57.617585 29799 tablet_bootstrap.cc:654] T 7a7f0c232a674615a2cf5c3c06abd8a8 P c11aeb9ac7f04cceb63233785ce00503: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:57.616256 29798 raft_consensus.cc:740] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ea2e5a5c2b0429985eb26f907033c9b, State: Initialized, Role: FOLLOWER
I20260807 13:50:57.618793 29798 consensus_queue.cc:260] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:57.619874 29798 ts_tablet_manager.cc:1434] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260807 13:50:57.620350 29798 tablet_bootstrap.cc:492] T 3da3196623e04606aca463b8847ab6cd P 0ea2e5a5c2b0429985eb26f907033c9b: Bootstrap starting.
I20260807 13:50:57.623080 29798 tablet_bootstrap.cc:654] T 3da3196623e04606aca463b8847ab6cd P 0ea2e5a5c2b0429985eb26f907033c9b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:57.625020 29799 tablet_bootstrap.cc:492] T 7a7f0c232a674615a2cf5c3c06abd8a8 P c11aeb9ac7f04cceb63233785ce00503: No bootstrap required, opened a new log
I20260807 13:50:57.625216 29799 ts_tablet_manager.cc:1403] T 7a7f0c232a674615a2cf5c3c06abd8a8 P c11aeb9ac7f04cceb63233785ce00503: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.005s
I20260807 13:50:57.625262 29800 tablet_bootstrap.cc:492] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe: No bootstrap required, opened a new log
I20260807 13:50:57.625448 29800 ts_tablet_manager.cc:1403] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.008s
I20260807 13:50:57.626353 29800 raft_consensus.cc:359] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } }
I20260807 13:50:57.626573 29800 raft_consensus.cc:385] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:57.626605 29799 raft_consensus.cc:359] T 7a7f0c232a674615a2cf5c3c06abd8a8 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:57.626696 29800 raft_consensus.cc:740] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da72b03880d4414b034964abe86d4fe, State: Initialized, Role: FOLLOWER
I20260807 13:50:57.626806 29799 raft_consensus.cc:385] T 7a7f0c232a674615a2cf5c3c06abd8a8 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:57.626886 29799 raft_consensus.cc:740] T 7a7f0c232a674615a2cf5c3c06abd8a8 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c11aeb9ac7f04cceb63233785ce00503, State: Initialized, Role: FOLLOWER
I20260807 13:50:57.626978 29800 consensus_queue.cc:260] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } }
I20260807 13:50:57.627140 29799 consensus_queue.cc:260] T 7a7f0c232a674615a2cf5c3c06abd8a8 P c11aeb9ac7f04cceb63233785ce00503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:57.627625 29800 ts_tablet_manager.cc:1434] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:50:57.627743 29799 ts_tablet_manager.cc:1434] T 7a7f0c232a674615a2cf5c3c06abd8a8 P c11aeb9ac7f04cceb63233785ce00503: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 13:50:57.627818 29798 tablet_bootstrap.cc:492] T 3da3196623e04606aca463b8847ab6cd P 0ea2e5a5c2b0429985eb26f907033c9b: No bootstrap required, opened a new log
I20260807 13:50:57.628022 29798 ts_tablet_manager.cc:1403] T 3da3196623e04606aca463b8847ab6cd P 0ea2e5a5c2b0429985eb26f907033c9b: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260807 13:50:57.628990 29798 raft_consensus.cc:359] T 3da3196623e04606aca463b8847ab6cd P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } }
I20260807 13:50:57.629240 29798 raft_consensus.cc:385] T 3da3196623e04606aca463b8847ab6cd P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:57.629371 29798 raft_consensus.cc:740] T 3da3196623e04606aca463b8847ab6cd P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ea2e5a5c2b0429985eb26f907033c9b, State: Initialized, Role: FOLLOWER
I20260807 13:50:57.629662 29798 consensus_queue.cc:260] T 3da3196623e04606aca463b8847ab6cd P 0ea2e5a5c2b0429985eb26f907033c9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } }
I20260807 13:50:57.630247 29798 ts_tablet_manager.cc:1434] T 3da3196623e04606aca463b8847ab6cd P 0ea2e5a5c2b0429985eb26f907033c9b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 13:50:57.633524 29720 raft_consensus.cc:493] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:57.633708 29720 raft_consensus.cc:515] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } }
I20260807 13:50:57.634385 29720 leader_election.cc:290] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223)
I20260807 13:50:57.634915 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da3196623e04606aca463b8847ab6cd" candidate_uuid: "9da72b03880d4414b034964abe86d4fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" is_pre_election: true
I20260807 13:50:57.635118 28577 raft_consensus.cc:2468] T 3da3196623e04606aca463b8847ab6cd P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da72b03880d4414b034964abe86d4fe in term 0.
I20260807 13:50:57.635497 28663 leader_election.cc:304] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 0ea2e5a5c2b0429985eb26f907033c9b, 9da72b03880d4414b034964abe86d4fe; no voters:
I20260807 13:50:57.635761 29720 raft_consensus.cc:2804] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:57.635883 29720 raft_consensus.cc:493] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:57.635954 29720 raft_consensus.cc:3060] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:57.638074 29720 raft_consensus.cc:515] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } }
I20260807 13:50:57.638509 29720 leader_election.cc:290] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe [CANDIDATE]: Term 1 election: Requested vote from peers 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223)
I20260807 13:50:57.639031 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da3196623e04606aca463b8847ab6cd" candidate_uuid: "9da72b03880d4414b034964abe86d4fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ea2e5a5c2b0429985eb26f907033c9b"
I20260807 13:50:57.639253 28577 raft_consensus.cc:3060] T 3da3196623e04606aca463b8847ab6cd P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:57.640865 29729 raft_consensus.cc:493] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:57.641028 29729 raft_consensus.cc:515] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:57.641455 28577 raft_consensus.cc:2468] T 3da3196623e04606aca463b8847ab6cd P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da72b03880d4414b034964abe86d4fe in term 1.
I20260807 13:50:57.641794 29729 leader_election.cc:290] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223)
I20260807 13:50:57.641937 28663 leader_election.cc:304] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 0ea2e5a5c2b0429985eb26f907033c9b, 9da72b03880d4414b034964abe86d4fe; no voters:
I20260807 13:50:57.642328 29720 raft_consensus.cc:2804] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:57.642513 29720 raft_consensus.cc:697] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe [term 1 LEADER]: Becoming Leader. State: Replica: 9da72b03880d4414b034964abe86d4fe, State: Running, Role: LEADER
I20260807 13:50:57.642640 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2891223f5fd43979439c00fec9fca3d" candidate_uuid: "c11aeb9ac7f04cceb63233785ce00503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da72b03880d4414b034964abe86d4fe" is_pre_election: true
I20260807 13:50:57.642827 29720 consensus_queue.cc:237] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } }
I20260807 13:50:57.642905 28749 raft_consensus.cc:2468] T c2891223f5fd43979439c00fec9fca3d P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c11aeb9ac7f04cceb63233785ce00503 in term 0.
I20260807 13:50:57.643509 28832 leader_election.cc:304] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 9da72b03880d4414b034964abe86d4fe, c11aeb9ac7f04cceb63233785ce00503; no voters:
I20260807 13:50:57.643821 29729 raft_consensus.cc:2804] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:57.643963 29729 raft_consensus.cc:493] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:57.644059 29729 raft_consensus.cc:3060] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:57.646440 29729 raft_consensus.cc:515] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:57.646899 29729 leader_election.cc:290] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 [CANDIDATE]: Term 1 election: Requested vote from peers 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223)
I20260807 13:50:57.647516 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2891223f5fd43979439c00fec9fca3d" candidate_uuid: "c11aeb9ac7f04cceb63233785ce00503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da72b03880d4414b034964abe86d4fe"
I20260807 13:50:57.647758 28749 raft_consensus.cc:3060] T c2891223f5fd43979439c00fec9fca3d P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:57.649372 28390 catalog_manager.cc:5697] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da72b03880d4414b034964abe86d4fe (127.23.107.130). New cstate: current_term: 1 leader_uuid: "9da72b03880d4414b034964abe86d4fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } }
I20260807 13:50:57.650228 28749 raft_consensus.cc:2468] T c2891223f5fd43979439c00fec9fca3d P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c11aeb9ac7f04cceb63233785ce00503 in term 1.
I20260807 13:50:57.650679 28832 leader_election.cc:304] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 9da72b03880d4414b034964abe86d4fe, c11aeb9ac7f04cceb63233785ce00503; no voters:
I20260807 13:50:57.650990 29729 raft_consensus.cc:2804] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:57.651161 29729 raft_consensus.cc:697] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 [term 1 LEADER]: Becoming Leader. State: Replica: c11aeb9ac7f04cceb63233785ce00503, State: Running, Role: LEADER
I20260807 13:50:57.651407 29729 consensus_queue.cc:237] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:57.654044 28390 catalog_manager.cc:5697] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 reported cstate change: term changed from 0 to 1, leader changed from <none> to c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131). New cstate: current_term: 1 leader_uuid: "c11aeb9ac7f04cceb63233785ce00503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } }
I20260807 13:50:57.885046 29713 raft_consensus.cc:493] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:57.885294 29713 raft_consensus.cc:515] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:57.885977 29713 leader_election.cc:290] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571)
I20260807 13:50:57.886709 28920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7f0c232a674615a2cf5c3c06abd8a8" candidate_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c11aeb9ac7f04cceb63233785ce00503" is_pre_election: true
I20260807 13:50:57.886961 28920 raft_consensus.cc:2468] T 7a7f0c232a674615a2cf5c3c06abd8a8 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ea2e5a5c2b0429985eb26f907033c9b in term 0.
I20260807 13:50:57.887522 28493 leader_election.cc:304] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 0ea2e5a5c2b0429985eb26f907033c9b, c11aeb9ac7f04cceb63233785ce00503; no voters:
I20260807 13:50:57.887827 29713 raft_consensus.cc:2804] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:57.887956 29713 raft_consensus.cc:493] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:57.888060 29713 raft_consensus.cc:3060] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:57.890141 29713 raft_consensus.cc:515] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:57.890623 29713 leader_election.cc:290] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [CANDIDATE]: Term 1 election: Requested vote from peers c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571)
I20260807 13:50:57.891274 28920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7f0c232a674615a2cf5c3c06abd8a8" candidate_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c11aeb9ac7f04cceb63233785ce00503"
I20260807 13:50:57.891494 28920 raft_consensus.cc:3060] T 7a7f0c232a674615a2cf5c3c06abd8a8 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:57.893530 28920 raft_consensus.cc:2468] T 7a7f0c232a674615a2cf5c3c06abd8a8 P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ea2e5a5c2b0429985eb26f907033c9b in term 1.
I20260807 13:50:57.894191 28493 leader_election.cc:304] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 0ea2e5a5c2b0429985eb26f907033c9b, c11aeb9ac7f04cceb63233785ce00503; no voters:
I20260807 13:50:57.894520 29713 raft_consensus.cc:2804] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:57.894915 29713 raft_consensus.cc:697] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 LEADER]: Becoming Leader. State: Replica: 0ea2e5a5c2b0429985eb26f907033c9b, State: Running, Role: LEADER
I20260807 13:50:57.895210 29713 consensus_queue.cc:237] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:57.897708 28390 catalog_manager.cc:5697] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129). New cstate: current_term: 1 leader_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } }
I20260807 13:50:58.133219 29729 consensus_queue.cc:1048] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:58.231746 29720 consensus_queue.cc:1048] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:50:58.286778 29813 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:58.287142 29813 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_1'
I20260807 13:50:58.443660 29713 consensus_queue.cc:1048] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 195.332 ms
time per row: 0.0976658 ms
I20260807 13:50:58.647090 28383 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49002:
name: "rebalance_test_table_2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:50:58.657401 28551 tablet_service.cc:1511] Processing CreateTablet for tablet 3fefa1bc622f43ca8344ddfe3522ce46 (DEFAULT_TABLE table=rebalance_test_table_2 [id=46bf349795f3453589935822245c96b1]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:58.657811 28725 tablet_service.cc:1511] Processing CreateTablet for tablet 3fefa1bc622f43ca8344ddfe3522ce46 (DEFAULT_TABLE table=rebalance_test_table_2 [id=46bf349795f3453589935822245c96b1]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:58.657997 28551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fefa1bc622f43ca8344ddfe3522ce46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:58.658298 28725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fefa1bc622f43ca8344ddfe3522ce46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:58.658914 28553 tablet_service.cc:1511] Processing CreateTablet for tablet e88a325f491a4cbc97d05562c44efccd (DEFAULT_TABLE table=rebalance_test_table_2 [id=46bf349795f3453589935822245c96b1]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:58.658910 28895 tablet_service.cc:1511] Processing CreateTablet for tablet e88a325f491a4cbc97d05562c44efccd (DEFAULT_TABLE table=rebalance_test_table_2 [id=46bf349795f3453589935822245c96b1]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:58.659363 28895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e88a325f491a4cbc97d05562c44efccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:58.659359 28553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e88a325f491a4cbc97d05562c44efccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:58.661752 28894 tablet_service.cc:1511] Processing CreateTablet for tablet ae179f753242471eb4484553d9df106b (DEFAULT_TABLE table=rebalance_test_table_2 [id=46bf349795f3453589935822245c96b1]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:58.662125 28894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae179f753242471eb4484553d9df106b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:58.664399 28724 tablet_service.cc:1511] Processing CreateTablet for tablet ae179f753242471eb4484553d9df106b (DEFAULT_TABLE table=rebalance_test_table_2 [id=46bf349795f3453589935822245c96b1]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:58.664817 28724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae179f753242471eb4484553d9df106b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:58.676102 29886 tablet_bootstrap.cc:492] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe: Bootstrap starting.
I20260807 13:50:58.677942 29886 tablet_bootstrap.cc:654] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:58.680378 29886 tablet_bootstrap.cc:492] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe: No bootstrap required, opened a new log
I20260807 13:50:58.680609 29886 ts_tablet_manager.cc:1403] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260807 13:50:58.681488 29886 raft_consensus.cc:359] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:58.681674 29886 raft_consensus.cc:385] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:58.681782 29886 raft_consensus.cc:740] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da72b03880d4414b034964abe86d4fe, State: Initialized, Role: FOLLOWER
I20260807 13:50:58.682075 29886 consensus_queue.cc:260] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:58.682578 29886 ts_tablet_manager.cc:1434] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260807 13:50:58.683004 29886 tablet_bootstrap.cc:492] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe: Bootstrap starting.
I20260807 13:50:58.684813 29886 tablet_bootstrap.cc:654] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:58.685487 29888 tablet_bootstrap.cc:492] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503: Bootstrap starting.
I20260807 13:50:58.686138 29885 tablet_bootstrap.cc:492] T 3fefa1bc622f43ca8344ddfe3522ce46 P 0ea2e5a5c2b0429985eb26f907033c9b: Bootstrap starting.
I20260807 13:50:58.688303 29885 tablet_bootstrap.cc:654] T 3fefa1bc622f43ca8344ddfe3522ce46 P 0ea2e5a5c2b0429985eb26f907033c9b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:58.688303 29888 tablet_bootstrap.cc:654] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:58.691262 29886 tablet_bootstrap.cc:492] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe: No bootstrap required, opened a new log
I20260807 13:50:58.691454 29886 ts_tablet_manager.cc:1403] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260807 13:50:58.692131 29886 raft_consensus.cc:359] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:58.692330 29886 raft_consensus.cc:385] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:58.692433 29886 raft_consensus.cc:740] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da72b03880d4414b034964abe86d4fe, State: Initialized, Role: FOLLOWER
I20260807 13:50:58.692713 29886 consensus_queue.cc:260] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:58.693220 29886 ts_tablet_manager.cc:1434] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260807 13:50:58.697084 29888 tablet_bootstrap.cc:492] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503: No bootstrap required, opened a new log
I20260807 13:50:58.697317 29888 ts_tablet_manager.cc:1403] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.007s
I20260807 13:50:58.697726 29885 tablet_bootstrap.cc:492] T 3fefa1bc622f43ca8344ddfe3522ce46 P 0ea2e5a5c2b0429985eb26f907033c9b: No bootstrap required, opened a new log
I20260807 13:50:58.697885 29885 ts_tablet_manager.cc:1403] T 3fefa1bc622f43ca8344ddfe3522ce46 P 0ea2e5a5c2b0429985eb26f907033c9b: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260807 13:50:58.698303 29888 raft_consensus.cc:359] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:58.698499 29888 raft_consensus.cc:385] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:58.698606 29888 raft_consensus.cc:740] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c11aeb9ac7f04cceb63233785ce00503, State: Initialized, Role: FOLLOWER
I20260807 13:50:58.698807 29885 raft_consensus.cc:359] T 3fefa1bc622f43ca8344ddfe3522ce46 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:58.698891 29888 consensus_queue.cc:260] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:58.698988 29885 raft_consensus.cc:385] T 3fefa1bc622f43ca8344ddfe3522ce46 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:58.699088 29885 raft_consensus.cc:740] T 3fefa1bc622f43ca8344ddfe3522ce46 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ea2e5a5c2b0429985eb26f907033c9b, State: Initialized, Role: FOLLOWER
I20260807 13:50:58.699373 29885 consensus_queue.cc:260] T 3fefa1bc622f43ca8344ddfe3522ce46 P 0ea2e5a5c2b0429985eb26f907033c9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:58.699493 29888 ts_tablet_manager.cc:1434] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 13:50:58.699950 29885 ts_tablet_manager.cc:1434] T 3fefa1bc622f43ca8344ddfe3522ce46 P 0ea2e5a5c2b0429985eb26f907033c9b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 13:50:58.699776 29888 tablet_bootstrap.cc:492] T ae179f753242471eb4484553d9df106b P c11aeb9ac7f04cceb63233785ce00503: Bootstrap starting.
I20260807 13:50:58.700273 29885 tablet_bootstrap.cc:492] T e88a325f491a4cbc97d05562c44efccd P 0ea2e5a5c2b0429985eb26f907033c9b: Bootstrap starting.
I20260807 13:50:58.701920 29888 tablet_bootstrap.cc:654] T ae179f753242471eb4484553d9df106b P c11aeb9ac7f04cceb63233785ce00503: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:58.702075 29885 tablet_bootstrap.cc:654] T e88a325f491a4cbc97d05562c44efccd P 0ea2e5a5c2b0429985eb26f907033c9b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:58.704795 29888 tablet_bootstrap.cc:492] T ae179f753242471eb4484553d9df106b P c11aeb9ac7f04cceb63233785ce00503: No bootstrap required, opened a new log
I20260807 13:50:58.705082 29888 ts_tablet_manager.cc:1403] T ae179f753242471eb4484553d9df106b P c11aeb9ac7f04cceb63233785ce00503: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 13:50:58.706351 29888 raft_consensus.cc:359] T ae179f753242471eb4484553d9df106b P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:58.706630 29888 raft_consensus.cc:385] T ae179f753242471eb4484553d9df106b P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:58.706737 29888 raft_consensus.cc:740] T ae179f753242471eb4484553d9df106b P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c11aeb9ac7f04cceb63233785ce00503, State: Initialized, Role: FOLLOWER
I20260807 13:50:58.707020 29888 consensus_queue.cc:260] T ae179f753242471eb4484553d9df106b P c11aeb9ac7f04cceb63233785ce00503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:58.707521 29888 ts_tablet_manager.cc:1434] T ae179f753242471eb4484553d9df106b P c11aeb9ac7f04cceb63233785ce00503: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260807 13:50:58.707715 29885 tablet_bootstrap.cc:492] T e88a325f491a4cbc97d05562c44efccd P 0ea2e5a5c2b0429985eb26f907033c9b: No bootstrap required, opened a new log
I20260807 13:50:58.707898 29885 ts_tablet_manager.cc:1403] T e88a325f491a4cbc97d05562c44efccd P 0ea2e5a5c2b0429985eb26f907033c9b: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260807 13:50:58.708611 29885 raft_consensus.cc:359] T e88a325f491a4cbc97d05562c44efccd P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:58.708758 29885 raft_consensus.cc:385] T e88a325f491a4cbc97d05562c44efccd P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:58.708855 29885 raft_consensus.cc:740] T e88a325f491a4cbc97d05562c44efccd P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ea2e5a5c2b0429985eb26f907033c9b, State: Initialized, Role: FOLLOWER
I20260807 13:50:58.709136 29885 consensus_queue.cc:260] T e88a325f491a4cbc97d05562c44efccd P 0ea2e5a5c2b0429985eb26f907033c9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:58.709700 29885 ts_tablet_manager.cc:1434] T e88a325f491a4cbc97d05562c44efccd P 0ea2e5a5c2b0429985eb26f907033c9b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 13:50:58.871455 29720 raft_consensus.cc:493] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:58.871634 29720 raft_consensus.cc:515] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:58.872244 29720 leader_election.cc:290] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223)
I20260807 13:50:58.873000 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fefa1bc622f43ca8344ddfe3522ce46" candidate_uuid: "9da72b03880d4414b034964abe86d4fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" is_pre_election: true
I20260807 13:50:58.873329 28577 raft_consensus.cc:2468] T 3fefa1bc622f43ca8344ddfe3522ce46 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da72b03880d4414b034964abe86d4fe in term 0.
I20260807 13:50:58.874032 28663 leader_election.cc:304] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 0ea2e5a5c2b0429985eb26f907033c9b, 9da72b03880d4414b034964abe86d4fe; no voters:
I20260807 13:50:58.874364 29720 raft_consensus.cc:2804] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:58.874493 29720 raft_consensus.cc:493] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:58.874608 29720 raft_consensus.cc:3060] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:58.876786 29720 raft_consensus.cc:515] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:58.877249 29720 leader_election.cc:290] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [CANDIDATE]: Term 1 election: Requested vote from peers 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223)
I20260807 13:50:58.877934 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fefa1bc622f43ca8344ddfe3522ce46" candidate_uuid: "9da72b03880d4414b034964abe86d4fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ea2e5a5c2b0429985eb26f907033c9b"
I20260807 13:50:58.878136 28577 raft_consensus.cc:3060] T 3fefa1bc622f43ca8344ddfe3522ce46 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:58.880276 28577 raft_consensus.cc:2468] T 3fefa1bc622f43ca8344ddfe3522ce46 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da72b03880d4414b034964abe86d4fe in term 1.
I20260807 13:50:58.880808 28663 leader_election.cc:304] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 0ea2e5a5c2b0429985eb26f907033c9b, 9da72b03880d4414b034964abe86d4fe; no voters:
I20260807 13:50:58.881155 29720 raft_consensus.cc:2804] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:58.881316 29720 raft_consensus.cc:697] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [term 1 LEADER]: Becoming Leader. State: Replica: 9da72b03880d4414b034964abe86d4fe, State: Running, Role: LEADER
I20260807 13:50:58.881637 29720 consensus_queue.cc:237] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:58.884600 28383 catalog_manager.cc:5697] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da72b03880d4414b034964abe86d4fe (127.23.107.130). New cstate: current_term: 1 leader_uuid: "9da72b03880d4414b034964abe86d4fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } }
I20260807 13:50:58.953375 29715 raft_consensus.cc:493] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:58.953780 29715 raft_consensus.cc:515] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:58.954502 29715 leader_election.cc:290] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223)
I20260807 13:50:58.960376 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88a325f491a4cbc97d05562c44efccd" candidate_uuid: "c11aeb9ac7f04cceb63233785ce00503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" is_pre_election: true
I20260807 13:50:58.960662 28577 raft_consensus.cc:2468] T e88a325f491a4cbc97d05562c44efccd P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c11aeb9ac7f04cceb63233785ce00503 in term 0.
I20260807 13:50:58.961139 28835 leader_election.cc:304] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 0ea2e5a5c2b0429985eb26f907033c9b, c11aeb9ac7f04cceb63233785ce00503; no voters:
I20260807 13:50:58.961470 29715 raft_consensus.cc:2804] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:58.961596 29715 raft_consensus.cc:493] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:58.961695 29715 raft_consensus.cc:3060] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:58.964210 29715 raft_consensus.cc:515] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:58.964771 29715 leader_election.cc:290] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 [CANDIDATE]: Term 1 election: Requested vote from peers 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223)
I20260807 13:50:58.965291 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88a325f491a4cbc97d05562c44efccd" candidate_uuid: "c11aeb9ac7f04cceb63233785ce00503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ea2e5a5c2b0429985eb26f907033c9b"
I20260807 13:50:58.965544 28577 raft_consensus.cc:3060] T e88a325f491a4cbc97d05562c44efccd P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:58.967558 28577 raft_consensus.cc:2468] T e88a325f491a4cbc97d05562c44efccd P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c11aeb9ac7f04cceb63233785ce00503 in term 1.
I20260807 13:50:58.967975 28835 leader_election.cc:304] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 0ea2e5a5c2b0429985eb26f907033c9b, c11aeb9ac7f04cceb63233785ce00503; no voters:
I20260807 13:50:58.968274 29715 raft_consensus.cc:2804] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:58.968446 29715 raft_consensus.cc:697] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 [term 1 LEADER]: Becoming Leader. State: Replica: c11aeb9ac7f04cceb63233785ce00503, State: Running, Role: LEADER
I20260807 13:50:58.968809 29715 consensus_queue.cc:237] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:58.971589 28383 catalog_manager.cc:5697] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 reported cstate change: term changed from 0 to 1, leader changed from <none> to c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131). New cstate: current_term: 1 leader_uuid: "c11aeb9ac7f04cceb63233785ce00503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } }
I20260807 13:50:58.998448 29720 raft_consensus.cc:493] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:58.998728 29720 raft_consensus.cc:515] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:58.999536 29720 leader_election.cc:290] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571)
I20260807 13:50:59.005964 28920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae179f753242471eb4484553d9df106b" candidate_uuid: "9da72b03880d4414b034964abe86d4fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c11aeb9ac7f04cceb63233785ce00503" is_pre_election: true
I20260807 13:50:59.006227 28920 raft_consensus.cc:2468] T ae179f753242471eb4484553d9df106b P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da72b03880d4414b034964abe86d4fe in term 0.
I20260807 13:50:59.006754 28662 leader_election.cc:304] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 9da72b03880d4414b034964abe86d4fe, c11aeb9ac7f04cceb63233785ce00503; no voters:
I20260807 13:50:59.007091 29720 raft_consensus.cc:2804] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:59.007184 29720 raft_consensus.cc:493] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:59.007320 29720 raft_consensus.cc:3060] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:59.009460 29720 raft_consensus.cc:515] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:59.009974 29720 leader_election.cc:290] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe [CANDIDATE]: Term 1 election: Requested vote from peers c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571)
I20260807 13:50:59.010537 28920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae179f753242471eb4484553d9df106b" candidate_uuid: "9da72b03880d4414b034964abe86d4fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c11aeb9ac7f04cceb63233785ce00503"
I20260807 13:50:59.010763 28920 raft_consensus.cc:3060] T ae179f753242471eb4484553d9df106b P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:59.012842 28920 raft_consensus.cc:2468] T ae179f753242471eb4484553d9df106b P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da72b03880d4414b034964abe86d4fe in term 1.
I20260807 13:50:59.013324 28662 leader_election.cc:304] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 9da72b03880d4414b034964abe86d4fe, c11aeb9ac7f04cceb63233785ce00503; no voters:
I20260807 13:50:59.013713 29720 raft_consensus.cc:2804] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:59.013896 29720 raft_consensus.cc:697] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe [term 1 LEADER]: Becoming Leader. State: Replica: 9da72b03880d4414b034964abe86d4fe, State: Running, Role: LEADER
I20260807 13:50:59.014181 29720 consensus_queue.cc:237] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:50:59.016716 28383 catalog_manager.cc:5697] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da72b03880d4414b034964abe86d4fe (127.23.107.130). New cstate: current_term: 1 leader_uuid: "9da72b03880d4414b034964abe86d4fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } }
W20260807 13:50:59.415659 29903 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:50:59.416000 29903 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260807 13:50:59.447721 29720 consensus_queue.cc:1048] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Using table 'rebalance_test_table_2'
I20260807 13:50:59.463889 29715 consensus_queue.cc:1048] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:59.574811 28920 raft_consensus.cc:1275] T ae179f753242471eb4484553d9df106b P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Refusing update from remote peer 9da72b03880d4414b034964abe86d4fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 13:50:59.575793 29720 consensus_queue.cc:1048] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:50:59.628607 29954 mvcc.cc:204] Tried to move back new op lower bound from 7315909261609017344 to 7315909259323695104. Current Snapshot: MvccSnapshot[applied={T|T < 7315909261609017344}]
INSERT report
rows total: 2000
time total: 176.526 ms
time per row: 0.0882629 ms
I20260807 13:50:59.758307 28389 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49002:
name: "rebalance_test_table_3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:50:59.768841 28724 tablet_service.cc:1511] Processing CreateTablet for tablet 5daf3681a6ba460385331aadffabfa8f (DEFAULT_TABLE table=rebalance_test_table_3 [id=6232d7b2b0b5403c842e16fd04e72177]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:59.769407 28724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5daf3681a6ba460385331aadffabfa8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:59.769552 28551 tablet_service.cc:1511] Processing CreateTablet for tablet 5daf3681a6ba460385331aadffabfa8f (DEFAULT_TABLE table=rebalance_test_table_3 [id=6232d7b2b0b5403c842e16fd04e72177]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:59.770018 28551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5daf3681a6ba460385331aadffabfa8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:59.773782 28894 tablet_service.cc:1511] Processing CreateTablet for tablet f726c2f0034d4cc8b36c2f706f5e5b04 (DEFAULT_TABLE table=rebalance_test_table_3 [id=6232d7b2b0b5403c842e16fd04e72177]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:59.774207 28894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f726c2f0034d4cc8b36c2f706f5e5b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:59.776806 28895 tablet_service.cc:1511] Processing CreateTablet for tablet 04f1daf8b6a44274bf2cc578e93c8303 (DEFAULT_TABLE table=rebalance_test_table_3 [id=6232d7b2b0b5403c842e16fd04e72177]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:59.777191 28895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f1daf8b6a44274bf2cc578e93c8303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:59.777216 29967 tablet_bootstrap.cc:492] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b: Bootstrap starting.
I20260807 13:50:59.779232 29967 tablet_bootstrap.cc:654] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:59.781762 28553 tablet_service.cc:1511] Processing CreateTablet for tablet 04f1daf8b6a44274bf2cc578e93c8303 (DEFAULT_TABLE table=rebalance_test_table_3 [id=6232d7b2b0b5403c842e16fd04e72177]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:59.781924 29967 tablet_bootstrap.cc:492] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b: No bootstrap required, opened a new log
I20260807 13:50:59.782063 29967 ts_tablet_manager.cc:1403] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 13:50:59.782182 28553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f1daf8b6a44274bf2cc578e93c8303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:59.782379 28725 tablet_service.cc:1511] Processing CreateTablet for tablet f726c2f0034d4cc8b36c2f706f5e5b04 (DEFAULT_TABLE table=rebalance_test_table_3 [id=6232d7b2b0b5403c842e16fd04e72177]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:50:59.782888 28725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f726c2f0034d4cc8b36c2f706f5e5b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:50:59.782949 29967 raft_consensus.cc:359] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } }
I20260807 13:50:59.783160 29967 raft_consensus.cc:385] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:59.783257 29967 raft_consensus.cc:740] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ea2e5a5c2b0429985eb26f907033c9b, State: Initialized, Role: FOLLOWER
I20260807 13:50:59.783526 29967 consensus_queue.cc:260] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } }
I20260807 13:50:59.784253 29967 ts_tablet_manager.cc:1434] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:50:59.785115 29966 tablet_bootstrap.cc:492] T 5daf3681a6ba460385331aadffabfa8f P 9da72b03880d4414b034964abe86d4fe: Bootstrap starting.
I20260807 13:50:59.787210 29966 tablet_bootstrap.cc:654] T 5daf3681a6ba460385331aadffabfa8f P 9da72b03880d4414b034964abe86d4fe: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:59.787428 29967 tablet_bootstrap.cc:492] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b: Bootstrap starting.
I20260807 13:50:59.789016 29967 tablet_bootstrap.cc:654] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:59.795410 29971 tablet_bootstrap.cc:492] T 04f1daf8b6a44274bf2cc578e93c8303 P c11aeb9ac7f04cceb63233785ce00503: Bootstrap starting.
I20260807 13:50:59.798974 29971 tablet_bootstrap.cc:654] T 04f1daf8b6a44274bf2cc578e93c8303 P c11aeb9ac7f04cceb63233785ce00503: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:59.802987 29966 tablet_bootstrap.cc:492] T 5daf3681a6ba460385331aadffabfa8f P 9da72b03880d4414b034964abe86d4fe: No bootstrap required, opened a new log
I20260807 13:50:59.803158 29966 ts_tablet_manager.cc:1403] T 5daf3681a6ba460385331aadffabfa8f P 9da72b03880d4414b034964abe86d4fe: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.007s
I20260807 13:50:59.803418 29967 tablet_bootstrap.cc:492] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b: No bootstrap required, opened a new log
I20260807 13:50:59.803627 29967 ts_tablet_manager.cc:1403] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b: Time spent bootstrapping tablet: real 0.016s user 0.014s sys 0.000s
I20260807 13:50:59.804122 29966 raft_consensus.cc:359] T 5daf3681a6ba460385331aadffabfa8f P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } }
I20260807 13:50:59.804338 29966 raft_consensus.cc:385] T 5daf3681a6ba460385331aadffabfa8f P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:59.804451 29966 raft_consensus.cc:740] T 5daf3681a6ba460385331aadffabfa8f P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da72b03880d4414b034964abe86d4fe, State: Initialized, Role: FOLLOWER
I20260807 13:50:59.804407 29967 raft_consensus.cc:359] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:59.804631 29967 raft_consensus.cc:385] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:59.804721 29967 raft_consensus.cc:740] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ea2e5a5c2b0429985eb26f907033c9b, State: Initialized, Role: FOLLOWER
I20260807 13:50:59.804716 29966 consensus_queue.cc:260] T 5daf3681a6ba460385331aadffabfa8f P 9da72b03880d4414b034964abe86d4fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } }
I20260807 13:50:59.805095 29971 tablet_bootstrap.cc:492] T 04f1daf8b6a44274bf2cc578e93c8303 P c11aeb9ac7f04cceb63233785ce00503: No bootstrap required, opened a new log
I20260807 13:50:59.805230 29971 ts_tablet_manager.cc:1403] T 04f1daf8b6a44274bf2cc578e93c8303 P c11aeb9ac7f04cceb63233785ce00503: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20260807 13:50:59.805322 29966 ts_tablet_manager.cc:1434] T 5daf3681a6ba460385331aadffabfa8f P 9da72b03880d4414b034964abe86d4fe: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260807 13:50:59.805763 29966 tablet_bootstrap.cc:492] T f726c2f0034d4cc8b36c2f706f5e5b04 P 9da72b03880d4414b034964abe86d4fe: Bootstrap starting.
I20260807 13:50:59.806097 29971 raft_consensus.cc:359] T 04f1daf8b6a44274bf2cc578e93c8303 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:59.805009 29967 consensus_queue.cc:260] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:59.806667 29971 raft_consensus.cc:385] T 04f1daf8b6a44274bf2cc578e93c8303 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:59.806838 29971 raft_consensus.cc:740] T 04f1daf8b6a44274bf2cc578e93c8303 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c11aeb9ac7f04cceb63233785ce00503, State: Initialized, Role: FOLLOWER
I20260807 13:50:59.807161 29967 ts_tablet_manager.cc:1434] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 13:50:59.807180 29971 consensus_queue.cc:260] T 04f1daf8b6a44274bf2cc578e93c8303 P c11aeb9ac7f04cceb63233785ce00503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:59.807629 29966 tablet_bootstrap.cc:654] T f726c2f0034d4cc8b36c2f706f5e5b04 P 9da72b03880d4414b034964abe86d4fe: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:59.808851 29971 ts_tablet_manager.cc:1434] T 04f1daf8b6a44274bf2cc578e93c8303 P c11aeb9ac7f04cceb63233785ce00503: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260807 13:50:59.809170 29971 tablet_bootstrap.cc:492] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503: Bootstrap starting.
I20260807 13:50:59.812126 29971 tablet_bootstrap.cc:654] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503: Neither blocks nor log segments found. Creating new log.
I20260807 13:50:59.813269 29867 raft_consensus.cc:493] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:59.813464 29867 raft_consensus.cc:515] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } }
I20260807 13:50:59.814162 29867 leader_election.cc:290] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223)
I20260807 13:50:59.814823 29966 tablet_bootstrap.cc:492] T f726c2f0034d4cc8b36c2f706f5e5b04 P 9da72b03880d4414b034964abe86d4fe: No bootstrap required, opened a new log
I20260807 13:50:59.814893 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5daf3681a6ba460385331aadffabfa8f" candidate_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da72b03880d4414b034964abe86d4fe" is_pre_election: true
I20260807 13:50:59.815025 29966 ts_tablet_manager.cc:1403] T f726c2f0034d4cc8b36c2f706f5e5b04 P 9da72b03880d4414b034964abe86d4fe: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260807 13:50:59.815099 28749 raft_consensus.cc:2468] T 5daf3681a6ba460385331aadffabfa8f P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ea2e5a5c2b0429985eb26f907033c9b in term 0.
I20260807 13:50:59.815671 28493 leader_election.cc:304] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 0ea2e5a5c2b0429985eb26f907033c9b, 9da72b03880d4414b034964abe86d4fe; no voters:
I20260807 13:50:59.815940 29966 raft_consensus.cc:359] T f726c2f0034d4cc8b36c2f706f5e5b04 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:59.816068 29867 raft_consensus.cc:2804] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:59.816162 29966 raft_consensus.cc:385] T f726c2f0034d4cc8b36c2f706f5e5b04 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:59.816174 29867 raft_consensus.cc:493] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:59.816190 29971 tablet_bootstrap.cc:492] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503: No bootstrap required, opened a new log
I20260807 13:50:59.816237 29966 raft_consensus.cc:740] T f726c2f0034d4cc8b36c2f706f5e5b04 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da72b03880d4414b034964abe86d4fe, State: Initialized, Role: FOLLOWER
I20260807 13:50:59.816262 29867 raft_consensus.cc:3060] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:59.816345 29971 ts_tablet_manager.cc:1403] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260807 13:50:59.816512 29966 consensus_queue.cc:260] T f726c2f0034d4cc8b36c2f706f5e5b04 P 9da72b03880d4414b034964abe86d4fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:59.817013 29966 ts_tablet_manager.cc:1434] T f726c2f0034d4cc8b36c2f706f5e5b04 P 9da72b03880d4414b034964abe86d4fe: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260807 13:50:59.817202 29971 raft_consensus.cc:359] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:59.817412 29971 raft_consensus.cc:385] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:50:59.817492 29971 raft_consensus.cc:740] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c11aeb9ac7f04cceb63233785ce00503, State: Initialized, Role: FOLLOWER
I20260807 13:50:59.817798 29971 consensus_queue.cc:260] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:59.818368 29971 ts_tablet_manager.cc:1434] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260807 13:50:59.819480 29867 raft_consensus.cc:515] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } }
I20260807 13:50:59.820410 29867 leader_election.cc:290] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b [CANDIDATE]: Term 1 election: Requested vote from peers 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223)
I20260807 13:50:59.820518 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5daf3681a6ba460385331aadffabfa8f" candidate_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da72b03880d4414b034964abe86d4fe"
I20260807 13:50:59.820698 28749 raft_consensus.cc:3060] T 5daf3681a6ba460385331aadffabfa8f P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:59.823343 28749 raft_consensus.cc:2468] T 5daf3681a6ba460385331aadffabfa8f P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ea2e5a5c2b0429985eb26f907033c9b in term 1.
I20260807 13:50:59.823793 28493 leader_election.cc:304] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 0ea2e5a5c2b0429985eb26f907033c9b, 9da72b03880d4414b034964abe86d4fe; no voters:
I20260807 13:50:59.824071 29867 raft_consensus.cc:2804] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:59.824661 29867 raft_consensus.cc:697] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 LEADER]: Becoming Leader. State: Replica: 0ea2e5a5c2b0429985eb26f907033c9b, State: Running, Role: LEADER
I20260807 13:50:59.824946 29867 consensus_queue.cc:237] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } }
I20260807 13:50:59.827688 28388 catalog_manager.cc:5697] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129). New cstate: current_term: 1 leader_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } }
I20260807 13:50:59.908916 29867 raft_consensus.cc:493] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:50:59.909178 29867 raft_consensus.cc:515] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:59.909802 29867 leader_election.cc:290] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571)
I20260807 13:50:59.910533 28918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f1daf8b6a44274bf2cc578e93c8303" candidate_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c11aeb9ac7f04cceb63233785ce00503" is_pre_election: true
I20260807 13:50:59.910727 28918 raft_consensus.cc:2468] T 04f1daf8b6a44274bf2cc578e93c8303 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ea2e5a5c2b0429985eb26f907033c9b in term 0.
I20260807 13:50:59.911159 28493 leader_election.cc:304] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 0ea2e5a5c2b0429985eb26f907033c9b, c11aeb9ac7f04cceb63233785ce00503; no voters:
I20260807 13:50:59.911473 29867 raft_consensus.cc:2804] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:50:59.911578 29867 raft_consensus.cc:493] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:50:59.911669 29867 raft_consensus.cc:3060] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:59.913781 29867 raft_consensus.cc:515] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:59.914275 29867 leader_election.cc:290] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [CANDIDATE]: Term 1 election: Requested vote from peers c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571)
I20260807 13:50:59.914850 28918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f1daf8b6a44274bf2cc578e93c8303" candidate_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c11aeb9ac7f04cceb63233785ce00503"
I20260807 13:50:59.915057 28918 raft_consensus.cc:3060] T 04f1daf8b6a44274bf2cc578e93c8303 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:50:59.917171 28918 raft_consensus.cc:2468] T 04f1daf8b6a44274bf2cc578e93c8303 P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ea2e5a5c2b0429985eb26f907033c9b in term 1.
I20260807 13:50:59.917675 28493 leader_election.cc:304] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 0ea2e5a5c2b0429985eb26f907033c9b, c11aeb9ac7f04cceb63233785ce00503; no voters:
I20260807 13:50:59.917946 29867 raft_consensus.cc:2804] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:50:59.918157 29867 raft_consensus.cc:697] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 LEADER]: Becoming Leader. State: Replica: 0ea2e5a5c2b0429985eb26f907033c9b, State: Running, Role: LEADER
I20260807 13:50:59.918453 29867 consensus_queue.cc:237] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:50:59.921417 28388 catalog_manager.cc:5697] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129). New cstate: current_term: 1 leader_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } }
I20260807 13:51:00.108165 29729 raft_consensus.cc:493] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:51:00.108357 29729 raft_consensus.cc:515] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:51:00.109016 29729 leader_election.cc:290] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223)
I20260807 13:51:00.109719 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f726c2f0034d4cc8b36c2f706f5e5b04" candidate_uuid: "c11aeb9ac7f04cceb63233785ce00503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da72b03880d4414b034964abe86d4fe" is_pre_election: true
I20260807 13:51:00.109974 28749 raft_consensus.cc:2468] T f726c2f0034d4cc8b36c2f706f5e5b04 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c11aeb9ac7f04cceb63233785ce00503 in term 0.
I20260807 13:51:00.110489 28832 leader_election.cc:304] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 9da72b03880d4414b034964abe86d4fe, c11aeb9ac7f04cceb63233785ce00503; no voters:
I20260807 13:51:00.110802 29729 raft_consensus.cc:2804] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:51:00.110929 29729 raft_consensus.cc:493] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:51:00.111020 29729 raft_consensus.cc:3060] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:51:00.114106 29729 raft_consensus.cc:515] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:51:00.114663 29729 leader_election.cc:290] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 [CANDIDATE]: Term 1 election: Requested vote from peers 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223)
I20260807 13:51:00.115257 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f726c2f0034d4cc8b36c2f706f5e5b04" candidate_uuid: "c11aeb9ac7f04cceb63233785ce00503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da72b03880d4414b034964abe86d4fe"
I20260807 13:51:00.115495 28749 raft_consensus.cc:3060] T f726c2f0034d4cc8b36c2f706f5e5b04 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:51:00.118033 28749 raft_consensus.cc:2468] T f726c2f0034d4cc8b36c2f706f5e5b04 P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c11aeb9ac7f04cceb63233785ce00503 in term 1.
I20260807 13:51:00.118445 28832 leader_election.cc:304] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 9da72b03880d4414b034964abe86d4fe, c11aeb9ac7f04cceb63233785ce00503; no voters:
I20260807 13:51:00.118893 29729 raft_consensus.cc:2804] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:51:00.119390 29729 raft_consensus.cc:697] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 [term 1 LEADER]: Becoming Leader. State: Replica: c11aeb9ac7f04cceb63233785ce00503, State: Running, Role: LEADER
I20260807 13:51:00.119737 29729 consensus_queue.cc:237] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:51:00.122836 28388 catalog_manager.cc:5697] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 reported cstate change: term changed from 0 to 1, leader changed from <none> to c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131). New cstate: current_term: 1 leader_uuid: "c11aeb9ac7f04cceb63233785ce00503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } }
I20260807 13:51:00.245857 29867 consensus_queue.cc:1048] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:51:00.340016 29867 consensus_queue.cc:1048] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:51:00.548619 29984 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:51:00.549057 29984 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_3'
I20260807 13:51:00.616010 29729 consensus_queue.cc:1048] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 206.509 ms
time per row: 0.103255 ms
I20260807 13:51:00.921522 28384 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49002:
name: "rebalance_test_table_4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:51:00.932024 28553 tablet_service.cc:1511] Processing CreateTablet for tablet 1592525dd2a646de874117d51026e771 (DEFAULT_TABLE table=rebalance_test_table_4 [id=2b6a5ac0e14d42a0b4c4bcc31b2a8e84]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:51:00.932586 28553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1592525dd2a646de874117d51026e771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:51:00.932498 28725 tablet_service.cc:1511] Processing CreateTablet for tablet 1592525dd2a646de874117d51026e771 (DEFAULT_TABLE table=rebalance_test_table_4 [id=2b6a5ac0e14d42a0b4c4bcc31b2a8e84]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:51:00.932986 28725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1592525dd2a646de874117d51026e771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:51:00.933525 28895 tablet_service.cc:1511] Processing CreateTablet for tablet ba6d87b94369439dac8c8355d744a7f3 (DEFAULT_TABLE table=rebalance_test_table_4 [id=2b6a5ac0e14d42a0b4c4bcc31b2a8e84]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:51:00.933969 28895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba6d87b94369439dac8c8355d744a7f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:51:00.937790 28551 tablet_service.cc:1511] Processing CreateTablet for tablet 79268a57a70b4612aff6405c6d587f33 (DEFAULT_TABLE table=rebalance_test_table_4 [id=2b6a5ac0e14d42a0b4c4bcc31b2a8e84]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:51:00.937893 28894 tablet_service.cc:1511] Processing CreateTablet for tablet 79268a57a70b4612aff6405c6d587f33 (DEFAULT_TABLE table=rebalance_test_table_4 [id=2b6a5ac0e14d42a0b4c4bcc31b2a8e84]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:51:00.938192 28551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79268a57a70b4612aff6405c6d587f33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:51:00.938347 28894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79268a57a70b4612aff6405c6d587f33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:51:00.941148 28724 tablet_service.cc:1511] Processing CreateTablet for tablet ba6d87b94369439dac8c8355d744a7f3 (DEFAULT_TABLE table=rebalance_test_table_4 [id=2b6a5ac0e14d42a0b4c4bcc31b2a8e84]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:51:00.941638 28724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba6d87b94369439dac8c8355d744a7f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:51:00.948042 30058 tablet_bootstrap.cc:492] T 79268a57a70b4612aff6405c6d587f33 P 0ea2e5a5c2b0429985eb26f907033c9b: Bootstrap starting.
I20260807 13:51:00.948243 30057 tablet_bootstrap.cc:492] T ba6d87b94369439dac8c8355d744a7f3 P c11aeb9ac7f04cceb63233785ce00503: Bootstrap starting.
I20260807 13:51:00.948377 30056 tablet_bootstrap.cc:492] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe: Bootstrap starting.
I20260807 13:51:00.950392 30057 tablet_bootstrap.cc:654] T ba6d87b94369439dac8c8355d744a7f3 P c11aeb9ac7f04cceb63233785ce00503: Neither blocks nor log segments found. Creating new log.
I20260807 13:51:00.950533 30056 tablet_bootstrap.cc:654] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe: Neither blocks nor log segments found. Creating new log.
I20260807 13:51:00.952195 30058 tablet_bootstrap.cc:654] T 79268a57a70b4612aff6405c6d587f33 P 0ea2e5a5c2b0429985eb26f907033c9b: Neither blocks nor log segments found. Creating new log.
I20260807 13:51:00.952991 30057 tablet_bootstrap.cc:492] T ba6d87b94369439dac8c8355d744a7f3 P c11aeb9ac7f04cceb63233785ce00503: No bootstrap required, opened a new log
I20260807 13:51:00.953019 30056 tablet_bootstrap.cc:492] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe: No bootstrap required, opened a new log
I20260807 13:51:00.953197 30056 ts_tablet_manager.cc:1403] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260807 13:51:00.953210 30057 ts_tablet_manager.cc:1403] T ba6d87b94369439dac8c8355d744a7f3 P c11aeb9ac7f04cceb63233785ce00503: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260807 13:51:00.954030 30057 raft_consensus.cc:359] T ba6d87b94369439dac8c8355d744a7f3 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:51:00.954223 30057 raft_consensus.cc:385] T ba6d87b94369439dac8c8355d744a7f3 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:51:00.954327 30057 raft_consensus.cc:740] T ba6d87b94369439dac8c8355d744a7f3 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c11aeb9ac7f04cceb63233785ce00503, State: Initialized, Role: FOLLOWER
I20260807 13:51:00.954236 30056 raft_consensus.cc:359] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:51:00.954445 30056 raft_consensus.cc:385] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:51:00.954588 30056 raft_consensus.cc:740] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da72b03880d4414b034964abe86d4fe, State: Initialized, Role: FOLLOWER
I20260807 13:51:00.954598 30057 consensus_queue.cc:260] T ba6d87b94369439dac8c8355d744a7f3 P c11aeb9ac7f04cceb63233785ce00503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:51:00.954934 30058 tablet_bootstrap.cc:492] T 79268a57a70b4612aff6405c6d587f33 P 0ea2e5a5c2b0429985eb26f907033c9b: No bootstrap required, opened a new log
I20260807 13:51:00.954895 30056 consensus_queue.cc:260] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:51:00.955076 30058 ts_tablet_manager.cc:1403] T 79268a57a70b4612aff6405c6d587f33 P 0ea2e5a5c2b0429985eb26f907033c9b: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.001s
I20260807 13:51:00.955202 30057 ts_tablet_manager.cc:1434] T ba6d87b94369439dac8c8355d744a7f3 P c11aeb9ac7f04cceb63233785ce00503: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:51:00.955457 30056 ts_tablet_manager.cc:1434] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260807 13:51:00.955761 30056 tablet_bootstrap.cc:492] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe: Bootstrap starting.
I20260807 13:51:00.956110 30058 raft_consensus.cc:359] T 79268a57a70b4612aff6405c6d587f33 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:51:00.956318 30058 raft_consensus.cc:385] T 79268a57a70b4612aff6405c6d587f33 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:51:00.956445 30058 raft_consensus.cc:740] T 79268a57a70b4612aff6405c6d587f33 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ea2e5a5c2b0429985eb26f907033c9b, State: Initialized, Role: FOLLOWER
I20260807 13:51:00.956769 30058 consensus_queue.cc:260] T 79268a57a70b4612aff6405c6d587f33 P 0ea2e5a5c2b0429985eb26f907033c9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:51:00.956928 30057 tablet_bootstrap.cc:492] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503: Bootstrap starting.
I20260807 13:51:00.957440 30058 ts_tablet_manager.cc:1434] T 79268a57a70b4612aff6405c6d587f33 P 0ea2e5a5c2b0429985eb26f907033c9b: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260807 13:51:00.957778 30058 tablet_bootstrap.cc:492] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b: Bootstrap starting.
I20260807 13:51:00.957876 30056 tablet_bootstrap.cc:654] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe: Neither blocks nor log segments found. Creating new log.
I20260807 13:51:00.959546 30058 tablet_bootstrap.cc:654] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b: Neither blocks nor log segments found. Creating new log.
I20260807 13:51:00.962131 30057 tablet_bootstrap.cc:654] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503: Neither blocks nor log segments found. Creating new log.
I20260807 13:51:00.970084 30056 tablet_bootstrap.cc:492] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe: No bootstrap required, opened a new log
I20260807 13:51:00.970346 30056 ts_tablet_manager.cc:1403] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe: Time spent bootstrapping tablet: real 0.015s user 0.013s sys 0.001s
I20260807 13:51:00.971199 30057 tablet_bootstrap.cc:492] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503: No bootstrap required, opened a new log
I20260807 13:51:00.971402 30057 ts_tablet_manager.cc:1403] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.007s
I20260807 13:51:00.971371 30056 raft_consensus.cc:359] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:51:00.971597 30056 raft_consensus.cc:385] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:51:00.971704 30056 raft_consensus.cc:740] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da72b03880d4414b034964abe86d4fe, State: Initialized, Role: FOLLOWER
I20260807 13:51:00.972008 30058 tablet_bootstrap.cc:492] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b: No bootstrap required, opened a new log
I20260807 13:51:00.972075 30056 consensus_queue.cc:260] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:51:00.972276 30057 raft_consensus.cc:359] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:51:00.972563 30057 raft_consensus.cc:385] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:51:00.972658 30056 ts_tablet_manager.cc:1434] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260807 13:51:00.972663 30057 raft_consensus.cc:740] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c11aeb9ac7f04cceb63233785ce00503, State: Initialized, Role: FOLLOWER
I20260807 13:51:00.972955 30057 consensus_queue.cc:260] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:51:00.973526 30057 ts_tablet_manager.cc:1434] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260807 13:51:00.972242 30058 ts_tablet_manager.cc:1403] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.012s
I20260807 13:51:00.974489 30058 raft_consensus.cc:359] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:51:00.974725 30058 raft_consensus.cc:385] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:51:00.974817 30058 raft_consensus.cc:740] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ea2e5a5c2b0429985eb26f907033c9b, State: Initialized, Role: FOLLOWER
I20260807 13:51:00.975301 30058 consensus_queue.cc:260] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:51:00.976017 30058 ts_tablet_manager.cc:1434] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 13:51:01.077981 29982 raft_consensus.cc:493] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:51:01.078249 29982 raft_consensus.cc:515] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:51:01.079216 29982 leader_election.cc:290] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223)
I20260807 13:51:01.080128 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79268a57a70b4612aff6405c6d587f33" candidate_uuid: "c11aeb9ac7f04cceb63233785ce00503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" is_pre_election: true
I20260807 13:51:01.080418 28576 raft_consensus.cc:2468] T 79268a57a70b4612aff6405c6d587f33 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c11aeb9ac7f04cceb63233785ce00503 in term 0.
I20260807 13:51:01.080999 28835 leader_election.cc:304] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 0ea2e5a5c2b0429985eb26f907033c9b, c11aeb9ac7f04cceb63233785ce00503; no voters:
I20260807 13:51:01.081391 29982 raft_consensus.cc:2804] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:51:01.081564 29982 raft_consensus.cc:493] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:51:01.081688 29982 raft_consensus.cc:3060] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:51:01.083808 29982 raft_consensus.cc:515] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:51:01.084316 29982 leader_election.cc:290] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 [CANDIDATE]: Term 1 election: Requested vote from peers 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223)
I20260807 13:51:01.085024 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79268a57a70b4612aff6405c6d587f33" candidate_uuid: "c11aeb9ac7f04cceb63233785ce00503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ea2e5a5c2b0429985eb26f907033c9b"
I20260807 13:51:01.085296 28576 raft_consensus.cc:3060] T 79268a57a70b4612aff6405c6d587f33 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:51:01.089119 28576 raft_consensus.cc:2468] T 79268a57a70b4612aff6405c6d587f33 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c11aeb9ac7f04cceb63233785ce00503 in term 1.
I20260807 13:51:01.089869 28835 leader_election.cc:304] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 0ea2e5a5c2b0429985eb26f907033c9b, c11aeb9ac7f04cceb63233785ce00503; no voters:
I20260807 13:51:01.090270 29982 raft_consensus.cc:2804] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:51:01.090435 29982 raft_consensus.cc:697] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 [term 1 LEADER]: Becoming Leader. State: Replica: c11aeb9ac7f04cceb63233785ce00503, State: Running, Role: LEADER
I20260807 13:51:01.090725 29982 consensus_queue.cc:237] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } }
I20260807 13:51:01.094693 28388 catalog_manager.cc:5697] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 reported cstate change: term changed from 0 to 1, leader changed from <none> to c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131). New cstate: current_term: 1 leader_uuid: "c11aeb9ac7f04cceb63233785ce00503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } }
I20260807 13:51:01.106700 29720 raft_consensus.cc:493] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:51:01.106936 29720 raft_consensus.cc:515] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:51:01.107564 29720 leader_election.cc:290] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571)
I20260807 13:51:01.108330 28918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba6d87b94369439dac8c8355d744a7f3" candidate_uuid: "9da72b03880d4414b034964abe86d4fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c11aeb9ac7f04cceb63233785ce00503" is_pre_election: true
I20260807 13:51:01.108629 28918 raft_consensus.cc:2468] T ba6d87b94369439dac8c8355d744a7f3 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da72b03880d4414b034964abe86d4fe in term 0.
I20260807 13:51:01.109223 28662 leader_election.cc:304] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 9da72b03880d4414b034964abe86d4fe, c11aeb9ac7f04cceb63233785ce00503; no voters:
I20260807 13:51:01.109637 29720 raft_consensus.cc:2804] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:51:01.109778 29720 raft_consensus.cc:493] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:51:01.109884 29720 raft_consensus.cc:3060] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:51:01.112234 29720 raft_consensus.cc:515] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:51:01.112793 29720 leader_election.cc:290] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe [CANDIDATE]: Term 1 election: Requested vote from peers c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571)
I20260807 13:51:01.113431 28918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba6d87b94369439dac8c8355d744a7f3" candidate_uuid: "9da72b03880d4414b034964abe86d4fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c11aeb9ac7f04cceb63233785ce00503"
I20260807 13:51:01.113688 28918 raft_consensus.cc:3060] T ba6d87b94369439dac8c8355d744a7f3 P c11aeb9ac7f04cceb63233785ce00503 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:51:01.115741 28918 raft_consensus.cc:2468] T ba6d87b94369439dac8c8355d744a7f3 P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da72b03880d4414b034964abe86d4fe in term 1.
I20260807 13:51:01.116248 28662 leader_election.cc:304] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 9da72b03880d4414b034964abe86d4fe, c11aeb9ac7f04cceb63233785ce00503; no voters:
I20260807 13:51:01.116602 29720 raft_consensus.cc:2804] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:51:01.117065 29720 raft_consensus.cc:697] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe [term 1 LEADER]: Becoming Leader. State: Replica: 9da72b03880d4414b034964abe86d4fe, State: Running, Role: LEADER
I20260807 13:51:01.117447 29720 consensus_queue.cc:237] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:51:01.120236 28388 catalog_manager.cc:5697] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da72b03880d4414b034964abe86d4fe (127.23.107.130). New cstate: current_term: 1 leader_uuid: "9da72b03880d4414b034964abe86d4fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } }
I20260807 13:51:01.123847 29720 raft_consensus.cc:493] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:51:01.124064 29720 raft_consensus.cc:515] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:51:01.124549 29720 leader_election.cc:290] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223)
I20260807 13:51:01.125138 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1592525dd2a646de874117d51026e771" candidate_uuid: "9da72b03880d4414b034964abe86d4fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" is_pre_election: true
I20260807 13:51:01.125442 28576 raft_consensus.cc:2468] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da72b03880d4414b034964abe86d4fe in term 0.
I20260807 13:51:01.125980 28663 leader_election.cc:304] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 0ea2e5a5c2b0429985eb26f907033c9b, 9da72b03880d4414b034964abe86d4fe; no voters:
I20260807 13:51:01.126307 29720 raft_consensus.cc:2804] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:51:01.126416 29720 raft_consensus.cc:493] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:51:01.126529 29720 raft_consensus.cc:3060] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:51:01.128589 29720 raft_consensus.cc:515] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:51:01.129074 29720 leader_election.cc:290] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [CANDIDATE]: Term 1 election: Requested vote from peers 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223)
I20260807 13:51:01.129710 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1592525dd2a646de874117d51026e771" candidate_uuid: "9da72b03880d4414b034964abe86d4fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ea2e5a5c2b0429985eb26f907033c9b"
I20260807 13:51:01.129935 28576 raft_consensus.cc:3060] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:51:01.131981 28576 raft_consensus.cc:2468] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da72b03880d4414b034964abe86d4fe in term 1.
I20260807 13:51:01.132453 28663 leader_election.cc:304] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 0ea2e5a5c2b0429985eb26f907033c9b, 9da72b03880d4414b034964abe86d4fe; no voters:
I20260807 13:51:01.132805 29720 raft_consensus.cc:2804] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:51:01.133046 29720 raft_consensus.cc:697] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [term 1 LEADER]: Becoming Leader. State: Replica: 9da72b03880d4414b034964abe86d4fe, State: Running, Role: LEADER
I20260807 13:51:01.133363 29720 consensus_queue.cc:237] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } }
I20260807 13:51:01.136147 28388 catalog_manager.cc:5697] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da72b03880d4414b034964abe86d4fe (127.23.107.130). New cstate: current_term: 1 leader_uuid: "9da72b03880d4414b034964abe86d4fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } }
I20260807 13:51:01.527832 29982 consensus_queue.cc:1048] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:51:01.560549 30071 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:51:01.560933 30071 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_4'
I20260807 13:51:01.652474 29720 consensus_queue.cc:1048] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:51:01.667050 30111 consensus_queue.cc:1048] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 215.612 ms
time per row: 0.107806 ms
I20260807 13:51:01.997601 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.132:34213
--local_ip_for_outbound_sockets=127.23.107.132
--tserver_master_addrs=127.23.107.190:39563
--webserver_port=38737
--webserver_interface=127.23.107.132
--builtin_ntp_servers=127.23.107.148:41209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
W20260807 13:51:02.372198 30137 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:51:02.372505 30137 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:51:02.372665 30137 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:51:02.381582 30137 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:51:02.381685 30137 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:51:02.381870 30137 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.132
I20260807 13:51:02.392123 30137 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:41209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.132:34213
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.23.107.132
--webserver_port=38737
--tserver_master_addrs=127.23.107.190:39563
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.132
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:51:02.393959 30137 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:51:02.395884 30137 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:51:02.406301 30144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:51:02.406601 30147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:51:02.406639 30142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:51:02.407698 30137 server_base.cc:1061] running on GCE node
I20260807 13:51:02.408308 30137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:51:02.409195 30137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:51:02.410454 30137 hybrid_clock.cc:648] HybridClock initialized: now 1786110662410382 us; error 63 us; skew 500 ppm
I20260807 13:51:02.410766 30137 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:51:02.412972 30137 webserver.cc:533] Webserver started at http://127.23.107.132:38737/ using document root <none> and password file <none>
I20260807 13:51:02.413821 30137 fs_manager.cc:362] Metadata directory not provided
I20260807 13:51:02.413993 30137 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:51:02.419662 30137 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260807 13:51:02.422739 30156 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:51:02.424144 30137 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 13:51:02.424327 30137 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "c45d5217722649e6bdbccee30863591b"
format_stamp: "Formatted at 2026-08-07 13:50:50 on dist-test-slave-bw88"
I20260807 13:51:02.425144 30137 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:51:02.447317 30137 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:51:02.448261 30137 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:51:02.448561 30137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:51:02.449718 30137 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:51:02.451933 30168 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260807 13:51:02.458372 30137 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 13:51:02.458488 30137 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260807 13:51:02.458600 30137 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260807 13:51:02.461807 30137 ts_tablet_manager.cc:616] Registered 1 tablets
I20260807 13:51:02.461920 30137 ts_tablet_manager.cc:595] Time spent register tablets: real 0.003s user 0.003s sys 0.000s
I20260807 13:51:02.462461 30168 tablet_bootstrap.cc:492] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b: Bootstrap starting.
I20260807 13:51:02.484213 30168 log.cc:826] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b: Log is configured to *not* fsync() on all Append() calls
I20260807 13:51:02.488489 30168 tablet_bootstrap.cc:492] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:51:02.489099 30168 tablet_bootstrap.cc:492] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b: Bootstrap complete.
I20260807 13:51:02.491060 30168 ts_tablet_manager.cc:1403] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b: Time spent bootstrapping tablet: real 0.029s user 0.018s sys 0.008s
I20260807 13:51:02.501001 30168 raft_consensus.cc:359] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:51:02.502337 30168 raft_consensus.cc:740] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45d5217722649e6bdbccee30863591b, State: Initialized, Role: FOLLOWER
I20260807 13:51:02.503415 30168 consensus_queue.cc:260] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:51:02.505067 30168 ts_tablet_manager.cc:1434] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b: Time spent starting tablet: real 0.014s user 0.005s sys 0.008s
I20260807 13:51:02.512058 30137 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.132:34213
I20260807 13:51:02.512101 30313 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.132:34213 every 8 connection(s)
I20260807 13:51:02.513674 30137 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/info.pb
W20260807 13:51:02.515044 30315 tablet.cc:2406] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 13:51:02.521140 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 30137
I20260807 13:51:02.521860 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.133:34943
--local_ip_for_outbound_sockets=127.23.107.133
--tserver_master_addrs=127.23.107.190:39563
--webserver_port=33709
--webserver_interface=127.23.107.133
--builtin_ntp_servers=127.23.107.148:41209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260807 13:51:02.532236 30314 heartbeater.cc:344] Connected to a master server at 127.23.107.190:39563
I20260807 13:51:02.532629 30314 heartbeater.cc:461] Registering TS with master...
I20260807 13:51:02.533613 30314 heartbeater.cc:507] Master 127.23.107.190:39563 requested a full tablet report, sending...
I20260807 13:51:02.537042 28382 ts_manager.cc:194] Re-registered known tserver with Master: c45d5217722649e6bdbccee30863591b (127.23.107.132:34213)
I20260807 13:51:02.538890 28382 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.132:60101
W20260807 13:51:02.911886 30318 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:51:02.912240 30318 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:51:02.912315 30318 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:51:02.920991 30318 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:51:02.921109 30318 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:51:02.921257 30318 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.133
I20260807 13:51:02.931720 30318 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:41209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.133:34943
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.23.107.133
--webserver_port=33709
--tserver_master_addrs=127.23.107.190:39563
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.133
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:51:02.933605 30318 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:51:02.935606 30318 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:51:02.946976 30326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:51:02.947230 30328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:51:02.948001 30325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:51:02.954797 30318 server_base.cc:1061] running on GCE node
I20260807 13:51:02.955540 30318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:51:02.956554 30318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:51:02.957788 30318 hybrid_clock.cc:648] HybridClock initialized: now 1786110662957722 us; error 38 us; skew 500 ppm
I20260807 13:51:02.958129 30318 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:51:02.960670 30318 webserver.cc:533] Webserver started at http://127.23.107.133:33709/ using document root <none> and password file <none>
I20260807 13:51:02.961505 30318 fs_manager.cc:362] Metadata directory not provided
I20260807 13:51:02.961643 30318 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:51:02.967496 30318 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 13:51:02.970534 30334 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:51:02.972110 30318 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 13:51:02.972262 30318 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "ed5ae0647048435da282261048c04db2"
format_stamp: "Formatted at 2026-08-07 13:50:50 on dist-test-slave-bw88"
I20260807 13:51:02.973462 30318 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:51:02.996506 30318 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:51:02.997545 30318 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:51:02.997808 30318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:51:02.998893 30318 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:51:03.000722 30318 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:51:03.000844 30318 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:51:03.000983 30318 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:51:03.001084 30318 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:51:03.037920 30318 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.133:34943
I20260807 13:51:03.038005 30477 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.133:34943 every 8 connection(s)
I20260807 13:51:03.039669 30318 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20260807 13:51:03.049214 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 30318
I20260807 13:51:03.050110 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.134:41561
--local_ip_for_outbound_sockets=127.23.107.134
--tserver_master_addrs=127.23.107.190:39563
--webserver_port=41797
--webserver_interface=127.23.107.134
--builtin_ntp_servers=127.23.107.148:41209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260807 13:51:03.054327 30479 heartbeater.cc:344] Connected to a master server at 127.23.107.190:39563
I20260807 13:51:03.054709 30479 heartbeater.cc:461] Registering TS with master...
I20260807 13:51:03.055538 30479 heartbeater.cc:507] Master 127.23.107.190:39563 requested a full tablet report, sending...
I20260807 13:51:03.057363 28382 ts_manager.cc:194] Re-registered known tserver with Master: ed5ae0647048435da282261048c04db2 (127.23.107.133:34943)
I20260807 13:51:03.058460 28382 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.133:57151
W20260807 13:51:03.424356 30483 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:51:03.424728 30483 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:51:03.424904 30483 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:51:03.433954 30483 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:51:03.434063 30483 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:51:03.434247 30483 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.134
I20260807 13:51:03.444553 30483 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:41209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.134:41561
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--webserver_interface=127.23.107.134
--webserver_port=41797
--tserver_master_addrs=127.23.107.190:39563
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.134
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:51:03.446331 30483 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:51:03.448257 30483 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:51:03.459125 30490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:51:03.459205 30491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:51:03.460070 30494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:51:03.460434 30483 server_base.cc:1061] running on GCE node
I20260807 13:51:03.461200 30483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:51:03.462359 30483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:51:03.463580 30483 hybrid_clock.cc:648] HybridClock initialized: now 1786110663463494 us; error 39 us; skew 500 ppm
I20260807 13:51:03.463964 30483 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:51:03.466656 30483 webserver.cc:533] Webserver started at http://127.23.107.134:41797/ using document root <none> and password file <none>
I20260807 13:51:03.467418 30483 fs_manager.cc:362] Metadata directory not provided
I20260807 13:51:03.467564 30483 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:51:03.474336 30483 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 13:51:03.477468 30500 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:51:03.479070 30483 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 13:51:03.479211 30483 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal
uuid: "22b9a9a4b1bf44daa35fcecd47b8856a"
format_stamp: "Formatted at 2026-08-07 13:50:51 on dist-test-slave-bw88"
I20260807 13:51:03.479928 30483 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:51:03.500341 30483 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:51:03.501258 30483 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:51:03.501583 30483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:51:03.502594 30483 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:51:03.504918 30512 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260807 13:51:03.511588 30483 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 13:51:03.511722 30483 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260807 13:51:03.511886 30483 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260807 13:51:03.515671 30483 ts_tablet_manager.cc:616] Registered 1 tablets
I20260807 13:51:03.515771 30483 ts_tablet_manager.cc:595] Time spent register tablets: real 0.004s user 0.002s sys 0.000s
I20260807 13:51:03.516253 30512 tablet_bootstrap.cc:492] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a: Bootstrap starting.
I20260807 13:51:03.542642 30314 heartbeater.cc:499] Master 127.23.107.190:39563 was elected leader, sending a full tablet report...
I20260807 13:51:03.544545 30512 log.cc:826] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a: Log is configured to *not* fsync() on all Append() calls
I20260807 13:51:03.550230 30512 tablet_bootstrap.cc:492] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260807 13:51:03.551080 30512 tablet_bootstrap.cc:492] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a: Bootstrap complete.
I20260807 13:51:03.552784 30512 ts_tablet_manager.cc:1403] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a: Time spent bootstrapping tablet: real 0.037s user 0.025s sys 0.011s
I20260807 13:51:03.561532 30512 raft_consensus.cc:359] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:51:03.563262 30512 raft_consensus.cc:740] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22b9a9a4b1bf44daa35fcecd47b8856a, State: Initialized, Role: FOLLOWER
I20260807 13:51:03.564406 30512 consensus_queue.cc:260] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:51:03.566488 30512 ts_tablet_manager.cc:1434] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a: Time spent starting tablet: real 0.014s user 0.007s sys 0.005s
I20260807 13:51:03.567520 30483 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.134:41561
I20260807 13:51:03.567603 30668 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.134:41561 every 8 connection(s)
I20260807 13:51:03.569140 30483 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/info.pb
W20260807 13:51:03.570523 30670 tablet.cc:2406] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 13:51:03.576334 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 30483
I20260807 13:51:03.577154 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.135:39559
--local_ip_for_outbound_sockets=127.23.107.135
--tserver_master_addrs=127.23.107.190:39563
--webserver_port=34967
--webserver_interface=127.23.107.135
--builtin_ntp_servers=127.23.107.148:41209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260807 13:51:03.582939 30669 heartbeater.cc:344] Connected to a master server at 127.23.107.190:39563
I20260807 13:51:03.583300 30669 heartbeater.cc:461] Registering TS with master...
I20260807 13:51:03.584074 30669 heartbeater.cc:507] Master 127.23.107.190:39563 requested a full tablet report, sending...
I20260807 13:51:03.586862 28382 ts_manager.cc:194] Re-registered known tserver with Master: 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134:41561)
I20260807 13:51:03.588526 28382 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.134:35601
W20260807 13:51:03.954294 30674 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:51:03.954668 30674 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:51:03.954809 30674 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:51:03.963621 30674 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:51:03.963757 30674 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:51:03.963949 30674 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.135
I20260807 13:51:03.974757 30674 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:41209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.135:39559
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--webserver_interface=127.23.107.135
--webserver_port=34967
--tserver_master_addrs=127.23.107.190:39563
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.135
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:51:03.976590 30674 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:51:03.978597 30674 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:51:03.988778 30681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:51:03.989217 30682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:51:03.989465 30684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:51:03.990597 30674 server_base.cc:1061] running on GCE node
I20260807 13:51:03.991114 30674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:51:03.991961 30674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:51:03.993217 30674 hybrid_clock.cc:648] HybridClock initialized: now 1786110663993143 us; error 48 us; skew 500 ppm
I20260807 13:51:03.993556 30674 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:51:03.995923 30674 webserver.cc:533] Webserver started at http://127.23.107.135:34967/ using document root <none> and password file <none>
I20260807 13:51:03.996650 30674 fs_manager.cc:362] Metadata directory not provided
I20260807 13:51:03.996780 30674 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:51:04.002599 30674 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 13:51:04.005540 30692 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:51:04.006994 30674 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 13:51:04.007195 30674 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal
uuid: "f634a7b061e64a7caf1cb02a4731dadc"
format_stamp: "Formatted at 2026-08-07 13:50:51 on dist-test-slave-bw88"
I20260807 13:51:04.007975 30674 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:51:04.019726 30699 raft_consensus.cc:493] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:51:04.020011 30699 raft_consensus.cc:515] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:51:04.021893 30699 leader_election.cc:290] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134:41561)
I20260807 13:51:04.030211 30674 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:51:04.031251 30674 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:51:04.031561 30674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:51:04.031431 30599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024803a9deb6450dad724e4b614213e1" candidate_uuid: "c45d5217722649e6bdbccee30863591b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" is_pre_election: true
I20260807 13:51:04.031998 30599 raft_consensus.cc:2410] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c45d5217722649e6bdbccee30863591b for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:51:04.032709 30674 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:51:04.033555 30163 leader_election.cc:304] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: c45d5217722649e6bdbccee30863591b; no voters: 22b9a9a4b1bf44daa35fcecd47b8856a
I20260807 13:51:04.034003 30699 raft_consensus.cc:2749] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:51:04.035104 30674 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:51:04.035223 30674 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:51:04.035359 30674 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:51:04.035454 30674 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:51:04.062366 30479 heartbeater.cc:499] Master 127.23.107.190:39563 was elected leader, sending a full tablet report...
I20260807 13:51:04.074359 30674 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.135:39559
I20260807 13:51:04.074458 30842 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.135:39559 every 8 connection(s)
I20260807 13:51:04.076017 30674 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data/info.pb
I20260807 13:51:04.082226 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 30674
I20260807 13:51:04.093000 30843 heartbeater.cc:344] Connected to a master server at 127.23.107.190:39563
I20260807 13:51:04.093495 30843 heartbeater.cc:461] Registering TS with master...
I20260807 13:51:04.094349 30843 heartbeater.cc:507] Master 127.23.107.190:39563 requested a full tablet report, sending...
I20260807 13:51:04.096179 28382 ts_manager.cc:194] Re-registered known tserver with Master: f634a7b061e64a7caf1cb02a4731dadc (127.23.107.135:39559)
I20260807 13:51:04.097153 28382 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.135:35161
I20260807 13:51:04.102368 23982 test_workload.cc:405] TestWorkload: Skipping table creation because table rebalance_test_table_0 already exists
I20260807 13:51:04.121785 23982 test_workload.cc:405] TestWorkload: Skipping table creation because table rebalance_test_table_1 already exists
I20260807 13:51:04.160322 23982 test_workload.cc:405] TestWorkload: Skipping table creation because table rebalance_test_table_2 already exists
I20260807 13:51:04.242304 23982 test_workload.cc:405] TestWorkload: Skipping table creation because table rebalance_test_table_3 already exists
W20260807 13:51:04.314515 30892 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.GetTableLocations -> {remote=127.23.107.190:39563, user_credentials={real_user=slave}} blocked reactor thread for 43879us
I20260807 13:51:04.355571 23982 test_workload.cc:405] TestWorkload: Skipping table creation because table rebalance_test_table_4 already exists
I20260807 13:51:04.591959 30669 heartbeater.cc:499] Master 127.23.107.190:39563 was elected leader, sending a full tablet report...
I20260807 13:51:04.887005 30961 raft_consensus.cc:493] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:51:04.887351 30961 raft_consensus.cc:515] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:51:04.944780 30961 leader_election.cc:290] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c45d5217722649e6bdbccee30863591b (127.23.107.132:34213)
I20260807 13:51:04.947710 30248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024803a9deb6450dad724e4b614213e1" candidate_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45d5217722649e6bdbccee30863591b" is_pre_election: true
I20260807 13:51:04.948167 30248 raft_consensus.cc:2468] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22b9a9a4b1bf44daa35fcecd47b8856a in term 1.
I20260807 13:51:04.949384 30504 leader_election.cc:304] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 22b9a9a4b1bf44daa35fcecd47b8856a, c45d5217722649e6bdbccee30863591b; no voters:
I20260807 13:51:04.950121 30961 raft_consensus.cc:2804] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:51:04.950274 30961 raft_consensus.cc:493] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:51:04.950382 30961 raft_consensus.cc:3060] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:51:04.956620 30961 raft_consensus.cc:515] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:51:04.957800 30248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024803a9deb6450dad724e4b614213e1" candidate_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c45d5217722649e6bdbccee30863591b"
I20260807 13:51:04.958040 30248 raft_consensus.cc:3060] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:51:04.964242 30248 raft_consensus.cc:2468] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22b9a9a4b1bf44daa35fcecd47b8856a in term 2.
I20260807 13:51:04.964835 30504 leader_election.cc:304] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 22b9a9a4b1bf44daa35fcecd47b8856a, c45d5217722649e6bdbccee30863591b; no voters:
I20260807 13:51:04.979084 30968 raft_consensus.cc:2804] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:51:04.979211 30961 leader_election.cc:290] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [CANDIDATE]: Term 2 election: Requested vote from peers c45d5217722649e6bdbccee30863591b (127.23.107.132:34213)
I20260807 13:51:04.989136 30968 raft_consensus.cc:697] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 2 LEADER]: Becoming Leader. State: Replica: 22b9a9a4b1bf44daa35fcecd47b8856a, State: Running, Role: LEADER
I20260807 13:51:04.989868 30968 consensus_queue.cc:237] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:51:04.998145 28383 catalog_manager.cc:5697] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
I20260807 13:51:05.100229 30843 heartbeater.cc:499] Master 127.23.107.190:39563 was elected leader, sending a full tablet report...
I20260807 13:51:05.556088 30248 raft_consensus.cc:1275] T 024803a9deb6450dad724e4b614213e1 P c45d5217722649e6bdbccee30863591b [term 2 FOLLOWER]: Refusing update from remote peer 22b9a9a4b1bf44daa35fcecd47b8856a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:51:05.562813 30995 consensus_queue.cc:1048] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:51:06.176623 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:51:06.177430 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:51:06.227938 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:51:06.318616 28724 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:51:06.378307 30758 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:06.424245 30396 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:06.474509 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:07.285116 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:51:07.323428 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:51:07.441759 28724 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:51:07.607789 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:51:07.718585 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:07.778124 30396 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:07.977836 30758 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:08.370759 28920 consensus_queue.cc:237] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 56, Committed index: 56, Last appended: 1.56, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 57 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } }
I20260807 13:51:08.374212 28575 raft_consensus.cc:1275] T 79268a57a70b4612aff6405c6d587f33 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Refusing update from remote peer c11aeb9ac7f04cceb63233785ce00503: Log matching property violated. Preceding OpId in replica: term: 1 index: 56. Preceding OpId from leader: term: 1 index: 57. (index mismatch)
I20260807 13:51:08.375000 30958 consensus_queue.cc:1048] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 57, Last known committed idx: 56, Time since last communication: 0.000s
I20260807 13:51:08.379987 31053 raft_consensus.cc:2955] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 [term 1 LEADER]: Committing config change with OpId 1.57: config changed from index -1 to 57, VOTER f634a7b061e64a7caf1cb02a4731dadc (127.23.107.135) added. New config: { opid_index: 57 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } }
I20260807 13:51:08.380633 28577 raft_consensus.cc:2955] T 79268a57a70b4612aff6405c6d587f33 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Committing config change with OpId 1.57: config changed from index -1 to 57, VOTER f634a7b061e64a7caf1cb02a4731dadc (127.23.107.135) added. New config: { opid_index: 57 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } }
I20260807 13:51:08.387944 28394 catalog_manager.cc:5697] T 79268a57a70b4612aff6405c6d587f33 P 0ea2e5a5c2b0429985eb26f907033c9b reported cstate change: config changed from index -1 to 57, VOTER f634a7b061e64a7caf1cb02a4731dadc (127.23.107.135) added. New cstate: current_term: 1 leader_uuid: "c11aeb9ac7f04cceb63233785ce00503" committed_config { opid_index: 57 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } }
W20260807 13:51:08.410892 28831 consensus_peers.cc:597] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 -> Peer f634a7b061e64a7caf1cb02a4731dadc (127.23.107.135:39559): Couldn't send request to peer f634a7b061e64a7caf1cb02a4731dadc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 79268a57a70b4612aff6405c6d587f33. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:51:08.624940 28577 consensus_queue.cc:237] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 85, Committed index: 85, Last appended: 1.85, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 86 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } }
I20260807 13:51:08.630306 28920 raft_consensus.cc:1275] T f9f996c0ec5849d98b1cc0fc83cc51a6 P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Refusing update from remote peer 0ea2e5a5c2b0429985eb26f907033c9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 85. Preceding OpId from leader: term: 1 index: 86. (index mismatch)
I20260807 13:51:08.631102 31012 consensus_queue.cc:1048] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 86, Last known committed idx: 85, Time since last communication: 0.000s
I20260807 13:51:08.634464 30932 raft_consensus.cc:2955] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 LEADER]: Committing config change with OpId 1.86: config changed from index -1 to 86, VOTER ed5ae0647048435da282261048c04db2 (127.23.107.133) added. New config: { opid_index: 86 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } } }
I20260807 13:51:08.635059 28920 raft_consensus.cc:2955] T f9f996c0ec5849d98b1cc0fc83cc51a6 P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Committing config change with OpId 1.86: config changed from index -1 to 86, VOTER ed5ae0647048435da282261048c04db2 (127.23.107.133) added. New config: { opid_index: 86 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } } }
I20260807 13:51:08.651489 28383 catalog_manager.cc:5697] T f9f996c0ec5849d98b1cc0fc83cc51a6 P c11aeb9ac7f04cceb63233785ce00503 reported cstate change: config changed from index -1 to 86, VOTER ed5ae0647048435da282261048c04db2 (127.23.107.133) added. New cstate: current_term: 1 leader_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" committed_config { opid_index: 86 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } } }
W20260807 13:51:08.704133 28490 consensus_peers.cc:597] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b -> Peer ed5ae0647048435da282261048c04db2 (127.23.107.133:34943): Couldn't send request to peer ed5ae0647048435da282261048c04db2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f9f996c0ec5849d98b1cc0fc83cc51a6. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:51:08.756140 31199 ts_tablet_manager.cc:933] T 79268a57a70b4612aff6405c6d587f33 P f634a7b061e64a7caf1cb02a4731dadc: Initiating tablet copy from peer c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571)
I20260807 13:51:08.769817 31199 tablet_copy_client.cc:323] T 79268a57a70b4612aff6405c6d587f33 P f634a7b061e64a7caf1cb02a4731dadc: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:41571
I20260807 13:51:08.825258 28943 tablet_copy_service.cc:140] P c11aeb9ac7f04cceb63233785ce00503: Received BeginTabletCopySession request for tablet 79268a57a70b4612aff6405c6d587f33 from peer f634a7b061e64a7caf1cb02a4731dadc ({username='slave'} at 127.23.107.135:33097)
I20260807 13:51:08.825677 28943 tablet_copy_service.cc:161] P c11aeb9ac7f04cceb63233785ce00503: Beginning new tablet copy session on tablet 79268a57a70b4612aff6405c6d587f33 from peer f634a7b061e64a7caf1cb02a4731dadc at {username='slave'} at 127.23.107.135:33097: session id = f634a7b061e64a7caf1cb02a4731dadc-79268a57a70b4612aff6405c6d587f33
I20260807 13:51:08.832331 28943 tablet_copy_source_session.cc:215] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:51:08.849711 31199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79268a57a70b4612aff6405c6d587f33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:51:08.865877 31199 tablet_copy_client.cc:806] T 79268a57a70b4612aff6405c6d587f33 P f634a7b061e64a7caf1cb02a4731dadc: tablet copy: Starting download of 0 data blocks...
I20260807 13:51:08.866434 31199 tablet_copy_client.cc:670] T 79268a57a70b4612aff6405c6d587f33 P f634a7b061e64a7caf1cb02a4731dadc: tablet copy: Starting download of 1 WAL segments...
I20260807 13:51:08.907903 31199 tablet_copy_client.cc:538] T 79268a57a70b4612aff6405c6d587f33 P f634a7b061e64a7caf1cb02a4731dadc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:51:08.913821 31199 tablet_bootstrap.cc:492] T 79268a57a70b4612aff6405c6d587f33 P f634a7b061e64a7caf1cb02a4731dadc: Bootstrap starting.
I20260807 13:51:08.986779 31199 log.cc:826] T 79268a57a70b4612aff6405c6d587f33 P f634a7b061e64a7caf1cb02a4731dadc: Log is configured to *not* fsync() on all Append() calls
I20260807 13:51:09.032241 28917 consensus_queue.cc:237] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 88, Committed index: 88, Last appended: 1.88, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 89 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
W20260807 13:51:09.078852 28832 consensus_peers.cc:597] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 -> Peer 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134:41561): Couldn't send request to peer 22b9a9a4b1bf44daa35fcecd47b8856a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c72c9d7fb3364b2485475585dc6f244a. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:51:09.082011 28746 raft_consensus.cc:1275] T c72c9d7fb3364b2485475585dc6f244a P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Refusing update from remote peer c11aeb9ac7f04cceb63233785ce00503: Log matching property violated. Preceding OpId in replica: term: 1 index: 88. Preceding OpId from leader: term: 1 index: 89. (index mismatch)
I20260807 13:51:09.084216 29729 consensus_queue.cc:1048] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 89, Last known committed idx: 88, Time since last communication: 0.000s
I20260807 13:51:09.123380 31053 raft_consensus.cc:2955] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [term 1 LEADER]: Committing config change with OpId 1.89: config changed from index -1 to 89, VOTER 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134) added. New config: { opid_index: 89 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
I20260807 13:51:09.123977 31211 ts_tablet_manager.cc:933] T f9f996c0ec5849d98b1cc0fc83cc51a6 P ed5ae0647048435da282261048c04db2: Initiating tablet copy from peer 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223)
I20260807 13:51:09.139424 28394 catalog_manager.cc:5697] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 reported cstate change: config changed from index -1 to 89, VOTER 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134) added. New cstate: current_term: 1 leader_uuid: "c11aeb9ac7f04cceb63233785ce00503" committed_config { opid_index: 89 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
I20260807 13:51:09.144865 28748 raft_consensus.cc:2955] T c72c9d7fb3364b2485475585dc6f244a P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Committing config change with OpId 1.89: config changed from index -1 to 89, VOTER 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134) added. New config: { opid_index: 89 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
I20260807 13:51:09.173938 31211 tablet_copy_client.cc:323] T f9f996c0ec5849d98b1cc0fc83cc51a6 P ed5ae0647048435da282261048c04db2: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:37223
I20260807 13:51:09.207139 28602 tablet_copy_service.cc:140] P 0ea2e5a5c2b0429985eb26f907033c9b: Received BeginTabletCopySession request for tablet f9f996c0ec5849d98b1cc0fc83cc51a6 from peer ed5ae0647048435da282261048c04db2 ({username='slave'} at 127.23.107.133:56241)
I20260807 13:51:09.207485 28602 tablet_copy_service.cc:161] P 0ea2e5a5c2b0429985eb26f907033c9b: Beginning new tablet copy session on tablet f9f996c0ec5849d98b1cc0fc83cc51a6 from peer ed5ae0647048435da282261048c04db2 at {username='slave'} at 127.23.107.133:56241: session id = ed5ae0647048435da282261048c04db2-f9f996c0ec5849d98b1cc0fc83cc51a6
I20260807 13:51:09.211175 31199 tablet_bootstrap.cc:492] T 79268a57a70b4612aff6405c6d587f33 P f634a7b061e64a7caf1cb02a4731dadc: Bootstrap replayed 1/1 log segments. Stats: ops{read=64 overwritten=0 applied=64 ignored=0} inserts{seen=695 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:51:09.211838 31199 tablet_bootstrap.cc:492] T 79268a57a70b4612aff6405c6d587f33 P f634a7b061e64a7caf1cb02a4731dadc: Bootstrap complete.
I20260807 13:51:09.212141 28602 tablet_copy_source_session.cc:215] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:51:09.212615 31199 ts_tablet_manager.cc:1403] T 79268a57a70b4612aff6405c6d587f33 P f634a7b061e64a7caf1cb02a4731dadc: Time spent bootstrapping tablet: real 0.299s user 0.129s sys 0.021s
I20260807 13:51:09.218570 31199 raft_consensus.cc:359] T 79268a57a70b4612aff6405c6d587f33 P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 57 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } }
I20260807 13:51:09.219170 31199 raft_consensus.cc:740] T 79268a57a70b4612aff6405c6d587f33 P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f634a7b061e64a7caf1cb02a4731dadc, State: Initialized, Role: FOLLOWER
I20260807 13:51:09.223318 31211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9f996c0ec5849d98b1cc0fc83cc51a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:51:09.234990 31199 consensus_queue.cc:260] T 79268a57a70b4612aff6405c6d587f33 P f634a7b061e64a7caf1cb02a4731dadc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 64, Last appended: 1.64, Last appended by leader: 64, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 57 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } }
I20260807 13:51:09.241082 31211 tablet_copy_client.cc:806] T f9f996c0ec5849d98b1cc0fc83cc51a6 P ed5ae0647048435da282261048c04db2: tablet copy: Starting download of 0 data blocks...
I20260807 13:51:09.241626 31211 tablet_copy_client.cc:670] T f9f996c0ec5849d98b1cc0fc83cc51a6 P ed5ae0647048435da282261048c04db2: tablet copy: Starting download of 1 WAL segments...
I20260807 13:51:09.248450 31211 tablet_copy_client.cc:538] T f9f996c0ec5849d98b1cc0fc83cc51a6 P ed5ae0647048435da282261048c04db2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:51:09.254745 31211 tablet_bootstrap.cc:492] T f9f996c0ec5849d98b1cc0fc83cc51a6 P ed5ae0647048435da282261048c04db2: Bootstrap starting.
I20260807 13:51:09.258782 31199 ts_tablet_manager.cc:1434] T 79268a57a70b4612aff6405c6d587f33 P f634a7b061e64a7caf1cb02a4731dadc: Time spent starting tablet: real 0.046s user 0.006s sys 0.003s
I20260807 13:51:09.271448 28943 tablet_copy_service.cc:342] P c11aeb9ac7f04cceb63233785ce00503: Request end of tablet copy session f634a7b061e64a7caf1cb02a4731dadc-79268a57a70b4612aff6405c6d587f33 received from {username='slave'} at 127.23.107.135:33097
I20260807 13:51:09.271842 28943 tablet_copy_service.cc:434] P c11aeb9ac7f04cceb63233785ce00503: ending tablet copy session f634a7b061e64a7caf1cb02a4731dadc-79268a57a70b4612aff6405c6d587f33 on tablet 79268a57a70b4612aff6405c6d587f33 with peer f634a7b061e64a7caf1cb02a4731dadc
I20260807 13:51:09.300815 31211 log.cc:826] T f9f996c0ec5849d98b1cc0fc83cc51a6 P ed5ae0647048435da282261048c04db2: Log is configured to *not* fsync() on all Append() calls
I20260807 13:51:09.301328 30784 raft_consensus.cc:1217] T 79268a57a70b4612aff6405c6d587f33 P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.56->[1.57-1.74] Dedup: 1.64->[1.65-1.74]
I20260807 13:51:09.485076 31211 tablet_bootstrap.cc:492] T f9f996c0ec5849d98b1cc0fc83cc51a6 P ed5ae0647048435da282261048c04db2: Bootstrap replayed 1/1 log segments. Stats: ops{read=95 overwritten=0 applied=95 ignored=0} inserts{seen=780 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:51:09.486090 31211 tablet_bootstrap.cc:492] T f9f996c0ec5849d98b1cc0fc83cc51a6 P ed5ae0647048435da282261048c04db2: Bootstrap complete.
I20260807 13:51:09.487265 31211 ts_tablet_manager.cc:1403] T f9f996c0ec5849d98b1cc0fc83cc51a6 P ed5ae0647048435da282261048c04db2: Time spent bootstrapping tablet: real 0.234s user 0.177s sys 0.017s
I20260807 13:51:09.500005 31240 ts_tablet_manager.cc:933] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a: Initiating tablet copy from peer c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571)
I20260807 13:51:09.500903 31211 raft_consensus.cc:359] T f9f996c0ec5849d98b1cc0fc83cc51a6 P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 86 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } }
I20260807 13:51:09.501566 31211 raft_consensus.cc:740] T f9f996c0ec5849d98b1cc0fc83cc51a6 P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed5ae0647048435da282261048c04db2, State: Initialized, Role: FOLLOWER
I20260807 13:51:09.506369 31211 consensus_queue.cc:260] T f9f996c0ec5849d98b1cc0fc83cc51a6 P ed5ae0647048435da282261048c04db2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 95, Last appended: 1.95, Last appended by leader: 95, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 86 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } }
I20260807 13:51:09.511886 31240 tablet_copy_client.cc:323] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:41571
I20260807 13:51:09.531229 28943 tablet_copy_service.cc:140] P c11aeb9ac7f04cceb63233785ce00503: Received BeginTabletCopySession request for tablet c72c9d7fb3364b2485475585dc6f244a from peer 22b9a9a4b1bf44daa35fcecd47b8856a ({username='slave'} at 127.23.107.134:51579)
I20260807 13:51:09.531476 28943 tablet_copy_service.cc:161] P c11aeb9ac7f04cceb63233785ce00503: Beginning new tablet copy session on tablet c72c9d7fb3364b2485475585dc6f244a from peer 22b9a9a4b1bf44daa35fcecd47b8856a at {username='slave'} at 127.23.107.134:51579: session id = 22b9a9a4b1bf44daa35fcecd47b8856a-c72c9d7fb3364b2485475585dc6f244a
I20260807 13:51:09.534969 28943 tablet_copy_source_session.cc:215] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:51:09.538203 31240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72c9d7fb3364b2485475585dc6f244a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:51:09.544727 31211 ts_tablet_manager.cc:1434] T f9f996c0ec5849d98b1cc0fc83cc51a6 P ed5ae0647048435da282261048c04db2: Time spent starting tablet: real 0.057s user 0.007s sys 0.022s
I20260807 13:51:09.546293 28602 tablet_copy_service.cc:342] P 0ea2e5a5c2b0429985eb26f907033c9b: Request end of tablet copy session ed5ae0647048435da282261048c04db2-f9f996c0ec5849d98b1cc0fc83cc51a6 received from {username='slave'} at 127.23.107.133:56241
I20260807 13:51:09.546553 28602 tablet_copy_service.cc:434] P 0ea2e5a5c2b0429985eb26f907033c9b: ending tablet copy session ed5ae0647048435da282261048c04db2-f9f996c0ec5849d98b1cc0fc83cc51a6 on tablet f9f996c0ec5849d98b1cc0fc83cc51a6 with peer ed5ae0647048435da282261048c04db2
I20260807 13:51:09.552839 31240 tablet_copy_client.cc:806] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a: tablet copy: Starting download of 0 data blocks...
I20260807 13:51:09.553272 31240 tablet_copy_client.cc:670] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a: tablet copy: Starting download of 1 WAL segments...
I20260807 13:51:09.577857 31240 tablet_copy_client.cc:538] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:51:09.583706 31240 tablet_bootstrap.cc:492] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a: Bootstrap starting.
I20260807 13:51:09.833818 31240 tablet_bootstrap.cc:492] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a: Bootstrap replayed 1/1 log segments. Stats: ops{read=94 overwritten=0 applied=93 ignored=0} inserts{seen=765 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260807 13:51:09.834460 31240 tablet_bootstrap.cc:492] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a: Bootstrap complete.
I20260807 13:51:09.834842 31240 ts_tablet_manager.cc:1403] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a: Time spent bootstrapping tablet: real 0.251s user 0.171s sys 0.015s
I20260807 13:51:09.836081 31240 raft_consensus.cc:359] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 89 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:51:09.896370 28746 consensus_queue.cc:237] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 95, Committed index: 95, Last appended: 1.95, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 96 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } }
I20260807 13:51:09.900730 31240 raft_consensus.cc:740] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22b9a9a4b1bf44daa35fcecd47b8856a, State: Initialized, Role: FOLLOWER
I20260807 13:51:09.901589 31240 consensus_queue.cc:260] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 93, Last appended: 1.94, Last appended by leader: 94, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 89 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:51:09.907709 31240 ts_tablet_manager.cc:1434] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a: Time spent starting tablet: real 0.073s user 0.030s sys 0.019s
I20260807 13:51:09.912498 28577 raft_consensus.cc:1275] T 3da3196623e04606aca463b8847ab6cd P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Refusing update from remote peer 9da72b03880d4414b034964abe86d4fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 95. Preceding OpId from leader: term: 1 index: 96. (index mismatch)
I20260807 13:51:09.914688 31180 consensus_queue.cc:1048] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 96, Last known committed idx: 95, Time since last communication: 0.000s
I20260807 13:51:09.924819 30599 raft_consensus.cc:1217] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.88->[1.89-1.99] Dedup: 1.94->[1.95-1.99]
I20260807 13:51:09.926352 31180 raft_consensus.cc:2955] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe [term 1 LEADER]: Committing config change with OpId 1.96: config changed from index -1 to 96, VOTER c45d5217722649e6bdbccee30863591b (127.23.107.132) added. New config: { opid_index: 96 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } }
I20260807 13:51:09.927263 28577 raft_consensus.cc:2955] T 3da3196623e04606aca463b8847ab6cd P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Committing config change with OpId 1.96: config changed from index -1 to 96, VOTER c45d5217722649e6bdbccee30863591b (127.23.107.132) added. New config: { opid_index: 96 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } }
I20260807 13:51:09.933444 28383 catalog_manager.cc:5697] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe reported cstate change: config changed from index -1 to 96, VOTER c45d5217722649e6bdbccee30863591b (127.23.107.132) added. New cstate: current_term: 1 leader_uuid: "9da72b03880d4414b034964abe86d4fe" committed_config { opid_index: 96 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } }
W20260807 13:51:10.036361 28662 consensus_peers.cc:597] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe -> Peer c45d5217722649e6bdbccee30863591b (127.23.107.132:34213): Couldn't send request to peer c45d5217722649e6bdbccee30863591b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3da3196623e04606aca463b8847ab6cd. This is attempt 1: this message will repeat every 5th retry.
W20260807 13:51:10.038489 30504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:34213, user_credentials={real_user=slave}} blocked reactor thread for 131200us
I20260807 13:51:10.039736 28943 tablet_copy_service.cc:342] P c11aeb9ac7f04cceb63233785ce00503: Request end of tablet copy session 22b9a9a4b1bf44daa35fcecd47b8856a-c72c9d7fb3364b2485475585dc6f244a received from {username='slave'} at 127.23.107.134:51579
I20260807 13:51:10.039898 28943 tablet_copy_service.cc:434] P c11aeb9ac7f04cceb63233785ce00503: ending tablet copy session 22b9a9a4b1bf44daa35fcecd47b8856a-c72c9d7fb3364b2485475585dc6f244a on tablet c72c9d7fb3364b2485475585dc6f244a with peer 22b9a9a4b1bf44daa35fcecd47b8856a
I20260807 13:51:10.090574 30421 raft_consensus.cc:1217] T f9f996c0ec5849d98b1cc0fc83cc51a6 P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.85->[1.86-1.100] Dedup: 1.95->[1.96-1.100]
I20260807 13:51:10.311429 28749 consensus_queue.cc:237] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 96, Committed index: 96, Last appended: 1.96, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 97 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } }
I20260807 13:51:10.315734 28915 raft_consensus.cc:1275] T ae179f753242471eb4484553d9df106b P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Refusing update from remote peer 9da72b03880d4414b034964abe86d4fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 96. Preceding OpId from leader: term: 1 index: 97. (index mismatch)
I20260807 13:51:10.316749 30901 consensus_queue.cc:1048] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 97, Last known committed idx: 96, Time since last communication: 0.000s
I20260807 13:51:10.320485 30901 raft_consensus.cc:2955] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe [term 1 LEADER]: Committing config change with OpId 1.97: config changed from index -1 to 97, VOTER f634a7b061e64a7caf1cb02a4731dadc (127.23.107.135) added. New config: { opid_index: 97 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } }
I20260807 13:51:10.321138 28915 raft_consensus.cc:2955] T ae179f753242471eb4484553d9df106b P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Committing config change with OpId 1.97: config changed from index -1 to 97, VOTER f634a7b061e64a7caf1cb02a4731dadc (127.23.107.135) added. New config: { opid_index: 97 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } }
I20260807 13:51:10.332857 28394 catalog_manager.cc:5697] T ae179f753242471eb4484553d9df106b P c11aeb9ac7f04cceb63233785ce00503 reported cstate change: config changed from index -1 to 97, VOTER f634a7b061e64a7caf1cb02a4731dadc (127.23.107.135) added. New cstate: current_term: 1 leader_uuid: "9da72b03880d4414b034964abe86d4fe" committed_config { opid_index: 97 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } }
W20260807 13:51:10.359128 28661 consensus_peers.cc:597] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe -> Peer f634a7b061e64a7caf1cb02a4731dadc (127.23.107.135:39559): Couldn't send request to peer f634a7b061e64a7caf1cb02a4731dadc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ae179f753242471eb4484553d9df106b. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:51:10.509745 31329 ts_tablet_manager.cc:933] T 3da3196623e04606aca463b8847ab6cd P c45d5217722649e6bdbccee30863591b: Initiating tablet copy from peer 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223)
I20260807 13:51:10.520248 28576 consensus_queue.cc:237] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 106, Committed index: 106, Last appended: 1.106, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 107 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } }
W20260807 13:51:10.529851 28490 consensus_peers.cc:597] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b -> Peer ed5ae0647048435da282261048c04db2 (127.23.107.133:34943): Couldn't send request to peer ed5ae0647048435da282261048c04db2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5daf3681a6ba460385331aadffabfa8f. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:51:10.535154 31329 tablet_copy_client.cc:323] T 3da3196623e04606aca463b8847ab6cd P c45d5217722649e6bdbccee30863591b: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.130:43223
I20260807 13:51:10.555904 28746 raft_consensus.cc:1275] T 5daf3681a6ba460385331aadffabfa8f P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Refusing update from remote peer 0ea2e5a5c2b0429985eb26f907033c9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 106. Preceding OpId from leader: term: 1 index: 107. (index mismatch)
I20260807 13:51:10.558108 30932 consensus_queue.cc:1048] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 107, Last known committed idx: 106, Time since last communication: 0.000s
I20260807 13:51:10.575685 30932 raft_consensus.cc:2955] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 LEADER]: Committing config change with OpId 1.107: config changed from index -1 to 107, VOTER ed5ae0647048435da282261048c04db2 (127.23.107.133) added. New config: { opid_index: 107 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } } }
I20260807 13:51:10.581315 28749 raft_consensus.cc:2955] T 5daf3681a6ba460385331aadffabfa8f P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Committing config change with OpId 1.107: config changed from index -1 to 107, VOTER ed5ae0647048435da282261048c04db2 (127.23.107.133) added. New config: { opid_index: 107 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } } }
I20260807 13:51:10.594368 28394 catalog_manager.cc:5697] T 5daf3681a6ba460385331aadffabfa8f P 9da72b03880d4414b034964abe86d4fe reported cstate change: config changed from index -1 to 107, VOTER ed5ae0647048435da282261048c04db2 (127.23.107.133) added. New cstate: current_term: 1 leader_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" committed_config { opid_index: 107 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } } }
I20260807 13:51:10.600112 28778 tablet_copy_service.cc:140] P 9da72b03880d4414b034964abe86d4fe: Received BeginTabletCopySession request for tablet 3da3196623e04606aca463b8847ab6cd from peer c45d5217722649e6bdbccee30863591b ({username='slave'} at 127.23.107.132:60087)
I20260807 13:51:10.600420 28778 tablet_copy_service.cc:161] P 9da72b03880d4414b034964abe86d4fe: Beginning new tablet copy session on tablet 3da3196623e04606aca463b8847ab6cd from peer c45d5217722649e6bdbccee30863591b at {username='slave'} at 127.23.107.132:60087: session id = c45d5217722649e6bdbccee30863591b-3da3196623e04606aca463b8847ab6cd
I20260807 13:51:10.605775 28778 tablet_copy_source_session.cc:215] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:51:10.609457 31329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3da3196623e04606aca463b8847ab6cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:51:10.634877 31329 tablet_copy_client.cc:806] T 3da3196623e04606aca463b8847ab6cd P c45d5217722649e6bdbccee30863591b: tablet copy: Starting download of 0 data blocks...
I20260807 13:51:10.650350 31329 tablet_copy_client.cc:670] T 3da3196623e04606aca463b8847ab6cd P c45d5217722649e6bdbccee30863591b: tablet copy: Starting download of 1 WAL segments...
I20260807 13:51:10.661816 31329 tablet_copy_client.cc:538] T 3da3196623e04606aca463b8847ab6cd P c45d5217722649e6bdbccee30863591b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:51:10.666167 31329 tablet_bootstrap.cc:492] T 3da3196623e04606aca463b8847ab6cd P c45d5217722649e6bdbccee30863591b: Bootstrap starting.
I20260807 13:51:10.789529 31348 ts_tablet_manager.cc:933] T ae179f753242471eb4484553d9df106b P f634a7b061e64a7caf1cb02a4731dadc: Initiating tablet copy from peer 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223)
I20260807 13:51:10.808300 31348 tablet_copy_client.cc:323] T ae179f753242471eb4484553d9df106b P f634a7b061e64a7caf1cb02a4731dadc: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.130:43223
I20260807 13:51:10.888111 28778 tablet_copy_service.cc:140] P 9da72b03880d4414b034964abe86d4fe: Received BeginTabletCopySession request for tablet ae179f753242471eb4484553d9df106b from peer f634a7b061e64a7caf1cb02a4731dadc ({username='slave'} at 127.23.107.135:34775)
I20260807 13:51:10.888357 28778 tablet_copy_service.cc:161] P 9da72b03880d4414b034964abe86d4fe: Beginning new tablet copy session on tablet ae179f753242471eb4484553d9df106b from peer f634a7b061e64a7caf1cb02a4731dadc at {username='slave'} at 127.23.107.135:34775: session id = f634a7b061e64a7caf1cb02a4731dadc-ae179f753242471eb4484553d9df106b
I20260807 13:51:10.891552 28778 tablet_copy_source_session.cc:215] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:51:10.893640 31348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae179f753242471eb4484553d9df106b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:51:10.913177 31348 tablet_copy_client.cc:806] T ae179f753242471eb4484553d9df106b P f634a7b061e64a7caf1cb02a4731dadc: tablet copy: Starting download of 0 data blocks...
I20260807 13:51:10.913627 31348 tablet_copy_client.cc:670] T ae179f753242471eb4484553d9df106b P f634a7b061e64a7caf1cb02a4731dadc: tablet copy: Starting download of 1 WAL segments...
I20260807 13:51:10.933389 31348 tablet_copy_client.cc:538] T ae179f753242471eb4484553d9df106b P f634a7b061e64a7caf1cb02a4731dadc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:51:10.944435 31348 tablet_bootstrap.cc:492] T ae179f753242471eb4484553d9df106b P f634a7b061e64a7caf1cb02a4731dadc: Bootstrap starting.
I20260807 13:51:10.979887 31355 ts_tablet_manager.cc:933] T 5daf3681a6ba460385331aadffabfa8f P ed5ae0647048435da282261048c04db2: Initiating tablet copy from peer 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223)
I20260807 13:51:10.991659 31355 tablet_copy_client.cc:323] T 5daf3681a6ba460385331aadffabfa8f P ed5ae0647048435da282261048c04db2: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:37223
I20260807 13:51:10.992808 28602 tablet_copy_service.cc:140] P 0ea2e5a5c2b0429985eb26f907033c9b: Received BeginTabletCopySession request for tablet 5daf3681a6ba460385331aadffabfa8f from peer ed5ae0647048435da282261048c04db2 ({username='slave'} at 127.23.107.133:56241)
I20260807 13:51:10.993038 28602 tablet_copy_service.cc:161] P 0ea2e5a5c2b0429985eb26f907033c9b: Beginning new tablet copy session on tablet 5daf3681a6ba460385331aadffabfa8f from peer ed5ae0647048435da282261048c04db2 at {username='slave'} at 127.23.107.133:56241: session id = ed5ae0647048435da282261048c04db2-5daf3681a6ba460385331aadffabfa8f
I20260807 13:51:10.996299 28602 tablet_copy_source_session.cc:215] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:51:10.998644 31355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5daf3681a6ba460385331aadffabfa8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:51:11.014621 31355 tablet_copy_client.cc:806] T 5daf3681a6ba460385331aadffabfa8f P ed5ae0647048435da282261048c04db2: tablet copy: Starting download of 0 data blocks...
I20260807 13:51:11.015102 31355 tablet_copy_client.cc:670] T 5daf3681a6ba460385331aadffabfa8f P ed5ae0647048435da282261048c04db2: tablet copy: Starting download of 1 WAL segments...
I20260807 13:51:11.017413 31355 tablet_copy_client.cc:538] T 5daf3681a6ba460385331aadffabfa8f P ed5ae0647048435da282261048c04db2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:51:11.036055 31355 tablet_bootstrap.cc:492] T 5daf3681a6ba460385331aadffabfa8f P ed5ae0647048435da282261048c04db2: Bootstrap starting.
I20260807 13:51:11.250638 28572 consensus_queue.cc:237] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 114, Committed index: 114, Last appended: 1.114, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 115 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:51:11.335860 28916 raft_consensus.cc:1275] T 7a7f0c232a674615a2cf5c3c06abd8a8 P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Refusing update from remote peer 0ea2e5a5c2b0429985eb26f907033c9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 114. Preceding OpId from leader: term: 1 index: 115. (index mismatch)
I20260807 13:51:11.353945 30932 consensus_queue.cc:1048] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 115, Last known committed idx: 114, Time since last communication: 0.000s
I20260807 13:51:11.364472 30932 raft_consensus.cc:2955] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 LEADER]: Committing config change with OpId 1.115: config changed from index -1 to 115, VOTER 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134) added. New config: { opid_index: 115 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
I20260807 13:51:11.374409 28383 catalog_manager.cc:5697] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b reported cstate change: config changed from index -1 to 115, VOTER 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134) added. New cstate: current_term: 1 leader_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" committed_config { opid_index: 115 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
I20260807 13:51:11.381093 28916 raft_consensus.cc:2955] T 7a7f0c232a674615a2cf5c3c06abd8a8 P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Committing config change with OpId 1.115: config changed from index -1 to 115, VOTER 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134) added. New config: { opid_index: 115 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
W20260807 13:51:11.386179 28493 consensus_peers.cc:597] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b -> Peer 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134:41561): Couldn't send request to peer 22b9a9a4b1bf44daa35fcecd47b8856a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7a7f0c232a674615a2cf5c3c06abd8a8. This is attempt 1: this message will repeat every 5th retry.
W20260807 13:51:11.417765 31348 log.cc:927] Time spent T ae179f753242471eb4484553d9df106b P f634a7b061e64a7caf1cb02a4731dadc: Append to log took a long time: real 0.068s user 0.000s sys 0.000s
I20260807 13:51:11.451027 31329 tablet_bootstrap.cc:492] T 3da3196623e04606aca463b8847ab6cd P c45d5217722649e6bdbccee30863591b: Bootstrap replayed 1/1 log segments. Stats: ops{read=102 overwritten=0 applied=102 ignored=0} inserts{seen=787 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:51:11.451728 31329 tablet_bootstrap.cc:492] T 3da3196623e04606aca463b8847ab6cd P c45d5217722649e6bdbccee30863591b: Bootstrap complete.
I20260807 13:51:11.452154 31329 ts_tablet_manager.cc:1403] T 3da3196623e04606aca463b8847ab6cd P c45d5217722649e6bdbccee30863591b: Time spent bootstrapping tablet: real 0.786s user 0.174s sys 0.055s
I20260807 13:51:11.453785 31329 raft_consensus.cc:359] T 3da3196623e04606aca463b8847ab6cd P c45d5217722649e6bdbccee30863591b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 96 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } }
I20260807 13:51:11.454130 31329 raft_consensus.cc:740] T 3da3196623e04606aca463b8847ab6cd P c45d5217722649e6bdbccee30863591b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45d5217722649e6bdbccee30863591b, State: Initialized, Role: FOLLOWER
I20260807 13:51:11.456305 31329 consensus_queue.cc:260] T 3da3196623e04606aca463b8847ab6cd P c45d5217722649e6bdbccee30863591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 102, Last appended: 1.102, Last appended by leader: 102, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 96 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } }
I20260807 13:51:11.471211 31329 ts_tablet_manager.cc:1434] T 3da3196623e04606aca463b8847ab6cd P c45d5217722649e6bdbccee30863591b: Time spent starting tablet: real 0.019s user 0.002s sys 0.006s
I20260807 13:51:11.486244 31355 tablet_bootstrap.cc:492] T 5daf3681a6ba460385331aadffabfa8f P ed5ae0647048435da282261048c04db2: Bootstrap replayed 1/1 log segments. Stats: ops{read=110 overwritten=0 applied=110 ignored=0} inserts{seen=795 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:51:11.486861 31355 tablet_bootstrap.cc:492] T 5daf3681a6ba460385331aadffabfa8f P ed5ae0647048435da282261048c04db2: Bootstrap complete.
I20260807 13:51:11.487205 31355 ts_tablet_manager.cc:1403] T 5daf3681a6ba460385331aadffabfa8f P ed5ae0647048435da282261048c04db2: Time spent bootstrapping tablet: real 0.451s user 0.169s sys 0.026s
I20260807 13:51:11.488334 31355 raft_consensus.cc:359] T 5daf3681a6ba460385331aadffabfa8f P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 107 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } }
I20260807 13:51:11.488618 31355 raft_consensus.cc:740] T 5daf3681a6ba460385331aadffabfa8f P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed5ae0647048435da282261048c04db2, State: Initialized, Role: FOLLOWER
I20260807 13:51:11.488920 31355 consensus_queue.cc:260] T 5daf3681a6ba460385331aadffabfa8f P ed5ae0647048435da282261048c04db2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 110, Last appended: 1.110, Last appended by leader: 110, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 107 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } }
I20260807 13:51:11.506711 31355 ts_tablet_manager.cc:1434] T 5daf3681a6ba460385331aadffabfa8f P ed5ae0647048435da282261048c04db2: Time spent starting tablet: real 0.019s user 0.012s sys 0.006s
I20260807 13:51:11.507596 28602 tablet_copy_service.cc:342] P 0ea2e5a5c2b0429985eb26f907033c9b: Request end of tablet copy session ed5ae0647048435da282261048c04db2-5daf3681a6ba460385331aadffabfa8f received from {username='slave'} at 127.23.107.133:56241
I20260807 13:51:11.507761 28602 tablet_copy_service.cc:434] P 0ea2e5a5c2b0429985eb26f907033c9b: ending tablet copy session ed5ae0647048435da282261048c04db2-5daf3681a6ba460385331aadffabfa8f on tablet 5daf3681a6ba460385331aadffabfa8f with peer ed5ae0647048435da282261048c04db2
I20260807 13:51:11.537647 28778 tablet_copy_service.cc:342] P 9da72b03880d4414b034964abe86d4fe: Request end of tablet copy session c45d5217722649e6bdbccee30863591b-3da3196623e04606aca463b8847ab6cd received from {username='slave'} at 127.23.107.132:60087
I20260807 13:51:11.537887 28778 tablet_copy_service.cc:434] P 9da72b03880d4414b034964abe86d4fe: ending tablet copy session c45d5217722649e6bdbccee30863591b-3da3196623e04606aca463b8847ab6cd on tablet 3da3196623e04606aca463b8847ab6cd with peer c45d5217722649e6bdbccee30863591b
I20260807 13:51:11.689726 31348 tablet_bootstrap.cc:492] T ae179f753242471eb4484553d9df106b P f634a7b061e64a7caf1cb02a4731dadc: Bootstrap replayed 1/1 log segments. Stats: ops{read=109 overwritten=0 applied=108 ignored=0} inserts{seen=780 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260807 13:51:11.690637 31348 tablet_bootstrap.cc:492] T ae179f753242471eb4484553d9df106b P f634a7b061e64a7caf1cb02a4731dadc: Bootstrap complete.
I20260807 13:51:11.691195 31348 ts_tablet_manager.cc:1403] T ae179f753242471eb4484553d9df106b P f634a7b061e64a7caf1cb02a4731dadc: Time spent bootstrapping tablet: real 0.747s user 0.192s sys 0.016s
I20260807 13:51:11.693079 31348 raft_consensus.cc:359] T ae179f753242471eb4484553d9df106b P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 97 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } }
I20260807 13:51:11.694075 31348 raft_consensus.cc:740] T ae179f753242471eb4484553d9df106b P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f634a7b061e64a7caf1cb02a4731dadc, State: Initialized, Role: FOLLOWER
I20260807 13:51:11.694507 31348 consensus_queue.cc:260] T ae179f753242471eb4484553d9df106b P f634a7b061e64a7caf1cb02a4731dadc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 108, Last appended: 1.109, Last appended by leader: 109, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 97 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } }
I20260807 13:51:11.702291 31348 ts_tablet_manager.cc:1434] T ae179f753242471eb4484553d9df106b P f634a7b061e64a7caf1cb02a4731dadc: Time spent starting tablet: real 0.011s user 0.009s sys 0.000s
I20260807 13:51:11.708264 28778 tablet_copy_service.cc:342] P 9da72b03880d4414b034964abe86d4fe: Request end of tablet copy session f634a7b061e64a7caf1cb02a4731dadc-ae179f753242471eb4484553d9df106b received from {username='slave'} at 127.23.107.135:34775
I20260807 13:51:11.708431 28778 tablet_copy_service.cc:434] P 9da72b03880d4414b034964abe86d4fe: ending tablet copy session f634a7b061e64a7caf1cb02a4731dadc-ae179f753242471eb4484553d9df106b on tablet ae179f753242471eb4484553d9df106b with peer f634a7b061e64a7caf1cb02a4731dadc
I20260807 13:51:11.726621 31393 ts_tablet_manager.cc:933] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 22b9a9a4b1bf44daa35fcecd47b8856a: Initiating tablet copy from peer 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223)
I20260807 13:51:11.875586 30784 raft_consensus.cc:1217] T ae179f753242471eb4484553d9df106b P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.96->[1.97-1.118] Dedup: 1.109->[1.110-1.118]
I20260807 13:51:11.874568 30248 raft_consensus.cc:1217] T 3da3196623e04606aca463b8847ab6cd P c45d5217722649e6bdbccee30863591b [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.95->[1.96-1.122] Dedup: 1.102->[1.103-1.122]
I20260807 13:51:11.881743 28749 consensus_queue.cc:237] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 103, Committed index: 103, Last appended: 1.104, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 105 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } }
I20260807 13:51:11.884022 28575 raft_consensus.cc:1275] T 3fefa1bc622f43ca8344ddfe3522ce46 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Refusing update from remote peer 9da72b03880d4414b034964abe86d4fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 104. Preceding OpId from leader: term: 1 index: 105. (index mismatch)
I20260807 13:51:11.884747 31287 consensus_queue.cc:1048] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 105, Last known committed idx: 103, Time since last communication: 0.000s
W20260807 13:51:11.885609 28662 consensus_peers.cc:597] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe -> Peer c45d5217722649e6bdbccee30863591b (127.23.107.132:34213): Couldn't send request to peer c45d5217722649e6bdbccee30863591b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3fefa1bc622f43ca8344ddfe3522ce46. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:51:11.887163 30901 raft_consensus.cc:2955] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [term 1 LEADER]: Committing config change with OpId 1.105: config changed from index -1 to 105, VOTER c45d5217722649e6bdbccee30863591b (127.23.107.132) added. New config: { opid_index: 105 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } }
I20260807 13:51:11.893383 28575 raft_consensus.cc:2955] T 3fefa1bc622f43ca8344ddfe3522ce46 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Committing config change with OpId 1.105: config changed from index -1 to 105, VOTER c45d5217722649e6bdbccee30863591b (127.23.107.132) added. New config: { opid_index: 105 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } }
I20260807 13:51:11.901211 28394 catalog_manager.cc:5697] T 3fefa1bc622f43ca8344ddfe3522ce46 P 0ea2e5a5c2b0429985eb26f907033c9b reported cstate change: config changed from index -1 to 105, VOTER c45d5217722649e6bdbccee30863591b (127.23.107.132) added. New cstate: current_term: 1 leader_uuid: "9da72b03880d4414b034964abe86d4fe" committed_config { opid_index: 105 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } }
I20260807 13:51:11.958817 31393 tablet_copy_client.cc:323] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 22b9a9a4b1bf44daa35fcecd47b8856a: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:37223
I20260807 13:51:11.989748 28602 tablet_copy_service.cc:140] P 0ea2e5a5c2b0429985eb26f907033c9b: Received BeginTabletCopySession request for tablet 7a7f0c232a674615a2cf5c3c06abd8a8 from peer 22b9a9a4b1bf44daa35fcecd47b8856a ({username='slave'} at 127.23.107.134:46697)
I20260807 13:51:11.990000 28602 tablet_copy_service.cc:161] P 0ea2e5a5c2b0429985eb26f907033c9b: Beginning new tablet copy session on tablet 7a7f0c232a674615a2cf5c3c06abd8a8 from peer 22b9a9a4b1bf44daa35fcecd47b8856a at {username='slave'} at 127.23.107.134:46697: session id = 22b9a9a4b1bf44daa35fcecd47b8856a-7a7f0c232a674615a2cf5c3c06abd8a8
I20260807 13:51:11.998914 28602 tablet_copy_source_session.cc:215] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:51:12.009208 31393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a7f0c232a674615a2cf5c3c06abd8a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:51:12.095008 30420 raft_consensus.cc:1217] T 5daf3681a6ba460385331aadffabfa8f P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.106->[1.107-1.116] Dedup: 1.110->[1.111-1.116]
I20260807 13:51:12.103214 31393 tablet_copy_client.cc:806] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 22b9a9a4b1bf44daa35fcecd47b8856a: tablet copy: Starting download of 0 data blocks...
I20260807 13:51:12.103704 31393 tablet_copy_client.cc:670] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 22b9a9a4b1bf44daa35fcecd47b8856a: tablet copy: Starting download of 1 WAL segments...
I20260807 13:51:12.131942 31393 tablet_copy_client.cc:538] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 22b9a9a4b1bf44daa35fcecd47b8856a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:51:12.164606 31393 tablet_bootstrap.cc:492] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 22b9a9a4b1bf44daa35fcecd47b8856a: Bootstrap starting.
I20260807 13:51:12.366947 28577 consensus_queue.cc:237] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 125, Committed index: 125, Last appended: 1.125, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 126 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } }
W20260807 13:51:12.375032 28662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:34213, user_credentials={real_user=slave}} blocked reactor thread for 132716us
I20260807 13:51:12.403595 28920 raft_consensus.cc:1275] T 04f1daf8b6a44274bf2cc578e93c8303 P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Refusing update from remote peer 0ea2e5a5c2b0429985eb26f907033c9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 125. Preceding OpId from leader: term: 1 index: 126. (index mismatch)
I20260807 13:51:12.404667 31012 consensus_queue.cc:1048] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 126, Last known committed idx: 125, Time since last communication: 0.000s
I20260807 13:51:12.408268 31012 raft_consensus.cc:2955] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 LEADER]: Committing config change with OpId 1.126: config changed from index -1 to 126, VOTER f634a7b061e64a7caf1cb02a4731dadc (127.23.107.135) added. New config: { opid_index: 126 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } }
I20260807 13:51:12.411067 28916 raft_consensus.cc:2955] T 04f1daf8b6a44274bf2cc578e93c8303 P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Committing config change with OpId 1.126: config changed from index -1 to 126, VOTER f634a7b061e64a7caf1cb02a4731dadc (127.23.107.135) added. New config: { opid_index: 126 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } }
I20260807 13:51:12.416612 31459 ts_tablet_manager.cc:933] T 3fefa1bc622f43ca8344ddfe3522ce46 P c45d5217722649e6bdbccee30863591b: Initiating tablet copy from peer 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223)
I20260807 13:51:12.417420 28383 catalog_manager.cc:5697] T 04f1daf8b6a44274bf2cc578e93c8303 P c11aeb9ac7f04cceb63233785ce00503 reported cstate change: config changed from index -1 to 126, VOTER f634a7b061e64a7caf1cb02a4731dadc (127.23.107.135) added. New cstate: current_term: 1 leader_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" committed_config { opid_index: 126 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } }
I20260807 13:51:12.439735 31459 tablet_copy_client.cc:323] T 3fefa1bc622f43ca8344ddfe3522ce46 P c45d5217722649e6bdbccee30863591b: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.130:43223
I20260807 13:51:12.440560 28778 tablet_copy_service.cc:140] P 9da72b03880d4414b034964abe86d4fe: Received BeginTabletCopySession request for tablet 3fefa1bc622f43ca8344ddfe3522ce46 from peer c45d5217722649e6bdbccee30863591b ({username='slave'} at 127.23.107.132:60087)
I20260807 13:51:12.440744 28778 tablet_copy_service.cc:161] P 9da72b03880d4414b034964abe86d4fe: Beginning new tablet copy session on tablet 3fefa1bc622f43ca8344ddfe3522ce46 from peer c45d5217722649e6bdbccee30863591b at {username='slave'} at 127.23.107.132:60087: session id = c45d5217722649e6bdbccee30863591b-3fefa1bc622f43ca8344ddfe3522ce46
I20260807 13:51:12.444190 28778 tablet_copy_source_session.cc:215] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:51:12.445617 31459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fefa1bc622f43ca8344ddfe3522ce46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:51:12.453442 31459 tablet_copy_client.cc:806] T 3fefa1bc622f43ca8344ddfe3522ce46 P c45d5217722649e6bdbccee30863591b: tablet copy: Starting download of 0 data blocks...
I20260807 13:51:12.453766 31459 tablet_copy_client.cc:670] T 3fefa1bc622f43ca8344ddfe3522ce46 P c45d5217722649e6bdbccee30863591b: tablet copy: Starting download of 1 WAL segments...
I20260807 13:51:12.455968 31459 tablet_copy_client.cc:538] T 3fefa1bc622f43ca8344ddfe3522ce46 P c45d5217722649e6bdbccee30863591b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:51:12.459673 31459 tablet_bootstrap.cc:492] T 3fefa1bc622f43ca8344ddfe3522ce46 P c45d5217722649e6bdbccee30863591b: Bootstrap starting.
I20260807 13:51:12.670712 31393 tablet_bootstrap.cc:492] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 22b9a9a4b1bf44daa35fcecd47b8856a: Bootstrap replayed 1/1 log segments. Stats: ops{read=124 overwritten=0 applied=124 ignored=0} inserts{seen=755 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:51:12.671406 31393 tablet_bootstrap.cc:492] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 22b9a9a4b1bf44daa35fcecd47b8856a: Bootstrap complete.
I20260807 13:51:12.671852 31393 ts_tablet_manager.cc:1403] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 22b9a9a4b1bf44daa35fcecd47b8856a: Time spent bootstrapping tablet: real 0.535s user 0.198s sys 0.017s
I20260807 13:51:12.672845 31393 raft_consensus.cc:359] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 115 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:51:12.673170 31393 raft_consensus.cc:740] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22b9a9a4b1bf44daa35fcecd47b8856a, State: Initialized, Role: FOLLOWER
I20260807 13:51:12.673552 31393 consensus_queue.cc:260] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 22b9a9a4b1bf44daa35fcecd47b8856a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 124, Last appended: 1.124, Last appended by leader: 124, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 115 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:51:12.674230 31393 ts_tablet_manager.cc:1434] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 22b9a9a4b1bf44daa35fcecd47b8856a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:51:12.675041 28602 tablet_copy_service.cc:342] P 0ea2e5a5c2b0429985eb26f907033c9b: Request end of tablet copy session 22b9a9a4b1bf44daa35fcecd47b8856a-7a7f0c232a674615a2cf5c3c06abd8a8 received from {username='slave'} at 127.23.107.134:46697
I20260807 13:51:12.675215 28602 tablet_copy_service.cc:434] P 0ea2e5a5c2b0429985eb26f907033c9b: ending tablet copy session 22b9a9a4b1bf44daa35fcecd47b8856a-7a7f0c232a674615a2cf5c3c06abd8a8 on tablet 7a7f0c232a674615a2cf5c3c06abd8a8 with peer 22b9a9a4b1bf44daa35fcecd47b8856a
W20260807 13:51:12.698896 28490 consensus_peers.cc:597] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b -> Peer f634a7b061e64a7caf1cb02a4731dadc (127.23.107.135:39559): Couldn't send request to peer f634a7b061e64a7caf1cb02a4731dadc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 04f1daf8b6a44274bf2cc578e93c8303. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:51:12.740278 31459 tablet_bootstrap.cc:492] T 3fefa1bc622f43ca8344ddfe3522ce46 P c45d5217722649e6bdbccee30863591b: Bootstrap replayed 1/1 log segments. Stats: ops{read=110 overwritten=0 applied=109 ignored=0} inserts{seen=794 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260807 13:51:12.740978 31459 tablet_bootstrap.cc:492] T 3fefa1bc622f43ca8344ddfe3522ce46 P c45d5217722649e6bdbccee30863591b: Bootstrap complete.
I20260807 13:51:12.741425 31459 ts_tablet_manager.cc:1403] T 3fefa1bc622f43ca8344ddfe3522ce46 P c45d5217722649e6bdbccee30863591b: Time spent bootstrapping tablet: real 0.282s user 0.186s sys 0.009s
I20260807 13:51:12.741501 30599 raft_consensus.cc:1217] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.114->[1.115-1.128] Dedup: 1.124->[1.125-1.128]
I20260807 13:51:12.752424 31459 raft_consensus.cc:359] T 3fefa1bc622f43ca8344ddfe3522ce46 P c45d5217722649e6bdbccee30863591b [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 105 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } }
I20260807 13:51:12.756690 31459 raft_consensus.cc:740] T 3fefa1bc622f43ca8344ddfe3522ce46 P c45d5217722649e6bdbccee30863591b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45d5217722649e6bdbccee30863591b, State: Initialized, Role: FOLLOWER
I20260807 13:51:12.757115 31459 consensus_queue.cc:260] T 3fefa1bc622f43ca8344ddfe3522ce46 P c45d5217722649e6bdbccee30863591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 109, Last appended: 1.110, Last appended by leader: 110, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 105 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } }
I20260807 13:51:12.768667 31459 ts_tablet_manager.cc:1434] T 3fefa1bc622f43ca8344ddfe3522ce46 P c45d5217722649e6bdbccee30863591b: Time spent starting tablet: real 0.027s user 0.000s sys 0.004s
I20260807 13:51:12.772125 28778 tablet_copy_service.cc:342] P 9da72b03880d4414b034964abe86d4fe: Request end of tablet copy session c45d5217722649e6bdbccee30863591b-3fefa1bc622f43ca8344ddfe3522ce46 received from {username='slave'} at 127.23.107.132:60087
I20260807 13:51:12.772307 28778 tablet_copy_service.cc:434] P 9da72b03880d4414b034964abe86d4fe: ending tablet copy session c45d5217722649e6bdbccee30863591b-3fefa1bc622f43ca8344ddfe3522ce46 on tablet 3fefa1bc622f43ca8344ddfe3522ce46 with peer c45d5217722649e6bdbccee30863591b
I20260807 13:51:12.875548 30248 raft_consensus.cc:1217] T 3fefa1bc622f43ca8344ddfe3522ce46 P c45d5217722649e6bdbccee30863591b [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.104->[1.105-1.114] Dedup: 1.110->[1.111-1.114]
I20260807 13:51:12.973132 31487 ts_tablet_manager.cc:933] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc: Initiating tablet copy from peer 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223)
I20260807 13:51:12.999379 31487 tablet_copy_client.cc:323] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:37223
I20260807 13:51:13.122808 28602 tablet_copy_service.cc:140] P 0ea2e5a5c2b0429985eb26f907033c9b: Received BeginTabletCopySession request for tablet 04f1daf8b6a44274bf2cc578e93c8303 from peer f634a7b061e64a7caf1cb02a4731dadc ({username='slave'} at 127.23.107.135:44339)
I20260807 13:51:13.123052 28602 tablet_copy_service.cc:161] P 0ea2e5a5c2b0429985eb26f907033c9b: Beginning new tablet copy session on tablet 04f1daf8b6a44274bf2cc578e93c8303 from peer f634a7b061e64a7caf1cb02a4731dadc at {username='slave'} at 127.23.107.135:44339: session id = f634a7b061e64a7caf1cb02a4731dadc-04f1daf8b6a44274bf2cc578e93c8303
I20260807 13:51:13.127373 28602 tablet_copy_source_session.cc:215] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:51:13.144208 31487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f1daf8b6a44274bf2cc578e93c8303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:51:13.151594 31487 tablet_copy_client.cc:806] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc: tablet copy: Starting download of 0 data blocks...
I20260807 13:51:13.151960 31487 tablet_copy_client.cc:670] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc: tablet copy: Starting download of 1 WAL segments...
I20260807 13:51:13.197934 28920 consensus_queue.cc:237] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 136, Committed index: 136, Last appended: 1.137, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 138 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } }
W20260807 13:51:13.207271 28662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.131:41571, user_credentials={real_user=slave}} blocked reactor thread for 64632us
I20260807 13:51:13.210899 28749 raft_consensus.cc:1275] T c2891223f5fd43979439c00fec9fca3d P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Refusing update from remote peer c11aeb9ac7f04cceb63233785ce00503: Log matching property violated. Preceding OpId in replica: term: 1 index: 137. Preceding OpId from leader: term: 1 index: 138. (index mismatch)
I20260807 13:51:13.211934 31153 consensus_queue.cc:1048] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 138, Last known committed idx: 136, Time since last communication: 0.000s
I20260807 13:51:13.231099 31474 raft_consensus.cc:2955] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 [term 1 LEADER]: Committing config change with OpId 1.138: config changed from index -1 to 138, VOTER ed5ae0647048435da282261048c04db2 (127.23.107.133) added. New config: { opid_index: 138 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } } }
I20260807 13:51:13.245218 28383 catalog_manager.cc:5697] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 reported cstate change: config changed from index -1 to 138, VOTER ed5ae0647048435da282261048c04db2 (127.23.107.133) added. New cstate: current_term: 1 leader_uuid: "c11aeb9ac7f04cceb63233785ce00503" committed_config { opid_index: 138 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } } }
W20260807 13:51:13.246997 28831 consensus_peers.cc:597] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 -> Peer ed5ae0647048435da282261048c04db2 (127.23.107.133:34943): Couldn't send request to peer ed5ae0647048435da282261048c04db2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c2891223f5fd43979439c00fec9fca3d. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:51:13.250526 28746 raft_consensus.cc:2955] T c2891223f5fd43979439c00fec9fca3d P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Committing config change with OpId 1.138: config changed from index -1 to 138, VOTER ed5ae0647048435da282261048c04db2 (127.23.107.133) added. New config: { opid_index: 138 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } } }
I20260807 13:51:13.266616 31487 tablet_copy_client.cc:538] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:51:13.270454 31487 tablet_bootstrap.cc:492] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc: Bootstrap starting.
I20260807 13:51:13.829443 31548 ts_tablet_manager.cc:933] T c2891223f5fd43979439c00fec9fca3d P ed5ae0647048435da282261048c04db2: Initiating tablet copy from peer c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571)
I20260807 13:51:13.850044 31487 tablet_bootstrap.cc:492] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc: Bootstrap replayed 1/1 log segments. Stats: ops{read=130 overwritten=0 applied=130 ignored=0} inserts{seen=761 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:51:13.851044 31487 tablet_bootstrap.cc:492] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc: Bootstrap complete.
I20260807 13:51:13.854050 31487 ts_tablet_manager.cc:1403] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc: Time spent bootstrapping tablet: real 0.583s user 0.205s sys 0.030s
I20260807 13:51:13.855371 31487 raft_consensus.cc:359] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 126 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } }
I20260807 13:51:13.859057 31487 raft_consensus.cc:740] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f634a7b061e64a7caf1cb02a4731dadc, State: Initialized, Role: FOLLOWER
I20260807 13:51:13.859700 31487 consensus_queue.cc:260] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 130, Last appended: 1.130, Last appended by leader: 130, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 126 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } }
I20260807 13:51:13.869179 31487 ts_tablet_manager.cc:1434] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc: Time spent starting tablet: real 0.015s user 0.003s sys 0.000s
I20260807 13:51:13.873966 28602 tablet_copy_service.cc:342] P 0ea2e5a5c2b0429985eb26f907033c9b: Request end of tablet copy session f634a7b061e64a7caf1cb02a4731dadc-04f1daf8b6a44274bf2cc578e93c8303 received from {username='slave'} at 127.23.107.135:44339
I20260807 13:51:13.874183 28602 tablet_copy_service.cc:434] P 0ea2e5a5c2b0429985eb26f907033c9b: ending tablet copy session f634a7b061e64a7caf1cb02a4731dadc-04f1daf8b6a44274bf2cc578e93c8303 on tablet 04f1daf8b6a44274bf2cc578e93c8303 with peer f634a7b061e64a7caf1cb02a4731dadc
I20260807 13:51:13.899164 30782 raft_consensus.cc:1217] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.125->[1.126-1.138] Dedup: 1.130->[1.131-1.138]
I20260807 13:51:13.911715 31548 tablet_copy_client.cc:323] T c2891223f5fd43979439c00fec9fca3d P ed5ae0647048435da282261048c04db2: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:41571
I20260807 13:51:14.054584 28943 tablet_copy_service.cc:140] P c11aeb9ac7f04cceb63233785ce00503: Received BeginTabletCopySession request for tablet c2891223f5fd43979439c00fec9fca3d from peer ed5ae0647048435da282261048c04db2 ({username='slave'} at 127.23.107.133:33979)
I20260807 13:51:14.054790 28943 tablet_copy_service.cc:161] P c11aeb9ac7f04cceb63233785ce00503: Beginning new tablet copy session on tablet c2891223f5fd43979439c00fec9fca3d from peer ed5ae0647048435da282261048c04db2 at {username='slave'} at 127.23.107.133:33979: session id = ed5ae0647048435da282261048c04db2-c2891223f5fd43979439c00fec9fca3d
I20260807 13:51:14.067121 28943 tablet_copy_source_session.cc:215] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:51:14.100425 31548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2891223f5fd43979439c00fec9fca3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:51:14.196101 31548 tablet_copy_client.cc:806] T c2891223f5fd43979439c00fec9fca3d P ed5ae0647048435da282261048c04db2: tablet copy: Starting download of 0 data blocks...
I20260807 13:51:14.201897 31548 tablet_copy_client.cc:670] T c2891223f5fd43979439c00fec9fca3d P ed5ae0647048435da282261048c04db2: tablet copy: Starting download of 1 WAL segments...
I20260807 13:51:14.212126 31548 tablet_copy_client.cc:538] T c2891223f5fd43979439c00fec9fca3d P ed5ae0647048435da282261048c04db2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:51:14.251106 31548 tablet_bootstrap.cc:492] T c2891223f5fd43979439c00fec9fca3d P ed5ae0647048435da282261048c04db2: Bootstrap starting.
I20260807 13:51:14.514690 28748 consensus_queue.cc:237] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 139, Committed index: 139, Last appended: 1.140, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 141 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:51:14.537602 28575 raft_consensus.cc:1275] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Refusing update from remote peer 9da72b03880d4414b034964abe86d4fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 139. Preceding OpId from leader: term: 1 index: 141. (index mismatch)
I20260807 13:51:14.583777 31446 consensus_queue.cc:1048] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 141, Last known committed idx: 139, Time since last communication: 0.000s
I20260807 13:51:14.601320 31527 raft_consensus.cc:2955] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [term 1 LEADER]: Committing config change with OpId 1.141: config changed from index -1 to 141, VOTER 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134) added. New config: { opid_index: 141 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
I20260807 13:51:14.611538 28394 catalog_manager.cc:5697] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe reported cstate change: config changed from index -1 to 141, VOTER 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134) added. New cstate: current_term: 1 leader_uuid: "9da72b03880d4414b034964abe86d4fe" committed_config { opid_index: 141 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
I20260807 13:51:14.621373 28575 raft_consensus.cc:2955] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Committing config change with OpId 1.141: config changed from index -1 to 141, VOTER 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134) added. New config: { opid_index: 141 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
W20260807 13:51:14.779242 28662 consensus_peers.cc:597] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe -> Peer 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134:41561): Couldn't send request to peer 22b9a9a4b1bf44daa35fcecd47b8856a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1592525dd2a646de874117d51026e771. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:51:14.902503 31548 tablet_bootstrap.cc:492] T c2891223f5fd43979439c00fec9fca3d P ed5ae0647048435da282261048c04db2: Bootstrap replayed 1/1 log segments. Stats: ops{read=145 overwritten=0 applied=145 ignored=0} inserts{seen=817 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:51:14.913069 31548 tablet_bootstrap.cc:492] T c2891223f5fd43979439c00fec9fca3d P ed5ae0647048435da282261048c04db2: Bootstrap complete.
I20260807 13:51:14.913756 31548 ts_tablet_manager.cc:1403] T c2891223f5fd43979439c00fec9fca3d P ed5ae0647048435da282261048c04db2: Time spent bootstrapping tablet: real 0.663s user 0.243s sys 0.023s
I20260807 13:51:14.915043 31548 raft_consensus.cc:359] T c2891223f5fd43979439c00fec9fca3d P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 138 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } }
I20260807 13:51:14.916630 31548 raft_consensus.cc:740] T c2891223f5fd43979439c00fec9fca3d P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed5ae0647048435da282261048c04db2, State: Initialized, Role: FOLLOWER
I20260807 13:51:14.917109 31548 consensus_queue.cc:260] T c2891223f5fd43979439c00fec9fca3d P ed5ae0647048435da282261048c04db2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 145, Last appended: 1.145, Last appended by leader: 145, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 138 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } }
I20260807 13:51:14.933918 31548 ts_tablet_manager.cc:1434] T c2891223f5fd43979439c00fec9fca3d P ed5ae0647048435da282261048c04db2: Time spent starting tablet: real 0.020s user 0.003s sys 0.001s
I20260807 13:51:14.934795 28943 tablet_copy_service.cc:342] P c11aeb9ac7f04cceb63233785ce00503: Request end of tablet copy session ed5ae0647048435da282261048c04db2-c2891223f5fd43979439c00fec9fca3d received from {username='slave'} at 127.23.107.133:33979
I20260807 13:51:14.934937 28943 tablet_copy_service.cc:434] P c11aeb9ac7f04cceb63233785ce00503: ending tablet copy session ed5ae0647048435da282261048c04db2-c2891223f5fd43979439c00fec9fca3d on tablet c2891223f5fd43979439c00fec9fca3d with peer ed5ae0647048435da282261048c04db2
I20260807 13:51:15.013484 31609 ts_tablet_manager.cc:933] T 1592525dd2a646de874117d51026e771 P 22b9a9a4b1bf44daa35fcecd47b8856a: Initiating tablet copy from peer 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223)
I20260807 13:51:15.051263 31609 tablet_copy_client.cc:323] T 1592525dd2a646de874117d51026e771 P 22b9a9a4b1bf44daa35fcecd47b8856a: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.130:43223
I20260807 13:51:15.102993 28778 tablet_copy_service.cc:140] P 9da72b03880d4414b034964abe86d4fe: Received BeginTabletCopySession request for tablet 1592525dd2a646de874117d51026e771 from peer 22b9a9a4b1bf44daa35fcecd47b8856a ({username='slave'} at 127.23.107.134:54239)
I20260807 13:51:15.103211 28778 tablet_copy_service.cc:161] P 9da72b03880d4414b034964abe86d4fe: Beginning new tablet copy session on tablet 1592525dd2a646de874117d51026e771 from peer 22b9a9a4b1bf44daa35fcecd47b8856a at {username='slave'} at 127.23.107.134:54239: session id = 22b9a9a4b1bf44daa35fcecd47b8856a-1592525dd2a646de874117d51026e771
I20260807 13:51:15.106540 28778 tablet_copy_source_session.cc:215] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:51:15.108603 31609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1592525dd2a646de874117d51026e771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:51:15.115773 31609 tablet_copy_client.cc:806] T 1592525dd2a646de874117d51026e771 P 22b9a9a4b1bf44daa35fcecd47b8856a: tablet copy: Starting download of 0 data blocks...
I20260807 13:51:15.116145 31609 tablet_copy_client.cc:670] T 1592525dd2a646de874117d51026e771 P 22b9a9a4b1bf44daa35fcecd47b8856a: tablet copy: Starting download of 1 WAL segments...
I20260807 13:51:15.121927 31609 tablet_copy_client.cc:538] T 1592525dd2a646de874117d51026e771 P 22b9a9a4b1bf44daa35fcecd47b8856a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:51:15.125552 31609 tablet_bootstrap.cc:492] T 1592525dd2a646de874117d51026e771 P 22b9a9a4b1bf44daa35fcecd47b8856a: Bootstrap starting.
I20260807 13:51:15.248008 28748 consensus_queue.cc:237] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 153, Committed index: 153, Last appended: 1.153, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 154 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } }
W20260807 13:51:15.254649 28662 consensus_peers.cc:597] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe -> Peer c45d5217722649e6bdbccee30863591b (127.23.107.132:34213): Couldn't send request to peer c45d5217722649e6bdbccee30863591b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba6d87b94369439dac8c8355d744a7f3. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:51:15.257777 28920 raft_consensus.cc:1275] T ba6d87b94369439dac8c8355d744a7f3 P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Refusing update from remote peer 9da72b03880d4414b034964abe86d4fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 153. Preceding OpId from leader: term: 1 index: 154. (index mismatch)
I20260807 13:51:15.260952 31616 consensus_queue.cc:1048] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 154, Last known committed idx: 153, Time since last communication: 0.000s
I20260807 13:51:15.280030 31616 raft_consensus.cc:2955] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe [term 1 LEADER]: Committing config change with OpId 1.154: config changed from index -1 to 154, VOTER c45d5217722649e6bdbccee30863591b (127.23.107.132) added. New config: { opid_index: 154 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } }
I20260807 13:51:15.290100 28394 catalog_manager.cc:5697] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe reported cstate change: config changed from index -1 to 154, VOTER c45d5217722649e6bdbccee30863591b (127.23.107.132) added. New cstate: current_term: 1 leader_uuid: "9da72b03880d4414b034964abe86d4fe" committed_config { opid_index: 154 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } }
I20260807 13:51:15.289994 28920 raft_consensus.cc:2955] T ba6d87b94369439dac8c8355d744a7f3 P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Committing config change with OpId 1.154: config changed from index -1 to 154, VOTER c45d5217722649e6bdbccee30863591b (127.23.107.132) added. New config: { opid_index: 154 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } }
I20260807 13:51:15.378190 30421 raft_consensus.cc:1217] T c2891223f5fd43979439c00fec9fca3d P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.137->[1.138-1.163] Dedup: 1.145->[1.146-1.163]
I20260807 13:51:15.658262 31609 tablet_bootstrap.cc:492] T 1592525dd2a646de874117d51026e771 P 22b9a9a4b1bf44daa35fcecd47b8856a: Bootstrap replayed 1/1 log segments. Stats: ops{read=143 overwritten=0 applied=143 ignored=0} inserts{seen=828 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:51:15.658941 31609 tablet_bootstrap.cc:492] T 1592525dd2a646de874117d51026e771 P 22b9a9a4b1bf44daa35fcecd47b8856a: Bootstrap complete.
I20260807 13:51:15.659363 31609 ts_tablet_manager.cc:1403] T 1592525dd2a646de874117d51026e771 P 22b9a9a4b1bf44daa35fcecd47b8856a: Time spent bootstrapping tablet: real 0.534s user 0.213s sys 0.027s
I20260807 13:51:15.660758 31609 raft_consensus.cc:359] T 1592525dd2a646de874117d51026e771 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 141 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:51:15.661072 31609 raft_consensus.cc:740] T 1592525dd2a646de874117d51026e771 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22b9a9a4b1bf44daa35fcecd47b8856a, State: Initialized, Role: FOLLOWER
I20260807 13:51:15.661459 31609 consensus_queue.cc:260] T 1592525dd2a646de874117d51026e771 P 22b9a9a4b1bf44daa35fcecd47b8856a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 143, Last appended: 1.143, Last appended by leader: 143, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 141 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:51:15.662155 31609 ts_tablet_manager.cc:1434] T 1592525dd2a646de874117d51026e771 P 22b9a9a4b1bf44daa35fcecd47b8856a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:51:15.671273 28778 tablet_copy_service.cc:342] P 9da72b03880d4414b034964abe86d4fe: Request end of tablet copy session 22b9a9a4b1bf44daa35fcecd47b8856a-1592525dd2a646de874117d51026e771 received from {username='slave'} at 127.23.107.134:54239
I20260807 13:51:15.671476 28778 tablet_copy_service.cc:434] P 9da72b03880d4414b034964abe86d4fe: ending tablet copy session 22b9a9a4b1bf44daa35fcecd47b8856a-1592525dd2a646de874117d51026e771 on tablet 1592525dd2a646de874117d51026e771 with peer 22b9a9a4b1bf44daa35fcecd47b8856a
I20260807 13:51:15.733796 31649 ts_tablet_manager.cc:933] T ba6d87b94369439dac8c8355d744a7f3 P c45d5217722649e6bdbccee30863591b: Initiating tablet copy from peer 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223)
I20260807 13:51:15.735179 31649 tablet_copy_client.cc:323] T ba6d87b94369439dac8c8355d744a7f3 P c45d5217722649e6bdbccee30863591b: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.130:43223
I20260807 13:51:15.748067 28778 tablet_copy_service.cc:140] P 9da72b03880d4414b034964abe86d4fe: Received BeginTabletCopySession request for tablet ba6d87b94369439dac8c8355d744a7f3 from peer c45d5217722649e6bdbccee30863591b ({username='slave'} at 127.23.107.132:60087)
I20260807 13:51:15.748243 28778 tablet_copy_service.cc:161] P 9da72b03880d4414b034964abe86d4fe: Beginning new tablet copy session on tablet ba6d87b94369439dac8c8355d744a7f3 from peer c45d5217722649e6bdbccee30863591b at {username='slave'} at 127.23.107.132:60087: session id = c45d5217722649e6bdbccee30863591b-ba6d87b94369439dac8c8355d744a7f3
I20260807 13:51:15.754529 28778 tablet_copy_source_session.cc:215] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:51:15.758057 31649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba6d87b94369439dac8c8355d744a7f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:51:15.766423 31649 tablet_copy_client.cc:806] T ba6d87b94369439dac8c8355d744a7f3 P c45d5217722649e6bdbccee30863591b: tablet copy: Starting download of 0 data blocks...
I20260807 13:51:15.766762 31649 tablet_copy_client.cc:670] T ba6d87b94369439dac8c8355d744a7f3 P c45d5217722649e6bdbccee30863591b: tablet copy: Starting download of 1 WAL segments...
I20260807 13:51:15.800227 31649 tablet_copy_client.cc:538] T ba6d87b94369439dac8c8355d744a7f3 P c45d5217722649e6bdbccee30863591b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:51:15.811373 31649 tablet_bootstrap.cc:492] T ba6d87b94369439dac8c8355d744a7f3 P c45d5217722649e6bdbccee30863591b: Bootstrap starting.
I20260807 13:51:15.932588 28748 consensus_queue.cc:237] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 169, Committed index: 169, Last appended: 1.169, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 170 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } }
W20260807 13:51:15.935976 28661 consensus_peers.cc:597] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe -> Peer f634a7b061e64a7caf1cb02a4731dadc (127.23.107.135:39559): Couldn't send request to peer f634a7b061e64a7caf1cb02a4731dadc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: be0c7339d6fd43c781879ef4c2c76fbd. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:51:15.968600 28575 raft_consensus.cc:1275] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Refusing update from remote peer 9da72b03880d4414b034964abe86d4fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 169. Preceding OpId from leader: term: 1 index: 170. (index mismatch)
I20260807 13:51:15.991923 31287 consensus_queue.cc:1048] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 170, Last known committed idx: 169, Time since last communication: 0.000s
I20260807 13:51:16.028012 31446 raft_consensus.cc:2955] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe [term 1 LEADER]: Committing config change with OpId 1.170: config changed from index -1 to 170, VOTER f634a7b061e64a7caf1cb02a4731dadc (127.23.107.135) added. New config: { opid_index: 170 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } }
I20260807 13:51:16.037832 28383 catalog_manager.cc:5697] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe reported cstate change: config changed from index -1 to 170, VOTER f634a7b061e64a7caf1cb02a4731dadc (127.23.107.135) added. New cstate: current_term: 1 leader_uuid: "9da72b03880d4414b034964abe86d4fe" committed_config { opid_index: 170 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } }
I20260807 13:51:16.046846 28577 raft_consensus.cc:2955] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Committing config change with OpId 1.170: config changed from index -1 to 170, VOTER f634a7b061e64a7caf1cb02a4731dadc (127.23.107.135) added. New config: { opid_index: 170 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } }
I20260807 13:51:16.145097 30599 raft_consensus.cc:1217] T 1592525dd2a646de874117d51026e771 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.140->[1.141-1.156] Dedup: 1.143->[1.144-1.156]
I20260807 13:51:16.268435 31649 tablet_bootstrap.cc:492] T ba6d87b94369439dac8c8355d744a7f3 P c45d5217722649e6bdbccee30863591b: Bootstrap replayed 1/1 log segments. Stats: ops{read=155 overwritten=0 applied=155 ignored=0} inserts{seen=827 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:51:16.269136 31649 tablet_bootstrap.cc:492] T ba6d87b94369439dac8c8355d744a7f3 P c45d5217722649e6bdbccee30863591b: Bootstrap complete.
I20260807 13:51:16.269599 31649 ts_tablet_manager.cc:1403] T ba6d87b94369439dac8c8355d744a7f3 P c45d5217722649e6bdbccee30863591b: Time spent bootstrapping tablet: real 0.458s user 0.234s sys 0.024s
I20260807 13:51:16.270891 31649 raft_consensus.cc:359] T ba6d87b94369439dac8c8355d744a7f3 P c45d5217722649e6bdbccee30863591b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 154 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } }
I20260807 13:51:16.271315 31649 raft_consensus.cc:740] T ba6d87b94369439dac8c8355d744a7f3 P c45d5217722649e6bdbccee30863591b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45d5217722649e6bdbccee30863591b, State: Initialized, Role: FOLLOWER
I20260807 13:51:16.271763 31649 consensus_queue.cc:260] T ba6d87b94369439dac8c8355d744a7f3 P c45d5217722649e6bdbccee30863591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 155, Last appended: 1.155, Last appended by leader: 155, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 154 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } }
I20260807 13:51:16.284083 31649 ts_tablet_manager.cc:1434] T ba6d87b94369439dac8c8355d744a7f3 P c45d5217722649e6bdbccee30863591b: Time spent starting tablet: real 0.014s user 0.005s sys 0.007s
I20260807 13:51:16.294952 28778 tablet_copy_service.cc:342] P 9da72b03880d4414b034964abe86d4fe: Request end of tablet copy session c45d5217722649e6bdbccee30863591b-ba6d87b94369439dac8c8355d744a7f3 received from {username='slave'} at 127.23.107.132:60087
I20260807 13:51:16.295142 28778 tablet_copy_service.cc:434] P 9da72b03880d4414b034964abe86d4fe: ending tablet copy session c45d5217722649e6bdbccee30863591b-ba6d87b94369439dac8c8355d744a7f3 on tablet ba6d87b94369439dac8c8355d744a7f3 with peer c45d5217722649e6bdbccee30863591b
I20260807 13:51:16.424772 31693 ts_tablet_manager.cc:933] T be0c7339d6fd43c781879ef4c2c76fbd P f634a7b061e64a7caf1cb02a4731dadc: Initiating tablet copy from peer 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223)
I20260807 13:51:16.500106 31693 tablet_copy_client.cc:323] T be0c7339d6fd43c781879ef4c2c76fbd P f634a7b061e64a7caf1cb02a4731dadc: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.130:43223
I20260807 13:51:16.501214 28778 tablet_copy_service.cc:140] P 9da72b03880d4414b034964abe86d4fe: Received BeginTabletCopySession request for tablet be0c7339d6fd43c781879ef4c2c76fbd from peer f634a7b061e64a7caf1cb02a4731dadc ({username='slave'} at 127.23.107.135:34775)
I20260807 13:51:16.501442 28778 tablet_copy_service.cc:161] P 9da72b03880d4414b034964abe86d4fe: Beginning new tablet copy session on tablet be0c7339d6fd43c781879ef4c2c76fbd from peer f634a7b061e64a7caf1cb02a4731dadc at {username='slave'} at 127.23.107.135:34775: session id = f634a7b061e64a7caf1cb02a4731dadc-be0c7339d6fd43c781879ef4c2c76fbd
I20260807 13:51:16.504783 28778 tablet_copy_source_session.cc:215] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:51:16.506456 31693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be0c7339d6fd43c781879ef4c2c76fbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:51:16.516604 31693 tablet_copy_client.cc:806] T be0c7339d6fd43c781879ef4c2c76fbd P f634a7b061e64a7caf1cb02a4731dadc: tablet copy: Starting download of 0 data blocks...
I20260807 13:51:16.516969 31693 tablet_copy_client.cc:670] T be0c7339d6fd43c781879ef4c2c76fbd P f634a7b061e64a7caf1cb02a4731dadc: tablet copy: Starting download of 1 WAL segments...
I20260807 13:51:16.535089 31693 tablet_copy_client.cc:538] T be0c7339d6fd43c781879ef4c2c76fbd P f634a7b061e64a7caf1cb02a4731dadc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:51:16.574375 31693 tablet_bootstrap.cc:492] T be0c7339d6fd43c781879ef4c2c76fbd P f634a7b061e64a7caf1cb02a4731dadc: Bootstrap starting.
I20260807 13:51:16.686268 30248 raft_consensus.cc:1217] T ba6d87b94369439dac8c8355d744a7f3 P c45d5217722649e6bdbccee30863591b [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.153->[1.154-1.165] Dedup: 1.155->[1.156-1.165]
I20260807 13:51:17.418092 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260807 13:51:17.426023 28661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.135:39559, user_credentials={real_user=slave}} blocked reactor thread for 63807.8us
I20260807 13:51:17.503269 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:51:17.547402 31693 tablet_bootstrap.cc:492] T be0c7339d6fd43c781879ef4c2c76fbd P f634a7b061e64a7caf1cb02a4731dadc: Bootstrap replayed 1/1 log segments. Stats: ops{read=175 overwritten=0 applied=175 ignored=0} inserts{seen=806 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:51:17.548163 31693 tablet_bootstrap.cc:492] T be0c7339d6fd43c781879ef4c2c76fbd P f634a7b061e64a7caf1cb02a4731dadc: Bootstrap complete.
I20260807 13:51:17.548636 31693 ts_tablet_manager.cc:1403] T be0c7339d6fd43c781879ef4c2c76fbd P f634a7b061e64a7caf1cb02a4731dadc: Time spent bootstrapping tablet: real 0.974s user 0.295s sys 0.020s
I20260807 13:51:17.549625 31693 raft_consensus.cc:359] T be0c7339d6fd43c781879ef4c2c76fbd P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 170 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } }
I20260807 13:51:17.549958 31693 raft_consensus.cc:740] T be0c7339d6fd43c781879ef4c2c76fbd P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f634a7b061e64a7caf1cb02a4731dadc, State: Initialized, Role: FOLLOWER
I20260807 13:51:17.550442 31693 consensus_queue.cc:260] T be0c7339d6fd43c781879ef4c2c76fbd P f634a7b061e64a7caf1cb02a4731dadc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 175, Last appended: 1.175, Last appended by leader: 175, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 170 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } }
I20260807 13:51:17.615543 31693 ts_tablet_manager.cc:1434] T be0c7339d6fd43c781879ef4c2c76fbd P f634a7b061e64a7caf1cb02a4731dadc: Time spent starting tablet: real 0.067s user 0.019s sys 0.022s
I20260807 13:51:17.618626 28778 tablet_copy_service.cc:342] P 9da72b03880d4414b034964abe86d4fe: Request end of tablet copy session f634a7b061e64a7caf1cb02a4731dadc-be0c7339d6fd43c781879ef4c2c76fbd received from {username='slave'} at 127.23.107.135:34775
I20260807 13:51:17.618793 28778 tablet_copy_service.cc:434] P 9da72b03880d4414b034964abe86d4fe: ending tablet copy session f634a7b061e64a7caf1cb02a4731dadc-be0c7339d6fd43c781879ef4c2c76fbd on tablet be0c7339d6fd43c781879ef4c2c76fbd with peer f634a7b061e64a7caf1cb02a4731dadc
I20260807 13:51:17.699601 30781 raft_consensus.cc:1217] T be0c7339d6fd43c781879ef4c2c76fbd P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.169->[1.170-1.189] Dedup: 1.175->[1.176-1.189]
I20260807 13:51:17.778642 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:51:17.803714 28724 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:51:17.833612 30396 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260807 13:51:17.902902 28663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.129:37223, user_credentials={real_user=slave}} blocked reactor thread for 103166us
I20260807 13:51:17.983546 30758 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:17.989492 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260807 13:51:18.046888 28663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.129:37223, user_credentials={real_user=slave}} blocked reactor thread for 69047.9us
W20260807 13:51:18.244385 28493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.131:41571, user_credentials={real_user=slave}} blocked reactor thread for 76839.7us
I20260807 13:51:19.310297 28748 consensus_queue.cc:237] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 210, Committed index: 210, Last appended: 1.210, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 211 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } }
I20260807 13:51:19.324156 30782 raft_consensus.cc:1275] T be0c7339d6fd43c781879ef4c2c76fbd P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Refusing update from remote peer 9da72b03880d4414b034964abe86d4fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 210. Preceding OpId from leader: term: 1 index: 211. (index mismatch)
I20260807 13:51:19.330577 31447 consensus_queue.cc:1048] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 211, Last known committed idx: 210, Time since last communication: 0.002s
I20260807 13:51:19.334949 31447 raft_consensus.cc:2955] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe [term 1 LEADER]: Committing config change with OpId 1.211: config changed from index 170 to 211, VOTER 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129) evicted. New config: { opid_index: 211 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } }
I20260807 13:51:19.336127 30784 raft_consensus.cc:2955] T be0c7339d6fd43c781879ef4c2c76fbd P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Committing config change with OpId 1.211: config changed from index 170 to 211, VOTER 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129) evicted. New config: { opid_index: 211 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } }
I20260807 13:51:19.354064 28394 catalog_manager.cc:5697] T be0c7339d6fd43c781879ef4c2c76fbd P 9da72b03880d4414b034964abe86d4fe reported cstate change: config changed from index 170 to 211, VOTER 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129) evicted. New cstate: current_term: 1 leader_uuid: "9da72b03880d4414b034964abe86d4fe" committed_config { opid_index: 211 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } }
I20260807 13:51:19.650117 28551 tablet_service.cc:1558] Processing DeleteTablet for tablet be0c7339d6fd43c781879ef4c2c76fbd with delete_type TABLET_DATA_TOMBSTONED (TS 0ea2e5a5c2b0429985eb26f907033c9b not found in new config with opid_index 211) from {username='slave'} at 127.0.0.1:60692
I20260807 13:51:19.652586 31846 tablet_replica.cc:333] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b: stopping tablet replica
I20260807 13:51:19.653262 31846 raft_consensus.cc:2243] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:51:19.657868 31846 raft_consensus.cc:2272] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:51:19.660168 31846 ts_tablet_manager.cc:1916] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:51:19.692873 31846 ts_tablet_manager.cc:1929] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.210
I20260807 13:51:19.694720 31846 log.cc:1199] T be0c7339d6fd43c781879ef4c2c76fbd P 0ea2e5a5c2b0429985eb26f907033c9b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/wals/be0c7339d6fd43c781879ef4c2c76fbd
I20260807 13:51:19.697819 28376 catalog_manager.cc:5028] TS 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223): tablet be0c7339d6fd43c781879ef4c2c76fbd (table rebalance_test_table_0 [id=2f5b82068ed242bcb08a733f8a0d94df]) successfully deleted
W20260807 13:51:19.922364 28662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:34213, user_credentials={real_user=slave}} blocked reactor thread for 66380.5us
W20260807 13:51:20.885783 28493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.131:41571, user_credentials={real_user=slave}} blocked reactor thread for 161347us
I20260807 13:51:21.135747 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:51:21.282634 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260807 13:51:21.334048 28493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.131:41571, user_credentials={real_user=slave}} blocked reactor thread for 47300.1us
I20260807 13:51:21.390640 30758 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:21.435246 28724 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:51:21.435745 30396 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:21.457758 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:21.534781 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
W20260807 13:51:22.611410 28832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.130:43223, user_credentials={real_user=slave}} blocked reactor thread for 176874us
W20260807 13:51:23.453466 28490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.135:39559, user_credentials={real_user=slave}} blocked reactor thread for 103533us
W20260807 13:51:23.572985 28493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.131:41571, user_credentials={real_user=slave}} blocked reactor thread for 124741us
I20260807 13:51:23.695461 28920 consensus_queue.cc:237] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 274, Committed index: 274, Last appended: 1.274, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 275 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } }
I20260807 13:51:23.697836 30419 raft_consensus.cc:1275] T c2891223f5fd43979439c00fec9fca3d P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Refusing update from remote peer c11aeb9ac7f04cceb63233785ce00503: Log matching property violated. Preceding OpId in replica: term: 1 index: 274. Preceding OpId from leader: term: 1 index: 275. (index mismatch)
I20260807 13:51:23.698961 31931 consensus_queue.cc:1048] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 275, Last known committed idx: 274, Time since last communication: 0.000s
I20260807 13:51:23.702529 31931 raft_consensus.cc:2955] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 [term 1 LEADER]: Committing config change with OpId 1.275: config changed from index 138 to 275, VOTER 9da72b03880d4414b034964abe86d4fe (127.23.107.130) evicted. New config: { opid_index: 275 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } } }
I20260807 13:51:23.704315 30419 raft_consensus.cc:2955] T c2891223f5fd43979439c00fec9fca3d P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Committing config change with OpId 1.275: config changed from index 138 to 275, VOTER 9da72b03880d4414b034964abe86d4fe (127.23.107.130) evicted. New config: { opid_index: 275 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } } }
I20260807 13:51:23.787854 28394 catalog_manager.cc:5697] T c2891223f5fd43979439c00fec9fca3d P c11aeb9ac7f04cceb63233785ce00503 reported cstate change: config changed from index 138 to 275, VOTER 9da72b03880d4414b034964abe86d4fe (127.23.107.130) evicted. New cstate: current_term: 1 leader_uuid: "c11aeb9ac7f04cceb63233785ce00503" committed_config { opid_index: 275 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } } }
I20260807 13:51:23.978075 28724 tablet_service.cc:1558] Processing DeleteTablet for tablet c2891223f5fd43979439c00fec9fca3d with delete_type TABLET_DATA_TOMBSTONED (TS 9da72b03880d4414b034964abe86d4fe not found in new config with opid_index 275) from {username='slave'} at 127.0.0.1:55848
I20260807 13:51:23.989023 32004 tablet_replica.cc:333] T c2891223f5fd43979439c00fec9fca3d P 9da72b03880d4414b034964abe86d4fe: stopping tablet replica
I20260807 13:51:23.989763 32004 raft_consensus.cc:2243] T c2891223f5fd43979439c00fec9fca3d P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:51:23.990327 32004 raft_consensus.cc:2272] T c2891223f5fd43979439c00fec9fca3d P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:51:23.998347 32004 ts_tablet_manager.cc:1916] T c2891223f5fd43979439c00fec9fca3d P 9da72b03880d4414b034964abe86d4fe: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:51:24.055248 32004 ts_tablet_manager.cc:1929] T c2891223f5fd43979439c00fec9fca3d P 9da72b03880d4414b034964abe86d4fe: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.274
I20260807 13:51:24.057014 32004 log.cc:1199] T c2891223f5fd43979439c00fec9fca3d P 9da72b03880d4414b034964abe86d4fe: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/c2891223f5fd43979439c00fec9fca3d
I20260807 13:51:24.058748 28375 catalog_manager.cc:5028] TS 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223): tablet c2891223f5fd43979439c00fec9fca3d (table rebalance_test_table_1 [id=49c4a818a68345dca0cf504531ad490a]) successfully deleted
W20260807 13:51:24.329254 28493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.131:41571, user_credentials={real_user=slave}} blocked reactor thread for 48473.4us
W20260807 13:51:25.273797 28493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.134:41561, user_credentials={real_user=slave}} blocked reactor thread for 94495us
W20260807 13:51:25.471704 28662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.131:41571, user_credentials={real_user=slave}} blocked reactor thread for 72519.3us
I20260807 13:51:25.710112 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:51:25.913866 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:51:25.965812 30758 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:25.967021 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:25.969527 30396 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:25.978662 28724 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:51:26.136850 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
W20260807 13:51:27.287591 28662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.131:41571, user_credentials={real_user=slave}} blocked reactor thread for 56419.3us
W20260807 13:51:27.550215 28662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.134:41561, user_credentials={real_user=slave}} blocked reactor thread for 58118.7us
I20260807 13:51:28.488083 28577 consensus_queue.cc:237] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 293, Committed index: 293, Last appended: 1.293, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 294 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } }
W20260807 13:51:28.498270 28490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.133:34943, user_credentials={real_user=slave}} blocked reactor thread for 48508.5us
I20260807 13:51:28.499868 30781 raft_consensus.cc:1275] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Refusing update from remote peer 0ea2e5a5c2b0429985eb26f907033c9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 293. Preceding OpId from leader: term: 1 index: 294. (index mismatch)
I20260807 13:51:28.501559 32176 consensus_queue.cc:1048] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 294, Last known committed idx: 293, Time since last communication: 0.001s
I20260807 13:51:28.511828 32176 raft_consensus.cc:2955] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 LEADER]: Committing config change with OpId 1.294: config changed from index 126 to 294, VOTER c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131) evicted. New config: { opid_index: 294 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } }
I20260807 13:51:28.513028 30781 raft_consensus.cc:2955] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Committing config change with OpId 1.294: config changed from index 126 to 294, VOTER c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131) evicted. New config: { opid_index: 294 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } }
I20260807 13:51:28.520797 28394 catalog_manager.cc:5697] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b reported cstate change: config changed from index 126 to 294, VOTER c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131) evicted. New cstate: current_term: 1 leader_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" committed_config { opid_index: 294 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } }
I20260807 13:51:28.595482 28895 tablet_service.cc:1558] Processing DeleteTablet for tablet 04f1daf8b6a44274bf2cc578e93c8303 with delete_type TABLET_DATA_TOMBSTONED (TS c11aeb9ac7f04cceb63233785ce00503 not found in new config with opid_index 294) from {username='slave'} at 127.0.0.1:39832
I20260807 13:51:28.612804 32192 tablet_replica.cc:333] T 04f1daf8b6a44274bf2cc578e93c8303 P c11aeb9ac7f04cceb63233785ce00503: stopping tablet replica
I20260807 13:51:28.624325 32192 raft_consensus.cc:2243] T 04f1daf8b6a44274bf2cc578e93c8303 P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:51:28.635763 32192 raft_consensus.cc:2272] T 04f1daf8b6a44274bf2cc578e93c8303 P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:51:28.642026 32192 ts_tablet_manager.cc:1916] T 04f1daf8b6a44274bf2cc578e93c8303 P c11aeb9ac7f04cceb63233785ce00503: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:51:28.702646 32192 ts_tablet_manager.cc:1929] T 04f1daf8b6a44274bf2cc578e93c8303 P c11aeb9ac7f04cceb63233785ce00503: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.293
I20260807 13:51:28.703801 32192 log.cc:1199] T 04f1daf8b6a44274bf2cc578e93c8303 P c11aeb9ac7f04cceb63233785ce00503: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/wals/04f1daf8b6a44274bf2cc578e93c8303
I20260807 13:51:28.705513 28375 catalog_manager.cc:5028] TS c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571): tablet 04f1daf8b6a44274bf2cc578e93c8303 (table rebalance_test_table_3 [id=6232d7b2b0b5403c842e16fd04e72177]) successfully deleted
W20260807 13:51:29.465005 28493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.131:41571, user_credentials={real_user=slave}} blocked reactor thread for 71849us
W20260807 13:51:29.714047 28662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.131:41571, user_credentials={real_user=slave}} blocked reactor thread for 62427.1us
W20260807 13:51:30.022244 28663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.129:37223, user_credentials={real_user=slave}} blocked reactor thread for 56464.6us
I20260807 13:51:30.344754 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260807 13:51:30.432171 28662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.131:41571, user_credentials={real_user=slave}} blocked reactor thread for 61987.9us
I20260807 13:51:30.451843 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:30.505568 28724 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
W20260807 13:51:30.536092 28832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.134:41561, user_credentials={real_user=slave}} blocked reactor thread for 104525us
I20260807 13:51:30.538699 30758 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:30.561865 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:51:30.612072 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:51:30.747562 30396 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260807 13:51:30.957445 28662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:34213, user_credentials={real_user=slave}} blocked reactor thread for 56030.2us
W20260807 13:51:31.846366 28835 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.129:37223, user_credentials={real_user=slave}} blocked reactor thread for 59906.5us
W20260807 13:51:31.934473 28832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.130:43223, user_credentials={real_user=slave}} blocked reactor thread for 52629.5us
I20260807 13:51:32.081036 28749 consensus_queue.cc:237] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 345, Committed index: 345, Last appended: 1.345, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 346 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } }
I20260807 13:51:32.093516 30242 raft_consensus.cc:1275] T 3fefa1bc622f43ca8344ddfe3522ce46 P c45d5217722649e6bdbccee30863591b [term 1 FOLLOWER]: Refusing update from remote peer 9da72b03880d4414b034964abe86d4fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 345. Preceding OpId from leader: term: 1 index: 346. (index mismatch)
I20260807 13:51:32.100090 32101 consensus_queue.cc:1048] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 346, Last known committed idx: 345, Time since last communication: 0.001s
I20260807 13:51:32.114537 32210 raft_consensus.cc:2955] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [term 1 LEADER]: Committing config change with OpId 1.346: config changed from index 105 to 346, VOTER 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129) evicted. New config: { opid_index: 346 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } }
I20260807 13:51:32.115510 30242 raft_consensus.cc:2955] T 3fefa1bc622f43ca8344ddfe3522ce46 P c45d5217722649e6bdbccee30863591b [term 1 FOLLOWER]: Committing config change with OpId 1.346: config changed from index 105 to 346, VOTER 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129) evicted. New config: { opid_index: 346 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } }
I20260807 13:51:32.157469 28394 catalog_manager.cc:5697] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe reported cstate change: config changed from index 105 to 346, VOTER 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129) evicted. New cstate: current_term: 1 leader_uuid: "9da72b03880d4414b034964abe86d4fe" committed_config { opid_index: 346 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } }
W20260807 13:51:32.421103 28493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.130:43223, user_credentials={real_user=slave}} blocked reactor thread for 90548.5us
I20260807 13:51:32.545055 28551 tablet_service.cc:1558] Processing DeleteTablet for tablet 3fefa1bc622f43ca8344ddfe3522ce46 with delete_type TABLET_DATA_TOMBSTONED (TS 0ea2e5a5c2b0429985eb26f907033c9b not found in new config with opid_index 346) from {username='slave'} at 127.0.0.1:60692
I20260807 13:51:32.644156 32349 tablet_replica.cc:333] T 3fefa1bc622f43ca8344ddfe3522ce46 P 0ea2e5a5c2b0429985eb26f907033c9b: stopping tablet replica
I20260807 13:51:32.644641 32349 raft_consensus.cc:2243] T 3fefa1bc622f43ca8344ddfe3522ce46 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:51:32.669762 32349 raft_consensus.cc:2272] T 3fefa1bc622f43ca8344ddfe3522ce46 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:51:32.699307 32349 ts_tablet_manager.cc:1916] T 3fefa1bc622f43ca8344ddfe3522ce46 P 0ea2e5a5c2b0429985eb26f907033c9b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:51:32.709532 32349 ts_tablet_manager.cc:1929] T 3fefa1bc622f43ca8344ddfe3522ce46 P 0ea2e5a5c2b0429985eb26f907033c9b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.345
I20260807 13:51:32.710292 32349 log.cc:1199] T 3fefa1bc622f43ca8344ddfe3522ce46 P 0ea2e5a5c2b0429985eb26f907033c9b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/wals/3fefa1bc622f43ca8344ddfe3522ce46
I20260807 13:51:32.711745 28376 catalog_manager.cc:5028] TS 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223): tablet 3fefa1bc622f43ca8344ddfe3522ce46 (table rebalance_test_table_2 [id=46bf349795f3453589935822245c96b1]) successfully deleted
W20260807 13:51:32.836648 28661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.135:39559, user_credentials={real_user=slave}} blocked reactor thread for 46992.6us
W20260807 13:51:33.437026 28662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:34213, user_credentials={real_user=slave}} blocked reactor thread for 46051.5us
W20260807 13:51:33.840301 28832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.130:43223, user_credentials={real_user=slave}} blocked reactor thread for 129328us
I20260807 13:51:34.040640 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:51:34.105486 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:51:34.196785 28724 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:51:34.440474 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:51:34.580565 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:34.766402 30396 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:35.013793 30758 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260807 13:51:35.700194 28663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.129:37223, user_credentials={real_user=slave}} blocked reactor thread for 77863.8us
W20260807 13:51:35.782052 28662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.131:41571, user_credentials={real_user=slave}} blocked reactor thread for 57935.1us
W20260807 13:51:35.836166 28662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:34213, user_credentials={real_user=slave}} blocked reactor thread for 52102.1us
I20260807 13:51:36.331115 28572 consensus_queue.cc:237] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 405, Committed index: 405, Last appended: 1.405, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 406 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } }
I20260807 13:51:36.334730 30420 raft_consensus.cc:1275] T f9f996c0ec5849d98b1cc0fc83cc51a6 P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Refusing update from remote peer 0ea2e5a5c2b0429985eb26f907033c9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 405. Preceding OpId from leader: term: 1 index: 406. (index mismatch)
I20260807 13:51:36.335947 32461 consensus_queue.cc:1048] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 406, Last known committed idx: 405, Time since last communication: 0.000s
I20260807 13:51:36.342645 32176 raft_consensus.cc:2955] T f9f996c0ec5849d98b1cc0fc83cc51a6 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 LEADER]: Committing config change with OpId 1.406: config changed from index 86 to 406, VOTER c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131) evicted. New config: { opid_index: 406 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } } }
I20260807 13:51:36.347497 30420 raft_consensus.cc:2955] T f9f996c0ec5849d98b1cc0fc83cc51a6 P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Committing config change with OpId 1.406: config changed from index 86 to 406, VOTER c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131) evicted. New config: { opid_index: 406 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } } }
W20260807 13:51:36.365599 28493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.130:43223, user_credentials={real_user=slave}} blocked reactor thread for 62921.1us
I20260807 13:51:36.384873 28383 catalog_manager.cc:5697] T f9f996c0ec5849d98b1cc0fc83cc51a6 P ed5ae0647048435da282261048c04db2 reported cstate change: config changed from index 86 to 406, VOTER c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131) evicted. New cstate: current_term: 1 leader_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" committed_config { opid_index: 406 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } } }
W20260807 13:51:36.439213 28493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.131:41571, user_credentials={real_user=slave}} blocked reactor thread for 50280us
I20260807 13:51:36.761622 28895 tablet_service.cc:1558] Processing DeleteTablet for tablet f9f996c0ec5849d98b1cc0fc83cc51a6 with delete_type TABLET_DATA_TOMBSTONED (TS c11aeb9ac7f04cceb63233785ce00503 not found in new config with opid_index 406) from {username='slave'} at 127.0.0.1:39832
I20260807 13:51:36.796079 32529 tablet_replica.cc:333] T f9f996c0ec5849d98b1cc0fc83cc51a6 P c11aeb9ac7f04cceb63233785ce00503: stopping tablet replica
I20260807 13:51:36.802151 32529 raft_consensus.cc:2243] T f9f996c0ec5849d98b1cc0fc83cc51a6 P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:51:36.802702 32529 raft_consensus.cc:2272] T f9f996c0ec5849d98b1cc0fc83cc51a6 P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:51:36.805804 32529 ts_tablet_manager.cc:1916] T f9f996c0ec5849d98b1cc0fc83cc51a6 P c11aeb9ac7f04cceb63233785ce00503: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:51:36.910470 32529 ts_tablet_manager.cc:1929] T f9f996c0ec5849d98b1cc0fc83cc51a6 P c11aeb9ac7f04cceb63233785ce00503: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.405
I20260807 13:51:36.943961 32529 log.cc:1199] T f9f996c0ec5849d98b1cc0fc83cc51a6 P c11aeb9ac7f04cceb63233785ce00503: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/wals/f9f996c0ec5849d98b1cc0fc83cc51a6
I20260807 13:51:36.982892 28375 catalog_manager.cc:5028] TS c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571): tablet f9f996c0ec5849d98b1cc0fc83cc51a6 (table rebalance_test_table_0 [id=2f5b82068ed242bcb08a733f8a0d94df]) successfully deleted
W20260807 13:51:37.529412 28662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:34213, user_credentials={real_user=slave}} blocked reactor thread for 59613.4us
I20260807 13:51:38.277575 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:51:38.537981 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:51:38.543545 28724 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:51:38.647123 30396 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:38.696759 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:38.707959 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
W20260807 13:51:38.837735 28663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.129:37223, user_credentials={real_user=slave}} blocked reactor thread for 53855.6us
W20260807 13:51:38.940749 28662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:34213, user_credentials={real_user=slave}} blocked reactor thread for 43645.6us
I20260807 13:51:38.945289 30758 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260807 13:51:39.691563 28662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.134:41561, user_credentials={real_user=slave}} blocked reactor thread for 50841.7us
I20260807 13:51:39.955304 28748 consensus_queue.cc:237] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 419, Committed index: 419, Last appended: 1.419, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 420 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } }
I20260807 13:51:39.965005 30247 raft_consensus.cc:1275] T ba6d87b94369439dac8c8355d744a7f3 P c45d5217722649e6bdbccee30863591b [term 1 FOLLOWER]: Refusing update from remote peer 9da72b03880d4414b034964abe86d4fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 419. Preceding OpId from leader: term: 1 index: 420. (index mismatch)
I20260807 13:51:39.969940 32469 consensus_queue.cc:1048] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 420, Last known committed idx: 419, Time since last communication: 0.000s
I20260807 13:51:40.006031 32339 raft_consensus.cc:2955] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe [term 1 LEADER]: Committing config change with OpId 1.420: config changed from index 154 to 420, VOTER c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131) evicted. New config: { opid_index: 420 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } }
I20260807 13:51:40.014463 28383 catalog_manager.cc:5697] T ba6d87b94369439dac8c8355d744a7f3 P 9da72b03880d4414b034964abe86d4fe reported cstate change: config changed from index 154 to 420, VOTER c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131) evicted. New cstate: current_term: 1 leader_uuid: "9da72b03880d4414b034964abe86d4fe" committed_config { opid_index: 420 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } }
I20260807 13:51:40.018450 30247 raft_consensus.cc:2955] T ba6d87b94369439dac8c8355d744a7f3 P c45d5217722649e6bdbccee30863591b [term 1 FOLLOWER]: Committing config change with OpId 1.420: config changed from index 154 to 420, VOTER c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131) evicted. New config: { opid_index: 420 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } }
I20260807 13:51:40.293776 28895 tablet_service.cc:1558] Processing DeleteTablet for tablet ba6d87b94369439dac8c8355d744a7f3 with delete_type TABLET_DATA_TOMBSTONED (TS c11aeb9ac7f04cceb63233785ce00503 not found in new config with opid_index 420) from {username='slave'} at 127.0.0.1:39832
I20260807 13:51:40.295324 32668 tablet_replica.cc:333] T ba6d87b94369439dac8c8355d744a7f3 P c11aeb9ac7f04cceb63233785ce00503: stopping tablet replica
I20260807 13:51:40.295605 32668 raft_consensus.cc:2243] T ba6d87b94369439dac8c8355d744a7f3 P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:51:40.295872 32668 raft_consensus.cc:2272] T ba6d87b94369439dac8c8355d744a7f3 P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:51:40.305208 32668 ts_tablet_manager.cc:1916] T ba6d87b94369439dac8c8355d744a7f3 P c11aeb9ac7f04cceb63233785ce00503: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:51:40.465567 32668 ts_tablet_manager.cc:1929] T ba6d87b94369439dac8c8355d744a7f3 P c11aeb9ac7f04cceb63233785ce00503: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.419
I20260807 13:51:40.465744 32668 log.cc:1199] T ba6d87b94369439dac8c8355d744a7f3 P c11aeb9ac7f04cceb63233785ce00503: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/wals/ba6d87b94369439dac8c8355d744a7f3
I20260807 13:51:40.469626 28375 catalog_manager.cc:5028] TS c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571): tablet ba6d87b94369439dac8c8355d744a7f3 (table rebalance_test_table_4 [id=2b6a5ac0e14d42a0b4c4bcc31b2a8e84]) successfully deleted
I20260807 13:51:40.910722 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:51:41.017462 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:41.068111 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:51:41.089984 30396 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:41.128666 30758 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:41.128674 28724 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:51:41.302511 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260807 13:51:41.470809 28661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.135:39559, user_credentials={real_user=slave}} blocked reactor thread for 61229.3us
I20260807 13:51:42.098914 28746 consensus_queue.cc:237] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 465, Committed index: 465, Last appended: 1.465, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 466 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } }
I20260807 13:51:42.117928 30247 raft_consensus.cc:1275] T 3da3196623e04606aca463b8847ab6cd P c45d5217722649e6bdbccee30863591b [term 1 FOLLOWER]: Refusing update from remote peer 9da72b03880d4414b034964abe86d4fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 465. Preceding OpId from leader: term: 1 index: 466. (index mismatch)
I20260807 13:51:42.118853 32631 consensus_queue.cc:1048] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 466, Last known committed idx: 465, Time since last communication: 0.000s
I20260807 13:51:42.122524 32556 raft_consensus.cc:2955] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe [term 1 LEADER]: Committing config change with OpId 1.466: config changed from index 96 to 466, VOTER 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129) evicted. New config: { opid_index: 466 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } }
I20260807 13:51:42.130189 30247 raft_consensus.cc:2955] T 3da3196623e04606aca463b8847ab6cd P c45d5217722649e6bdbccee30863591b [term 1 FOLLOWER]: Committing config change with OpId 1.466: config changed from index 96 to 466, VOTER 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129) evicted. New config: { opid_index: 466 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } }
I20260807 13:51:42.137949 28384 catalog_manager.cc:5697] T 3da3196623e04606aca463b8847ab6cd P 9da72b03880d4414b034964abe86d4fe reported cstate change: config changed from index 96 to 466, VOTER 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129) evicted. New cstate: current_term: 1 leader_uuid: "9da72b03880d4414b034964abe86d4fe" committed_config { opid_index: 466 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } }
W20260807 13:51:42.392561 28835 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.129:37223, user_credentials={real_user=slave}} blocked reactor thread for 47289.4us
I20260807 13:51:42.392947 28551 tablet_service.cc:1558] Processing DeleteTablet for tablet 3da3196623e04606aca463b8847ab6cd with delete_type TABLET_DATA_TOMBSTONED (TS 0ea2e5a5c2b0429985eb26f907033c9b not found in new config with opid_index 466) from {username='slave'} at 127.0.0.1:60692
I20260807 13:51:42.404605 312 tablet_replica.cc:333] T 3da3196623e04606aca463b8847ab6cd P 0ea2e5a5c2b0429985eb26f907033c9b: stopping tablet replica
I20260807 13:51:42.405038 312 raft_consensus.cc:2243] T 3da3196623e04606aca463b8847ab6cd P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:51:42.405601 312 pending_rounds.cc:70] T 3da3196623e04606aca463b8847ab6cd P 0ea2e5a5c2b0429985eb26f907033c9b: Trying to abort 1 pending ops.
I20260807 13:51:42.408476 312 pending_rounds.cc:77] T 3da3196623e04606aca463b8847ab6cd P 0ea2e5a5c2b0429985eb26f907033c9b: Aborting op as it isn't in flight: id { term: 1 index: 465 } timestamp: 7315909435694297088 op_type: WRITE_OP write_request { tablet_id: "3da3196623e04606aca463b8847ab6cd" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000\242\020\320\004\251l\262\263\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""81d4b465671ea7a6" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7315909435594199040 authz_token { token_data: "\010\364\307\327\323\006\"3\n\005slave\022*\n 49c4a818a68345dca0cf504531ad490a\020\001\030\001 \001(\001" signature: "<redacted>""\225\'\304\222oy\257r\207$\262.O\272*:\201\016\177\327*.\202BvZ\346G\033ji\237/ \305\027+9\351n1N\311\277j$\232\375:H\355\272J\245\267b4\266\026\233h\\q\344" signing_key_seq_num: 0 } } request_id { client_id: "21820689223b4cf385058c6d7522b866" seq_no: 1409 first_incomplete_seq_no: 1409 attempt_no: 0 }
I20260807 13:51:42.410208 312 raft_consensus.cc:2272] T 3da3196623e04606aca463b8847ab6cd P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:51:42.412137 312 ts_tablet_manager.cc:1916] T 3da3196623e04606aca463b8847ab6cd P 0ea2e5a5c2b0429985eb26f907033c9b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:51:42.433630 312 ts_tablet_manager.cc:1929] T 3da3196623e04606aca463b8847ab6cd P 0ea2e5a5c2b0429985eb26f907033c9b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.465
I20260807 13:51:42.434334 312 log.cc:1199] T 3da3196623e04606aca463b8847ab6cd P 0ea2e5a5c2b0429985eb26f907033c9b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/wals/3da3196623e04606aca463b8847ab6cd
I20260807 13:51:42.436033 28376 catalog_manager.cc:5028] TS 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223): tablet 3da3196623e04606aca463b8847ab6cd (table rebalance_test_table_1 [id=49c4a818a68345dca0cf504531ad490a]) successfully deleted
I20260807 13:51:43.375406 28724 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:51:43.379860 30396 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:43.394472 30758 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:43.466813 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:51:43.726186 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:51:43.751327 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
W20260807 13:51:43.864930 30165 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.527s user 0.078s sys 0.109s
W20260807 13:51:43.865235 30165 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.528s user 0.078s sys 0.110s
I20260807 13:51:44.099139 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260807 13:51:44.816818 30926 log.cc:927] Time spent T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b: Append to log took a long time: real 0.051s user 0.013s sys 0.000s
I20260807 13:51:45.048998 28748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1592525dd2a646de874117d51026e771"
dest_uuid: "9da72b03880d4414b034964abe86d4fe"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:59586
I20260807 13:51:45.050303 28748 raft_consensus.cc:606] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [term 1 LEADER]: Received request to transfer leadership
W20260807 13:51:45.158401 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40266: Service unavailable: leader transfer in progress
W20260807 13:51:45.175285 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40266: Service unavailable: leader transfer in progress
W20260807 13:51:45.180384 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40266: Service unavailable: leader transfer in progress
W20260807 13:51:45.194761 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40266: Service unavailable: leader transfer in progress
W20260807 13:51:45.207790 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40266: Service unavailable: leader transfer in progress
W20260807 13:51:45.220772 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40266: Service unavailable: leader transfer in progress
W20260807 13:51:45.235299 28696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40266: Service unavailable: leader transfer in progress
W20260807 13:51:45.252317 28696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40266: Service unavailable: leader transfer in progress
W20260807 13:51:45.268422 28696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40266: Service unavailable: leader transfer in progress
W20260807 13:51:45.294386 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40266: Service unavailable: leader transfer in progress
W20260807 13:51:45.307523 28696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40266: Service unavailable: leader transfer in progress
W20260807 13:51:45.323174 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40266: Service unavailable: leader transfer in progress
W20260807 13:51:45.356941 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40266: Service unavailable: leader transfer in progress
I20260807 13:51:45.372377 32631 raft_consensus.cc:993] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe: : Instructing follower 0ea2e5a5c2b0429985eb26f907033c9b to start an election
I20260807 13:51:45.372749 32631 raft_consensus.cc:1081] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [term 1 LEADER]: Signalling peer 0ea2e5a5c2b0429985eb26f907033c9b to start an election
W20260807 13:51:45.375617 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40266: Service unavailable: leader transfer in progress
I20260807 13:51:45.375993 28577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1592525dd2a646de874117d51026e771"
dest_uuid: "0ea2e5a5c2b0429985eb26f907033c9b"
from {username='slave'} at 127.23.107.130:46053
I20260807 13:51:45.376287 28577 raft_consensus.cc:493] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:51:45.376464 28577 raft_consensus.cc:3060] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:51:45.396646 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40266: Service unavailable: leader transfer in progress
I20260807 13:51:45.398604 28577 raft_consensus.cc:515] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 141 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:51:45.399856 28577 leader_election.cc:290] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b [CANDIDATE]: Term 2 election: Requested vote from peers 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223), 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134:41561)
I20260807 13:51:45.402184 30591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1592525dd2a646de874117d51026e771" candidate_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 503 } } ignore_live_leader: true dest_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a"
I20260807 13:51:45.402616 30591 raft_consensus.cc:3060] T 1592525dd2a646de874117d51026e771 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:51:45.419207 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40266: Service unavailable: leader transfer in progress
I20260807 13:51:45.421695 30591 raft_consensus.cc:2468] T 1592525dd2a646de874117d51026e771 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ea2e5a5c2b0429985eb26f907033c9b in term 2.
I20260807 13:51:45.423964 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1592525dd2a646de874117d51026e771" candidate_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 503 } } ignore_live_leader: true dest_uuid: "9da72b03880d4414b034964abe86d4fe"
I20260807 13:51:45.424203 28748 raft_consensus.cc:3055] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:51:45.424379 28748 raft_consensus.cc:740] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9da72b03880d4414b034964abe86d4fe, State: Running, Role: LEADER
I20260807 13:51:45.424880 28748 consensus_queue.cc:260] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 503, Committed index: 503, Last appended: 1.503, Last appended by leader: 503, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 141 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:51:45.425618 28748 raft_consensus.cc:3060] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:51:45.430204 28748 raft_consensus.cc:2468] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ea2e5a5c2b0429985eb26f907033c9b in term 2.
I20260807 13:51:45.435766 28493 leader_election.cc:304] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ea2e5a5c2b0429985eb26f907033c9b, 9da72b03880d4414b034964abe86d4fe; no voters:
I20260807 13:51:45.436643 374 raft_consensus.cc:2804] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:51:45.436782 374 raft_consensus.cc:697] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b [term 2 LEADER]: Becoming Leader. State: Replica: 0ea2e5a5c2b0429985eb26f907033c9b, State: Running, Role: LEADER
I20260807 13:51:45.437074 374 consensus_queue.cc:237] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 503, Committed index: 503, Last appended: 1.503, Last appended by leader: 503, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 141 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
W20260807 13:51:45.439726 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40266: Illegal state: replica 9da72b03880d4414b034964abe86d4fe is not leader of this config: current role FOLLOWER
I20260807 13:51:45.468972 28384 catalog_manager.cc:5697] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b reported cstate change: term changed from 1 to 2, leader changed from 9da72b03880d4414b034964abe86d4fe (127.23.107.130) to 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129). New cstate: current_term: 2 leader_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" committed_config { opid_index: 141 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
I20260807 13:51:45.672204 30595 raft_consensus.cc:1275] T 1592525dd2a646de874117d51026e771 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 2 FOLLOWER]: Refusing update from remote peer 0ea2e5a5c2b0429985eb26f907033c9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 503. Preceding OpId from leader: term: 2 index: 505. (index mismatch)
I20260807 13:51:45.672855 374 consensus_queue.cc:1048] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 504, Last known committed idx: 503, Time since last communication: 0.000s
I20260807 13:51:45.677492 28748 raft_consensus.cc:1275] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [term 2 FOLLOWER]: Refusing update from remote peer 0ea2e5a5c2b0429985eb26f907033c9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 503. Preceding OpId from leader: term: 2 index: 505. (index mismatch)
I20260807 13:51:45.682189 32551 mvcc.cc:204] Tried to move back new op lower bound from 7315909450423017472 to 7315909449475678208. Current Snapshot: MvccSnapshot[applied={T|T < 7315909450423017472 or (T in {7315909450423017472})}]
I20260807 13:51:45.682914 405 consensus_queue.cc:1048] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 504, Last known committed idx: 503, Time since last communication: 0.000s
I20260807 13:51:45.690433 380 mvcc.cc:204] Tried to move back new op lower bound from 7315909450423017472 to 7315909449475678208. Current Snapshot: MvccSnapshot[applied={T|T < 7315909450423017472}]
I20260807 13:51:46.160576 28551 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:51:46.177107 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:51:46.265393 28724 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:51:46.294126 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:46.366742 30758 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:46.367606 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:51:46.485248 30396 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260807 13:51:46.833142 28490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.133:34943, user_credentials={real_user=slave}} blocked reactor thread for 55099.5us
I20260807 13:51:48.604091 28724 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:51:48.604404 28551 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:51:48.620754 30396 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:48.688500 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:51:48.688743 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260807 13:51:48.731794 28662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.131:41571, user_credentials={real_user=slave}} blocked reactor thread for 52611.4us
I20260807 13:51:48.747228 30758 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260807 13:51:48.797457 28662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:34213, user_credentials={real_user=slave}} blocked reactor thread for 55442.4us
I20260807 13:51:48.872244 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:51:49.930186 28917 consensus_queue.cc:237] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 529, Committed index: 529, Last appended: 1.529, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 530 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } }
I20260807 13:51:49.932612 30778 raft_consensus.cc:1275] T 79268a57a70b4612aff6405c6d587f33 P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Refusing update from remote peer c11aeb9ac7f04cceb63233785ce00503: Log matching property violated. Preceding OpId in replica: term: 1 index: 529. Preceding OpId from leader: term: 1 index: 530. (index mismatch)
I20260807 13:51:49.933442 522 consensus_queue.cc:1048] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 530, Last known committed idx: 529, Time since last communication: 0.000s
I20260807 13:51:49.949122 589 raft_consensus.cc:2955] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 [term 1 LEADER]: Committing config change with OpId 1.530: config changed from index 57 to 530, VOTER 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129) evicted. New config: { opid_index: 530 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } }
I20260807 13:51:49.954501 30778 raft_consensus.cc:2955] T 79268a57a70b4612aff6405c6d587f33 P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Committing config change with OpId 1.530: config changed from index 57 to 530, VOTER 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129) evicted. New config: { opid_index: 530 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } }
I20260807 13:51:50.048923 28382 catalog_manager.cc:5697] T 79268a57a70b4612aff6405c6d587f33 P c11aeb9ac7f04cceb63233785ce00503 reported cstate change: config changed from index 57 to 530, VOTER 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129) evicted. New cstate: current_term: 1 leader_uuid: "c11aeb9ac7f04cceb63233785ce00503" committed_config { opid_index: 530 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } }
I20260807 13:51:50.099545 28551 tablet_service.cc:1558] Processing DeleteTablet for tablet 79268a57a70b4612aff6405c6d587f33 with delete_type TABLET_DATA_TOMBSTONED (TS 0ea2e5a5c2b0429985eb26f907033c9b not found in new config with opid_index 530) from {username='slave'} at 127.0.0.1:60692
I20260807 13:51:50.109004 639 tablet_replica.cc:333] T 79268a57a70b4612aff6405c6d587f33 P 0ea2e5a5c2b0429985eb26f907033c9b: stopping tablet replica
I20260807 13:51:50.109290 639 raft_consensus.cc:2243] T 79268a57a70b4612aff6405c6d587f33 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:51:50.109544 639 raft_consensus.cc:2272] T 79268a57a70b4612aff6405c6d587f33 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:51:50.131901 639 ts_tablet_manager.cc:1916] T 79268a57a70b4612aff6405c6d587f33 P 0ea2e5a5c2b0429985eb26f907033c9b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:51:50.148566 639 ts_tablet_manager.cc:1929] T 79268a57a70b4612aff6405c6d587f33 P 0ea2e5a5c2b0429985eb26f907033c9b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.529
I20260807 13:51:50.148746 639 log.cc:1199] T 79268a57a70b4612aff6405c6d587f33 P 0ea2e5a5c2b0429985eb26f907033c9b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/wals/79268a57a70b4612aff6405c6d587f33
I20260807 13:51:50.160343 28376 catalog_manager.cc:5028] TS 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223): tablet 79268a57a70b4612aff6405c6d587f33 (table rebalance_test_table_4 [id=2b6a5ac0e14d42a0b4c4bcc31b2a8e84]) successfully deleted
I20260807 13:51:51.806649 28551 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:51:51.974620 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:51:51.991995 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:51:51.995116 30396 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:52.077926 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:52.119170 30758 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:52.175899 28724 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:51:52.850814 28746 consensus_queue.cc:237] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 630, Committed index: 630, Last appended: 1.630, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 631 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } }
I20260807 13:51:52.854976 30782 raft_consensus.cc:1275] T ae179f753242471eb4484553d9df106b P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Refusing update from remote peer 9da72b03880d4414b034964abe86d4fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 630. Preceding OpId from leader: term: 1 index: 631. (index mismatch)
I20260807 13:51:52.855659 580 consensus_queue.cc:1048] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 631, Last known committed idx: 630, Time since last communication: 0.001s
I20260807 13:51:52.862280 30779 raft_consensus.cc:2955] T ae179f753242471eb4484553d9df106b P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Committing config change with OpId 1.631: config changed from index 97 to 631, VOTER c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131) evicted. New config: { opid_index: 631 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } }
I20260807 13:51:52.866237 32631 raft_consensus.cc:2955] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe [term 1 LEADER]: Committing config change with OpId 1.631: config changed from index 97 to 631, VOTER c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131) evicted. New config: { opid_index: 631 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } }
I20260807 13:51:52.882874 28382 catalog_manager.cc:5697] T ae179f753242471eb4484553d9df106b P 9da72b03880d4414b034964abe86d4fe reported cstate change: config changed from index 97 to 631, VOTER c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131) evicted. New cstate: current_term: 1 leader_uuid: "9da72b03880d4414b034964abe86d4fe" committed_config { opid_index: 631 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } }
I20260807 13:51:53.161190 28895 tablet_service.cc:1558] Processing DeleteTablet for tablet ae179f753242471eb4484553d9df106b with delete_type TABLET_DATA_TOMBSTONED (TS c11aeb9ac7f04cceb63233785ce00503 not found in new config with opid_index 631) from {username='slave'} at 127.0.0.1:39832
I20260807 13:51:53.179229 797 tablet_replica.cc:333] T ae179f753242471eb4484553d9df106b P c11aeb9ac7f04cceb63233785ce00503: stopping tablet replica
I20260807 13:51:53.209748 797 raft_consensus.cc:2243] T ae179f753242471eb4484553d9df106b P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:51:53.210265 797 raft_consensus.cc:2272] T ae179f753242471eb4484553d9df106b P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:51:53.214602 797 ts_tablet_manager.cc:1916] T ae179f753242471eb4484553d9df106b P c11aeb9ac7f04cceb63233785ce00503: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:51:53.245498 797 ts_tablet_manager.cc:1929] T ae179f753242471eb4484553d9df106b P c11aeb9ac7f04cceb63233785ce00503: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.630
I20260807 13:51:53.245718 797 log.cc:1199] T ae179f753242471eb4484553d9df106b P c11aeb9ac7f04cceb63233785ce00503: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/wals/ae179f753242471eb4484553d9df106b
I20260807 13:51:53.260989 28375 catalog_manager.cc:5028] TS c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571): tablet ae179f753242471eb4484553d9df106b (table rebalance_test_table_2 [id=46bf349795f3453589935822245c96b1]) successfully deleted
I20260807 13:51:54.030553 30396 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:54.064492 28551 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:51:54.079766 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:51:54.193658 28724 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:51:54.415413 30758 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:54.416263 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:51:54.437849 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:55.438226 28577 consensus_queue.cc:237] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 636, Committed index: 636, Last appended: 1.636, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 637 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:51:55.442770 30591 raft_consensus.cc:1275] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Refusing update from remote peer 0ea2e5a5c2b0429985eb26f907033c9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 636. Preceding OpId from leader: term: 1 index: 637. (index mismatch)
I20260807 13:51:55.445214 818 consensus_queue.cc:1048] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 637, Last known committed idx: 636, Time since last communication: 0.000s
I20260807 13:51:55.448519 374 raft_consensus.cc:2955] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 LEADER]: Committing config change with OpId 1.637: config changed from index 115 to 637, VOTER c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131) evicted. New config: { opid_index: 637 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
I20260807 13:51:55.457280 28383 catalog_manager.cc:5697] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b reported cstate change: config changed from index 115 to 637, VOTER c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131) evicted. New cstate: current_term: 1 leader_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" committed_config { opid_index: 637 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
I20260807 13:51:55.478416 30595 raft_consensus.cc:2955] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Committing config change with OpId 1.637: config changed from index 115 to 637, VOTER c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131) evicted. New config: { opid_index: 637 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
I20260807 13:51:55.686751 28895 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a7f0c232a674615a2cf5c3c06abd8a8 with delete_type TABLET_DATA_TOMBSTONED (TS c11aeb9ac7f04cceb63233785ce00503 not found in new config with opid_index 637) from {username='slave'} at 127.0.0.1:39832
I20260807 13:51:55.738808 920 tablet_replica.cc:333] T 7a7f0c232a674615a2cf5c3c06abd8a8 P c11aeb9ac7f04cceb63233785ce00503: stopping tablet replica
I20260807 13:51:55.739318 920 raft_consensus.cc:2243] T 7a7f0c232a674615a2cf5c3c06abd8a8 P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:51:55.740180 920 raft_consensus.cc:2272] T 7a7f0c232a674615a2cf5c3c06abd8a8 P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:51:55.741735 920 ts_tablet_manager.cc:1916] T 7a7f0c232a674615a2cf5c3c06abd8a8 P c11aeb9ac7f04cceb63233785ce00503: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:51:55.766605 920 ts_tablet_manager.cc:1929] T 7a7f0c232a674615a2cf5c3c06abd8a8 P c11aeb9ac7f04cceb63233785ce00503: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.636
I20260807 13:51:55.766865 920 log.cc:1199] T 7a7f0c232a674615a2cf5c3c06abd8a8 P c11aeb9ac7f04cceb63233785ce00503: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/wals/7a7f0c232a674615a2cf5c3c06abd8a8
I20260807 13:51:55.770481 28375 catalog_manager.cc:5028] TS c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571): tablet 7a7f0c232a674615a2cf5c3c06abd8a8 (table rebalance_test_table_1 [id=49c4a818a68345dca0cf504531ad490a]) successfully deleted
W20260807 13:51:56.765785 28831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.133:34943, user_credentials={real_user=slave}} blocked reactor thread for 59186.9us
I20260807 13:51:57.034837 28551 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:51:57.119737 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:51:57.166486 30396 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:57.180946 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:51:57.199010 30758 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260807 13:51:57.236708 28662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:34213, user_credentials={real_user=slave}} blocked reactor thread for 43571.8us
I20260807 13:51:57.435830 28724 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:51:57.444516 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260807 13:51:57.559270 28490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.133:34943, user_credentials={real_user=slave}} blocked reactor thread for 97322.9us
I20260807 13:51:58.159514 28920 consensus_queue.cc:237] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 720, Committed index: 720, Last appended: 1.720, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 721 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:51:58.163825 30591 raft_consensus.cc:1275] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Refusing update from remote peer c11aeb9ac7f04cceb63233785ce00503: Log matching property violated. Preceding OpId in replica: term: 1 index: 720. Preceding OpId from leader: term: 1 index: 721. (index mismatch)
I20260807 13:51:58.165051 696 consensus_queue.cc:1048] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 721, Last known committed idx: 720, Time since last communication: 0.000s
I20260807 13:51:58.168071 949 raft_consensus.cc:2955] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [term 1 LEADER]: Committing config change with OpId 1.721: config changed from index 89 to 721, VOTER 9da72b03880d4414b034964abe86d4fe (127.23.107.130) evicted. New config: { opid_index: 721 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
I20260807 13:51:58.171698 30599 raft_consensus.cc:2955] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Committing config change with OpId 1.721: config changed from index 89 to 721, VOTER 9da72b03880d4414b034964abe86d4fe (127.23.107.130) evicted. New config: { opid_index: 721 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
I20260807 13:51:58.179627 28383 catalog_manager.cc:5697] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 reported cstate change: config changed from index 89 to 721, VOTER 9da72b03880d4414b034964abe86d4fe (127.23.107.130) evicted. New cstate: current_term: 1 leader_uuid: "c11aeb9ac7f04cceb63233785ce00503" committed_config { opid_index: 721 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
I20260807 13:51:58.288538 28724 tablet_service.cc:1558] Processing DeleteTablet for tablet c72c9d7fb3364b2485475585dc6f244a with delete_type TABLET_DATA_TOMBSTONED (TS 9da72b03880d4414b034964abe86d4fe not found in new config with opid_index 721) from {username='slave'} at 127.0.0.1:55848
I20260807 13:51:58.291107 1042 tablet_replica.cc:333] T c72c9d7fb3364b2485475585dc6f244a P 9da72b03880d4414b034964abe86d4fe: stopping tablet replica
I20260807 13:51:58.291404 1042 raft_consensus.cc:2243] T c72c9d7fb3364b2485475585dc6f244a P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:51:58.292138 1042 raft_consensus.cc:2272] T c72c9d7fb3364b2485475585dc6f244a P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:51:58.293442 1042 ts_tablet_manager.cc:1916] T c72c9d7fb3364b2485475585dc6f244a P 9da72b03880d4414b034964abe86d4fe: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:51:58.303480 1042 ts_tablet_manager.cc:1929] T c72c9d7fb3364b2485475585dc6f244a P 9da72b03880d4414b034964abe86d4fe: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.720
I20260807 13:51:58.303730 1042 log.cc:1199] T c72c9d7fb3364b2485475585dc6f244a P 9da72b03880d4414b034964abe86d4fe: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/c72c9d7fb3364b2485475585dc6f244a
I20260807 13:51:58.306998 28375 catalog_manager.cc:5028] TS 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223): tablet c72c9d7fb3364b2485475585dc6f244a (table rebalance_test_table_0 [id=2f5b82068ed242bcb08a733f8a0d94df]) successfully deleted
W20260807 13:51:58.904639 28493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.134:41561, user_credentials={real_user=slave}} blocked reactor thread for 58778.4us
I20260807 13:51:59.100839 28551 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:51:59.178610 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:51:59.190790 30396 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:59.234043 28724 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:51:59.268756 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:51:59.299764 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:51:59.338487 30758 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:00.180056 28577 consensus_queue.cc:237] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 669, Committed index: 669, Last appended: 1.670, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 671 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } }
I20260807 13:52:00.184227 30421 raft_consensus.cc:1275] T 5daf3681a6ba460385331aadffabfa8f P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Refusing update from remote peer 0ea2e5a5c2b0429985eb26f907033c9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 670. Preceding OpId from leader: term: 1 index: 671. (index mismatch)
I20260807 13:52:00.185173 739 consensus_queue.cc:1048] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 671, Last known committed idx: 669, Time since last communication: 0.000s
I20260807 13:52:00.187978 1058 raft_consensus.cc:2955] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 LEADER]: Committing config change with OpId 1.671: config changed from index 107 to 671, VOTER 9da72b03880d4414b034964abe86d4fe (127.23.107.130) evicted. New config: { opid_index: 671 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } } }
I20260807 13:52:00.189222 30419 raft_consensus.cc:2955] T 5daf3681a6ba460385331aadffabfa8f P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Committing config change with OpId 1.671: config changed from index 107 to 671, VOTER 9da72b03880d4414b034964abe86d4fe (127.23.107.130) evicted. New config: { opid_index: 671 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } } }
I20260807 13:52:00.242679 28382 catalog_manager.cc:5697] T 5daf3681a6ba460385331aadffabfa8f P 0ea2e5a5c2b0429985eb26f907033c9b reported cstate change: config changed from index 107 to 671, VOTER 9da72b03880d4414b034964abe86d4fe (127.23.107.130) evicted. New cstate: current_term: 1 leader_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" committed_config { opid_index: 671 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } } }
I20260807 13:52:00.273618 28724 tablet_service.cc:1558] Processing DeleteTablet for tablet 5daf3681a6ba460385331aadffabfa8f with delete_type TABLET_DATA_TOMBSTONED (TS 9da72b03880d4414b034964abe86d4fe not found in new config with opid_index 671) from {username='slave'} at 127.0.0.1:55848
I20260807 13:52:00.316202 1154 tablet_replica.cc:333] T 5daf3681a6ba460385331aadffabfa8f P 9da72b03880d4414b034964abe86d4fe: stopping tablet replica
I20260807 13:52:00.316587 1154 raft_consensus.cc:2243] T 5daf3681a6ba460385331aadffabfa8f P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:52:00.316866 1154 pending_rounds.cc:70] T 5daf3681a6ba460385331aadffabfa8f P 9da72b03880d4414b034964abe86d4fe: Trying to abort 1 pending ops.
I20260807 13:52:00.317178 1154 pending_rounds.cc:77] T 5daf3681a6ba460385331aadffabfa8f P 9da72b03880d4414b034964abe86d4fe: Aborting op as it isn't in flight: id { term: 1 index: 670 } timestamp: 7315909509770203136 op_type: WRITE_OP write_request { tablet_id: "5daf3681a6ba460385331aadffabfa8f" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000\374\336>_\024H\344\033\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""7f4fcd2b204dc50c" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7315909509686571008 authz_token { token_data: "\010\364\307\327\323\006\"3\n\005slave\022*\n 6232d7b2b0b5403c842e16fd04e72177\020\001\030\001 \001(\001" signature: "<redacted>""ZG\033\362Z\225\023\351.\010.\177\352\024k\030\310\263\007<\347\301lI\017\325o\237w\313\276\342\231\277\200\355N\230\251\353Z\031\264\331\000\001(f\272\0225\337\223p\202\3562t\236\366\373#\250\262" signing_key_seq_num: 0 } } request_id { client_id: "6713978fd9004f64a5d0557390c2dc85" seq_no: 2002 first_incomplete_seq_no: 2002 attempt_no: 0 }
I20260807 13:52:00.318662 1154 raft_consensus.cc:2272] T 5daf3681a6ba460385331aadffabfa8f P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:52:00.327616 1154 ts_tablet_manager.cc:1916] T 5daf3681a6ba460385331aadffabfa8f P 9da72b03880d4414b034964abe86d4fe: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:52:00.340323 1154 ts_tablet_manager.cc:1929] T 5daf3681a6ba460385331aadffabfa8f P 9da72b03880d4414b034964abe86d4fe: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.670
I20260807 13:52:00.340656 1154 log.cc:1199] T 5daf3681a6ba460385331aadffabfa8f P 9da72b03880d4414b034964abe86d4fe: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/5daf3681a6ba460385331aadffabfa8f
I20260807 13:52:00.342121 28375 catalog_manager.cc:5028] TS 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223): tablet 5daf3681a6ba460385331aadffabfa8f (table rebalance_test_table_3 [id=6232d7b2b0b5403c842e16fd04e72177]) successfully deleted
I20260807 13:52:02.501662 28551 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:02.589365 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:02.623883 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:02.625316 28724 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:02.690914 30396 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:02.711725 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:02.725639 30758 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260807 13:52:03.271898 28832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.134:41561, user_credentials={real_user=slave}} blocked reactor thread for 49785.5us
I20260807 13:52:03.617620 28574 consensus_queue.cc:237] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 691, Committed index: 691, Last appended: 2.691, Last appended by leader: 503, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 692 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:52:03.625779 30599 raft_consensus.cc:1275] T 1592525dd2a646de874117d51026e771 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 2 FOLLOWER]: Refusing update from remote peer 0ea2e5a5c2b0429985eb26f907033c9b: Log matching property violated. Preceding OpId in replica: term: 2 index: 690. Preceding OpId from leader: term: 2 index: 692. (index mismatch)
I20260807 13:52:03.627619 867 consensus_queue.cc:1048] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 692, Last known committed idx: 689, Time since last communication: 0.000s
I20260807 13:52:03.677944 374 raft_consensus.cc:2955] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b [term 2 LEADER]: Committing config change with OpId 2.692: config changed from index 141 to 692, VOTER 9da72b03880d4414b034964abe86d4fe (127.23.107.130) evicted. New config: { opid_index: 692 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
I20260807 13:52:03.687176 28383 catalog_manager.cc:5697] T 1592525dd2a646de874117d51026e771 P 0ea2e5a5c2b0429985eb26f907033c9b reported cstate change: config changed from index 141 to 692, VOTER 9da72b03880d4414b034964abe86d4fe (127.23.107.130) evicted. New cstate: current_term: 2 leader_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" committed_config { opid_index: 692 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
I20260807 13:52:03.701217 30595 raft_consensus.cc:2955] T 1592525dd2a646de874117d51026e771 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 2 FOLLOWER]: Committing config change with OpId 2.692: config changed from index 141 to 692, VOTER 9da72b03880d4414b034964abe86d4fe (127.23.107.130) evicted. New config: { opid_index: 692 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
I20260807 13:52:03.779421 28724 tablet_service.cc:1558] Processing DeleteTablet for tablet 1592525dd2a646de874117d51026e771 with delete_type TABLET_DATA_TOMBSTONED (TS 9da72b03880d4414b034964abe86d4fe not found in new config with opid_index 692) from {username='slave'} at 127.0.0.1:55848
I20260807 13:52:03.853327 1348 tablet_replica.cc:333] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe: stopping tablet replica
I20260807 13:52:03.853672 1348 raft_consensus.cc:2243] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:52:03.853943 1348 raft_consensus.cc:2272] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:52:03.855120 1348 ts_tablet_manager.cc:1916] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:52:03.861227 1348 ts_tablet_manager.cc:1929] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.691
I20260807 13:52:03.861709 1348 log.cc:1199] T 1592525dd2a646de874117d51026e771 P 9da72b03880d4414b034964abe86d4fe: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/1592525dd2a646de874117d51026e771
I20260807 13:52:03.879050 28375 catalog_manager.cc:5028] TS 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223): tablet 1592525dd2a646de874117d51026e771 (table rebalance_test_table_4 [id=2b6a5ac0e14d42a0b4c4bcc31b2a8e84]) successfully deleted
I20260807 13:52:05.717947 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:05.756995 28724 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:05.797521 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:05.800889 28551 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:05.994156 30396 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:06.074719 30758 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:06.108489 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:06.982235 28745 consensus_queue.cc:237] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 788, Committed index: 788, Last appended: 1.788, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 789 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } }
I20260807 13:52:06.988113 30241 raft_consensus.cc:1275] T 3fefa1bc622f43ca8344ddfe3522ce46 P c45d5217722649e6bdbccee30863591b [term 1 FOLLOWER]: Refusing update from remote peer 9da72b03880d4414b034964abe86d4fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 788. Preceding OpId from leader: term: 1 index: 789. (index mismatch)
I20260807 13:52:06.990114 1355 consensus_queue.cc:1048] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 789, Last known committed idx: 788, Time since last communication: 0.000s
I20260807 13:52:06.993201 1355 raft_consensus.cc:2955] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [term 1 LEADER]: Committing config change with OpId 1.789: config changed from index 346 to 789, VOTER ed5ae0647048435da282261048c04db2 (127.23.107.133) added. New config: { opid_index: 789 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } } }
I20260807 13:52:06.994239 30241 raft_consensus.cc:2955] T 3fefa1bc622f43ca8344ddfe3522ce46 P c45d5217722649e6bdbccee30863591b [term 1 FOLLOWER]: Committing config change with OpId 1.789: config changed from index 346 to 789, VOTER ed5ae0647048435da282261048c04db2 (127.23.107.133) added. New config: { opid_index: 789 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } } }
I20260807 13:52:07.004917 28383 catalog_manager.cc:5697] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe reported cstate change: config changed from index 346 to 789, VOTER ed5ae0647048435da282261048c04db2 (127.23.107.133) added. New cstate: current_term: 1 leader_uuid: "9da72b03880d4414b034964abe86d4fe" committed_config { opid_index: 789 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } } }
W20260807 13:52:07.066823 28661 consensus_peers.cc:597] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe -> Peer ed5ae0647048435da282261048c04db2 (127.23.107.133:34943): Couldn't send request to peer ed5ae0647048435da282261048c04db2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3fefa1bc622f43ca8344ddfe3522ce46. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:52:07.384020 1524 ts_tablet_manager.cc:933] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2: Initiating tablet copy from peer 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223)
I20260807 13:52:07.408696 1524 tablet_copy_client.cc:323] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.130:43223
I20260807 13:52:07.425810 28778 tablet_copy_service.cc:140] P 9da72b03880d4414b034964abe86d4fe: Received BeginTabletCopySession request for tablet 3fefa1bc622f43ca8344ddfe3522ce46 from peer ed5ae0647048435da282261048c04db2 ({username='slave'} at 127.23.107.133:49787)
I20260807 13:52:07.426101 28778 tablet_copy_service.cc:161] P 9da72b03880d4414b034964abe86d4fe: Beginning new tablet copy session on tablet 3fefa1bc622f43ca8344ddfe3522ce46 from peer ed5ae0647048435da282261048c04db2 at {username='slave'} at 127.23.107.133:49787: session id = ed5ae0647048435da282261048c04db2-3fefa1bc622f43ca8344ddfe3522ce46
I20260807 13:52:07.429868 28778 tablet_copy_source_session.cc:215] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:52:07.432849 1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fefa1bc622f43ca8344ddfe3522ce46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:52:07.453119 1524 tablet_copy_client.cc:806] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2: tablet copy: Starting download of 0 data blocks...
I20260807 13:52:07.453768 1524 tablet_copy_client.cc:670] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2: tablet copy: Starting download of 1 WAL segments...
I20260807 13:52:07.484735 1524 tablet_copy_client.cc:538] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:52:07.509603 1524 tablet_bootstrap.cc:492] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2: Bootstrap starting.
I20260807 13:52:07.878739 28574 consensus_queue.cc:237] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 846, Committed index: 846, Last appended: 1.846, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 847 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
W20260807 13:52:07.881871 28493 consensus_peers.cc:597] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b -> Peer 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134:41561): Couldn't send request to peer 22b9a9a4b1bf44daa35fcecd47b8856a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 04f1daf8b6a44274bf2cc578e93c8303. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:52:07.883263 30778 raft_consensus.cc:1275] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Refusing update from remote peer 0ea2e5a5c2b0429985eb26f907033c9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 846. Preceding OpId from leader: term: 1 index: 847. (index mismatch)
I20260807 13:52:07.884289 739 consensus_queue.cc:1048] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 847, Last known committed idx: 846, Time since last communication: 0.000s
I20260807 13:52:07.888443 739 raft_consensus.cc:2955] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 LEADER]: Committing config change with OpId 1.847: config changed from index 294 to 847, VOTER 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134) added. New config: { opid_index: 847 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
I20260807 13:52:07.891554 30781 raft_consensus.cc:2955] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Committing config change with OpId 1.847: config changed from index 294 to 847, VOTER 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134) added. New config: { opid_index: 847 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
I20260807 13:52:07.946372 28394 catalog_manager.cc:5697] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc reported cstate change: config changed from index 294 to 847, VOTER 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134) added. New cstate: current_term: 1 leader_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" committed_config { opid_index: 847 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
I20260807 13:52:08.386262 1581 ts_tablet_manager.cc:933] T 04f1daf8b6a44274bf2cc578e93c8303 P 22b9a9a4b1bf44daa35fcecd47b8856a: Initiating tablet copy from peer 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223)
I20260807 13:52:08.396404 1581 tablet_copy_client.cc:323] T 04f1daf8b6a44274bf2cc578e93c8303 P 22b9a9a4b1bf44daa35fcecd47b8856a: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:37223
I20260807 13:52:08.397483 28602 tablet_copy_service.cc:140] P 0ea2e5a5c2b0429985eb26f907033c9b: Received BeginTabletCopySession request for tablet 04f1daf8b6a44274bf2cc578e93c8303 from peer 22b9a9a4b1bf44daa35fcecd47b8856a ({username='slave'} at 127.23.107.134:46697)
I20260807 13:52:08.397656 28602 tablet_copy_service.cc:161] P 0ea2e5a5c2b0429985eb26f907033c9b: Beginning new tablet copy session on tablet 04f1daf8b6a44274bf2cc578e93c8303 from peer 22b9a9a4b1bf44daa35fcecd47b8856a at {username='slave'} at 127.23.107.134:46697: session id = 22b9a9a4b1bf44daa35fcecd47b8856a-04f1daf8b6a44274bf2cc578e93c8303
I20260807 13:52:08.401562 28602 tablet_copy_source_session.cc:215] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:52:08.403512 1581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f1daf8b6a44274bf2cc578e93c8303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:52:08.432209 1581 tablet_copy_client.cc:806] T 04f1daf8b6a44274bf2cc578e93c8303 P 22b9a9a4b1bf44daa35fcecd47b8856a: tablet copy: Starting download of 0 data blocks...
I20260807 13:52:08.433310 1581 tablet_copy_client.cc:670] T 04f1daf8b6a44274bf2cc578e93c8303 P 22b9a9a4b1bf44daa35fcecd47b8856a: tablet copy: Starting download of 1 WAL segments...
I20260807 13:52:08.448879 1581 tablet_copy_client.cc:538] T 04f1daf8b6a44274bf2cc578e93c8303 P 22b9a9a4b1bf44daa35fcecd47b8856a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:52:08.455753 1581 tablet_bootstrap.cc:492] T 04f1daf8b6a44274bf2cc578e93c8303 P 22b9a9a4b1bf44daa35fcecd47b8856a: Bootstrap starting.
I20260807 13:52:09.532928 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:09.572371 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:09.632391 30758 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260807 13:52:09.630980 28662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:34213, user_credentials={real_user=slave}} blocked reactor thread for 88870.8us
I20260807 13:52:09.676906 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:09.748397 28551 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:09.799001 28724 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:09.863521 30396 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260807 13:52:09.866575 28661 consensus_peers.cc:597] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe -> Peer ed5ae0647048435da282261048c04db2 (127.23.107.133:34943): Couldn't send request to peer ed5ae0647048435da282261048c04db2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260807 13:52:10.694394 28493 consensus_peers.cc:597] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b -> Peer 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134:41561): Couldn't send request to peer 22b9a9a4b1bf44daa35fcecd47b8856a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260807 13:52:11.306540 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260807 13:52:11.564666 28490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.133:34943, user_credentials={real_user=slave}} blocked reactor thread for 55044.7us
I20260807 13:52:11.732739 28551 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:11.755501 28724 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:11.873987 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:11.895714 30396 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:11.919792 30758 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260807 13:52:11.945204 28490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.135:39559, user_credentials={real_user=slave}} blocked reactor thread for 50192.9us
I20260807 13:52:12.248709 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:12.251209 1581 tablet_bootstrap.cc:492] T 04f1daf8b6a44274bf2cc578e93c8303 P 22b9a9a4b1bf44daa35fcecd47b8856a: Bootstrap replayed 1/1 log segments. Stats: ops{read=852 overwritten=0 applied=852 ignored=0} inserts{seen=1481 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:52:12.252111 1581 tablet_bootstrap.cc:492] T 04f1daf8b6a44274bf2cc578e93c8303 P 22b9a9a4b1bf44daa35fcecd47b8856a: Bootstrap complete.
I20260807 13:52:12.256937 1581 ts_tablet_manager.cc:1403] T 04f1daf8b6a44274bf2cc578e93c8303 P 22b9a9a4b1bf44daa35fcecd47b8856a: Time spent bootstrapping tablet: real 3.801s user 1.190s sys 0.185s
I20260807 13:52:12.258129 1581 raft_consensus.cc:359] T 04f1daf8b6a44274bf2cc578e93c8303 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 847 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:52:12.258522 1581 raft_consensus.cc:740] T 04f1daf8b6a44274bf2cc578e93c8303 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22b9a9a4b1bf44daa35fcecd47b8856a, State: Initialized, Role: FOLLOWER
I20260807 13:52:12.258906 1581 consensus_queue.cc:260] T 04f1daf8b6a44274bf2cc578e93c8303 P 22b9a9a4b1bf44daa35fcecd47b8856a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 852, Last appended: 1.852, Last appended by leader: 852, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 847 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:52:12.259610 1581 ts_tablet_manager.cc:1434] T 04f1daf8b6a44274bf2cc578e93c8303 P 22b9a9a4b1bf44daa35fcecd47b8856a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:52:12.260555 28602 tablet_copy_service.cc:342] P 0ea2e5a5c2b0429985eb26f907033c9b: Request end of tablet copy session 22b9a9a4b1bf44daa35fcecd47b8856a-04f1daf8b6a44274bf2cc578e93c8303 received from {username='slave'} at 127.23.107.134:46697
I20260807 13:52:12.260876 28602 tablet_copy_service.cc:434] P 0ea2e5a5c2b0429985eb26f907033c9b: ending tablet copy session 22b9a9a4b1bf44daa35fcecd47b8856a-04f1daf8b6a44274bf2cc578e93c8303 on tablet 04f1daf8b6a44274bf2cc578e93c8303 with peer 22b9a9a4b1bf44daa35fcecd47b8856a
W20260807 13:52:12.339424 28662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:34213, user_credentials={real_user=slave}} blocked reactor thread for 56139.2us
W20260807 13:52:12.380143 28661 consensus_peers.cc:597] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe -> Peer ed5ae0647048435da282261048c04db2 (127.23.107.133:34943): Couldn't send request to peer ed5ae0647048435da282261048c04db2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260807 13:52:12.507091 1524 tablet_bootstrap.cc:492] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2: Bootstrap replayed 1/1 log segments. Stats: ops{read=792 overwritten=0 applied=792 ignored=0} inserts{seen=1475 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:52:12.507722 1524 tablet_bootstrap.cc:492] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2: Bootstrap complete.
I20260807 13:52:12.508157 1524 ts_tablet_manager.cc:1403] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2: Time spent bootstrapping tablet: real 4.999s user 1.061s sys 0.229s
I20260807 13:52:12.509126 1524 raft_consensus.cc:359] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 789 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } }
I20260807 13:52:12.509444 1524 raft_consensus.cc:740] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed5ae0647048435da282261048c04db2, State: Initialized, Role: FOLLOWER
I20260807 13:52:12.509776 1524 consensus_queue.cc:260] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 792, Last appended: 1.792, Last appended by leader: 792, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 789 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } }
I20260807 13:52:12.520964 1524 ts_tablet_manager.cc:1434] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2: Time spent starting tablet: real 0.012s user 0.001s sys 0.003s
I20260807 13:52:12.526047 28778 tablet_copy_service.cc:342] P 9da72b03880d4414b034964abe86d4fe: Request end of tablet copy session ed5ae0647048435da282261048c04db2-3fefa1bc622f43ca8344ddfe3522ce46 received from {username='slave'} at 127.23.107.133:49787
I20260807 13:52:12.526173 28778 tablet_copy_service.cc:434] P 9da72b03880d4414b034964abe86d4fe: ending tablet copy session ed5ae0647048435da282261048c04db2-3fefa1bc622f43ca8344ddfe3522ce46 on tablet 3fefa1bc622f43ca8344ddfe3522ce46 with peer ed5ae0647048435da282261048c04db2
I20260807 13:52:12.713661 30591 raft_consensus.cc:1217] T 04f1daf8b6a44274bf2cc578e93c8303 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.846->[1.847-1.891] Dedup: 1.852->[1.853-1.891]
I20260807 13:52:12.987133 30419 raft_consensus.cc:1217] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.788->[1.789-1.863] Dedup: 1.792->[1.793-1.863]
W20260807 13:52:13.585426 30504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:34213, user_credentials={real_user=slave}} blocked reactor thread for 147823us
I20260807 13:52:13.593786 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:13.606989 28551 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:13.668032 28724 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:13.872788 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:13.873548 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:13.944952 30758 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:13.957207 30396 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260807 13:52:14.055884 28661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.135:39559, user_credentials={real_user=slave}} blocked reactor thread for 123631us
I20260807 13:52:14.479242 28745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fefa1bc622f43ca8344ddfe3522ce46"
dest_uuid: "9da72b03880d4414b034964abe86d4fe"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:47004
I20260807 13:52:14.479468 28745 raft_consensus.cc:606] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [term 1 LEADER]: Received request to transfer leadership
W20260807 13:52:14.479677 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
W20260807 13:52:14.485559 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
W20260807 13:52:14.492936 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
W20260807 13:52:14.500255 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
W20260807 13:52:14.519945 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
W20260807 13:52:14.527292 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
W20260807 13:52:14.536487 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
W20260807 13:52:14.548682 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
W20260807 13:52:14.563531 28696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
W20260807 13:52:14.580163 28696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
W20260807 13:52:14.592159 28696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
W20260807 13:52:14.607126 28696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
W20260807 13:52:14.624173 28696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
W20260807 13:52:14.639369 28696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
W20260807 13:52:14.657660 28696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
W20260807 13:52:14.680550 28696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
W20260807 13:52:14.699416 28696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
W20260807 13:52:14.719370 28696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
W20260807 13:52:14.742818 28696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
W20260807 13:52:14.768779 28696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
W20260807 13:52:14.793462 28696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
W20260807 13:52:14.819676 28696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
W20260807 13:52:14.848289 28696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
W20260807 13:52:14.878612 28696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
W20260807 13:52:14.907860 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
I20260807 13:52:14.939560 1835 raft_consensus.cc:993] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe: : Instructing follower ed5ae0647048435da282261048c04db2 to start an election
I20260807 13:52:14.939796 1835 raft_consensus.cc:1081] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [term 1 LEADER]: Signalling peer ed5ae0647048435da282261048c04db2 to start an election
W20260807 13:52:14.939962 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
W20260807 13:52:14.969656 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
I20260807 13:52:14.975281 30421 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fefa1bc622f43ca8344ddfe3522ce46"
dest_uuid: "ed5ae0647048435da282261048c04db2"
from {username='slave'} at 127.23.107.130:58743
I20260807 13:52:14.975936 30421 raft_consensus.cc:493] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:52:14.976266 30421 raft_consensus.cc:3060] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:52:14.992835 30421 raft_consensus.cc:515] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 789 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } }
W20260807 13:52:15.002229 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
W20260807 13:52:15.035878 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Service unavailable: leader transfer in progress
I20260807 13:52:15.037259 28745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fefa1bc622f43ca8344ddfe3522ce46" candidate_uuid: "ed5ae0647048435da282261048c04db2" candidate_term: 2 candidate_status { last_received { term: 1 index: 891 } } ignore_live_leader: true dest_uuid: "9da72b03880d4414b034964abe86d4fe"
I20260807 13:52:15.037660 28745 raft_consensus.cc:3055] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:52:15.037871 28745 raft_consensus.cc:740] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9da72b03880d4414b034964abe86d4fe, State: Running, Role: LEADER
I20260807 13:52:15.038571 28745 consensus_queue.cc:260] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 891, Committed index: 891, Last appended: 1.891, Last appended by leader: 891, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 789 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } }
I20260807 13:52:15.039430 28745 raft_consensus.cc:3060] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:52:15.044438 28745 raft_consensus.cc:2468] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed5ae0647048435da282261048c04db2 in term 2.
I20260807 13:52:15.045647 30421 leader_election.cc:290] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2 [CANDIDATE]: Term 2 election: Requested vote from peers 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223), c45d5217722649e6bdbccee30863591b (127.23.107.132:34213)
W20260807 13:52:15.067315 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Illegal state: replica 9da72b03880d4414b034964abe86d4fe is not leader of this config: current role FOLLOWER
I20260807 13:52:15.068951 30337 leader_election.cc:304] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da72b03880d4414b034964abe86d4fe, ed5ae0647048435da282261048c04db2; no voters:
I20260807 13:52:15.080178 1889 raft_consensus.cc:2804] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:52:15.095618 30241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fefa1bc622f43ca8344ddfe3522ce46" candidate_uuid: "ed5ae0647048435da282261048c04db2" candidate_term: 2 candidate_status { last_received { term: 1 index: 891 } } ignore_live_leader: true dest_uuid: "c45d5217722649e6bdbccee30863591b"
I20260807 13:52:15.095937 30241 raft_consensus.cc:3060] T 3fefa1bc622f43ca8344ddfe3522ce46 P c45d5217722649e6bdbccee30863591b [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:52:15.126565 30241 raft_consensus.cc:2468] T 3fefa1bc622f43ca8344ddfe3522ce46 P c45d5217722649e6bdbccee30863591b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed5ae0647048435da282261048c04db2 in term 2.
I20260807 13:52:15.194231 1889 raft_consensus.cc:697] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2 [term 2 LEADER]: Becoming Leader. State: Replica: ed5ae0647048435da282261048c04db2, State: Running, Role: LEADER
I20260807 13:52:15.194875 1889 consensus_queue.cc:237] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 891, Committed index: 891, Last appended: 1.891, Last appended by leader: 891, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 789 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } }
I20260807 13:52:15.239845 28394 catalog_manager.cc:5697] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2 reported cstate change: term changed from 1 to 2, leader changed from 9da72b03880d4414b034964abe86d4fe (127.23.107.130) to ed5ae0647048435da282261048c04db2 (127.23.107.133). New cstate: current_term: 2 leader_uuid: "ed5ae0647048435da282261048c04db2" committed_config { opid_index: 789 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } } }
W20260807 13:52:15.348544 28695 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40262: Illegal state: replica 9da72b03880d4414b034964abe86d4fe is not leader of this config: current role FOLLOWER
W20260807 13:52:15.395514 30196 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43266: Illegal state: replica c45d5217722649e6bdbccee30863591b is not leader of this config: current role FOLLOWER
I20260807 13:52:15.465448 28551 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:15.539939 30247 raft_consensus.cc:1275] T 3fefa1bc622f43ca8344ddfe3522ce46 P c45d5217722649e6bdbccee30863591b [term 2 FOLLOWER]: Refusing update from remote peer ed5ae0647048435da282261048c04db2: Log matching property violated. Preceding OpId in replica: term: 1 index: 891. Preceding OpId from leader: term: 2 index: 893. (index mismatch)
I20260807 13:52:15.540678 28745 raft_consensus.cc:1275] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [term 2 FOLLOWER]: Refusing update from remote peer ed5ae0647048435da282261048c04db2: Log matching property violated. Preceding OpId in replica: term: 1 index: 891. Preceding OpId from leader: term: 2 index: 893. (index mismatch)
I20260807 13:52:15.540707 1891 consensus_queue.cc:1048] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 892, Last known committed idx: 891, Time since last communication: 0.000s
I20260807 13:52:15.541962 1891 consensus_queue.cc:1048] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 892, Last known committed idx: 891, Time since last communication: 0.000s
I20260807 13:52:15.555099 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:15.611845 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:15.617286 1887 mvcc.cc:204] Tried to move back new op lower bound from 7315909572757729280 to 7315909571363221504. Current Snapshot: MvccSnapshot[applied={T|T < 7315909572757729280}]
I20260807 13:52:15.702164 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260807 13:52:15.720537 30504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:34213, user_credentials={real_user=slave}} blocked reactor thread for 65021.3us
I20260807 13:52:15.751559 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:15.779105 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:15.783788 1936 mvcc.cc:204] Tried to move back new op lower bound from 7315909572757729280 to 7315909571363221504. Current Snapshot: MvccSnapshot[applied={T|T < 7315909572757729280 or (T in {7315909572757729280})}]
I20260807 13:52:15.857430 30758 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:17.845602 28551 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:17.846434 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:18.128669 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:18.137195 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:18.166152 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:18.173589 30758 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:18.195736 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:18.735353 28574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04f1daf8b6a44274bf2cc578e93c8303"
dest_uuid: "0ea2e5a5c2b0429985eb26f907033c9b"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:43854
I20260807 13:52:18.735589 28574 raft_consensus.cc:606] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 LEADER]: Received request to transfer leadership
I20260807 13:52:18.739701 1761 raft_consensus.cc:993] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b: : Instructing follower f634a7b061e64a7caf1cb02a4731dadc to start an election
I20260807 13:52:18.739850 1761 raft_consensus.cc:1081] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 LEADER]: Signalling peer f634a7b061e64a7caf1cb02a4731dadc to start an election
I20260807 13:52:18.745240 30778 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04f1daf8b6a44274bf2cc578e93c8303"
dest_uuid: "f634a7b061e64a7caf1cb02a4731dadc"
from {username='slave'} at 127.23.107.129:47583
I20260807 13:52:18.745577 30778 raft_consensus.cc:493] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:52:18.745735 30778 raft_consensus.cc:3060] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:52:18.746490 28524 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:38804: Service unavailable: leader transfer in progress
I20260807 13:52:18.748955 30778 raft_consensus.cc:515] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 847 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
W20260807 13:52:18.766610 28524 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:38804: Service unavailable: leader transfer in progress
W20260807 13:52:18.781279 28524 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:38804: Service unavailable: leader transfer in progress
W20260807 13:52:18.791311 28524 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:38804: Service unavailable: leader transfer in progress
I20260807 13:52:18.797502 30779 raft_consensus.cc:1240] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc [term 2 FOLLOWER]: Rejecting Update request from peer 0ea2e5a5c2b0429985eb26f907033c9b for earlier term 1. Current term is 2. Ops: []
I20260807 13:52:18.798429 1896 consensus_queue.cc:1059] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 }, Status: INVALID_TERM, Last received: 1.1008, Next index: 1009, Last known committed idx: 1007, Time since last communication: 0.000s
I20260807 13:52:18.798837 1896 raft_consensus.cc:3055] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:52:18.798985 1896 raft_consensus.cc:740] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ea2e5a5c2b0429985eb26f907033c9b, State: Running, Role: LEADER
I20260807 13:52:18.799497 1896 consensus_queue.cc:260] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1008, Committed index: 1008, Last appended: 1.1008, Last appended by leader: 1008, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 847 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:52:18.799970 1896 raft_consensus.cc:3060] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:52:18.802492 28524 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:38804: Illegal state: replica 0ea2e5a5c2b0429985eb26f907033c9b is not leader of this config: current role FOLLOWER
I20260807 13:52:18.810784 30778 leader_election.cc:290] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc [CANDIDATE]: Term 2 election: Requested vote from peers 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223), 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134:41561)
I20260807 13:52:18.816265 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f1daf8b6a44274bf2cc578e93c8303" candidate_uuid: "f634a7b061e64a7caf1cb02a4731dadc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1008 } } ignore_live_leader: true dest_uuid: "0ea2e5a5c2b0429985eb26f907033c9b"
I20260807 13:52:18.832634 28574 raft_consensus.cc:2468] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f634a7b061e64a7caf1cb02a4731dadc in term 2.
I20260807 13:52:18.834875 30697 leader_election.cc:304] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ea2e5a5c2b0429985eb26f907033c9b, f634a7b061e64a7caf1cb02a4731dadc; no voters:
I20260807 13:52:18.845194 2095 raft_consensus.cc:2804] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:52:18.854379 2095 raft_consensus.cc:697] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc [term 2 LEADER]: Becoming Leader. State: Replica: f634a7b061e64a7caf1cb02a4731dadc, State: Running, Role: LEADER
I20260807 13:52:18.855150 2095 consensus_queue.cc:237] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1007, Committed index: 1007, Last appended: 1.1008, Last appended by leader: 1008, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 847 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:52:18.861656 28388 catalog_manager.cc:5697] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc reported cstate change: term changed from 1 to 2, leader changed from 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129) to f634a7b061e64a7caf1cb02a4731dadc (127.23.107.135). New cstate: current_term: 2 leader_uuid: "f634a7b061e64a7caf1cb02a4731dadc" committed_config { opid_index: 847 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
I20260807 13:52:19.034933 30598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f1daf8b6a44274bf2cc578e93c8303" candidate_uuid: "f634a7b061e64a7caf1cb02a4731dadc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1008 } } ignore_live_leader: true dest_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a"
I20260807 13:52:19.035161 30598 raft_consensus.cc:3060] T 04f1daf8b6a44274bf2cc578e93c8303 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:52:19.041510 30598 raft_consensus.cc:2468] T 04f1daf8b6a44274bf2cc578e93c8303 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f634a7b061e64a7caf1cb02a4731dadc in term 2.
I20260807 13:52:19.206789 28574 raft_consensus.cc:1275] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [term 2 FOLLOWER]: Refusing update from remote peer f634a7b061e64a7caf1cb02a4731dadc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1008. Preceding OpId from leader: term: 2 index: 1010. (index mismatch)
I20260807 13:52:19.207571 2098 consensus_queue.cc:1048] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1009, Last known committed idx: 1008, Time since last communication: 0.000s
I20260807 13:52:19.213328 2069 mvcc.cc:204] Tried to move back new op lower bound from 7315909587776950272 to 7315909586363740160. Current Snapshot: MvccSnapshot[applied={T|T < 7315909585832923136}]
I20260807 13:52:19.228088 30591 raft_consensus.cc:1275] T 04f1daf8b6a44274bf2cc578e93c8303 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 2 FOLLOWER]: Refusing update from remote peer f634a7b061e64a7caf1cb02a4731dadc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1008. Preceding OpId from leader: term: 2 index: 1010. (index mismatch)
I20260807 13:52:19.228820 2095 consensus_queue.cc:1048] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc [LEADER]: Connected to new peer: Peer: permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1009, Last known committed idx: 1008, Time since last communication: 0.000s
W20260807 13:52:19.306185 30697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.129:37223, user_credentials={real_user=slave}} blocked reactor thread for 70886.3us
I20260807 13:52:19.703299 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:52:19.827641 28831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.133:34943, user_credentials={real_user=slave}} blocked reactor thread for 55001.9us
I20260807 13:52:19.867205 30758 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:19.896194 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:19.897387 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:19.981736 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:20.055336 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:20.134989 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:20.952371 30779 consensus_queue.cc:237] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1031, Committed index: 1031, Last appended: 2.1031, Last appended by leader: 1008, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1032 OBSOLETE_local: false peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:52:20.956113 30591 raft_consensus.cc:1275] T 04f1daf8b6a44274bf2cc578e93c8303 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 2 FOLLOWER]: Refusing update from remote peer f634a7b061e64a7caf1cb02a4731dadc: Log matching property violated. Preceding OpId in replica: term: 2 index: 1031. Preceding OpId from leader: term: 2 index: 1032. (index mismatch)
I20260807 13:52:20.956794 2095 consensus_queue.cc:1048] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc [LEADER]: Connected to new peer: Peer: permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1032, Last known committed idx: 1030, Time since last communication: 0.000s
I20260807 13:52:20.960671 2095 raft_consensus.cc:2955] T 04f1daf8b6a44274bf2cc578e93c8303 P f634a7b061e64a7caf1cb02a4731dadc [term 2 LEADER]: Committing config change with OpId 2.1032: config changed from index 847 to 1032, VOTER 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129) evicted. New config: { opid_index: 1032 OBSOLETE_local: false peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
I20260807 13:52:20.961745 30591 raft_consensus.cc:2955] T 04f1daf8b6a44274bf2cc578e93c8303 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 2 FOLLOWER]: Committing config change with OpId 2.1032: config changed from index 847 to 1032, VOTER 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129) evicted. New config: { opid_index: 1032 OBSOLETE_local: false peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
I20260807 13:52:20.968221 28394 catalog_manager.cc:5697] T 04f1daf8b6a44274bf2cc578e93c8303 P 22b9a9a4b1bf44daa35fcecd47b8856a reported cstate change: config changed from index 847 to 1032, VOTER 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129) evicted. New cstate: current_term: 2 leader_uuid: "f634a7b061e64a7caf1cb02a4731dadc" committed_config { opid_index: 1032 OBSOLETE_local: false peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } }
I20260807 13:52:21.107093 28551 tablet_service.cc:1558] Processing DeleteTablet for tablet 04f1daf8b6a44274bf2cc578e93c8303 with delete_type TABLET_DATA_TOMBSTONED (TS 0ea2e5a5c2b0429985eb26f907033c9b not found in new config with opid_index 1032) from {username='slave'} at 127.0.0.1:60692
I20260807 13:52:21.107699 2248 tablet_replica.cc:333] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b: stopping tablet replica
I20260807 13:52:21.108083 2248 raft_consensus.cc:2243] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:52:21.108366 2248 raft_consensus.cc:2272] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:52:21.111836 2248 ts_tablet_manager.cc:1916] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:52:21.124748 2248 ts_tablet_manager.cc:1929] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.1031
I20260807 13:52:21.128048 2248 log.cc:1199] T 04f1daf8b6a44274bf2cc578e93c8303 P 0ea2e5a5c2b0429985eb26f907033c9b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/wals/04f1daf8b6a44274bf2cc578e93c8303
I20260807 13:52:21.129933 28376 catalog_manager.cc:5028] TS 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223): tablet 04f1daf8b6a44274bf2cc578e93c8303 (table rebalance_test_table_3 [id=6232d7b2b0b5403c842e16fd04e72177]) successfully deleted
W20260807 13:52:21.693482 28835 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.129:37223, user_credentials={real_user=slave}} blocked reactor thread for 94898.4us
I20260807 13:52:22.205667 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:22.539110 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:22.540532 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:22.567152 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:22.582705 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
W20260807 13:52:22.606830 28493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.134:41561, user_credentials={real_user=slave}} blocked reactor thread for 73276.8us
I20260807 13:52:22.613755 30758 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:22.667042 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260807 13:52:23.095381 28832 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.130:43223, user_credentials={real_user=slave}} blocked reactor thread for 81124.7us
I20260807 13:52:23.406363 30421 consensus_queue.cc:237] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1002, Committed index: 1002, Last appended: 2.1002, Last appended by leader: 891, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1003 OBSOLETE_local: false peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } }
I20260807 13:52:23.465047 30241 raft_consensus.cc:1275] T 3fefa1bc622f43ca8344ddfe3522ce46 P c45d5217722649e6bdbccee30863591b [term 2 FOLLOWER]: Refusing update from remote peer ed5ae0647048435da282261048c04db2: Log matching property violated. Preceding OpId in replica: term: 2 index: 1002. Preceding OpId from leader: term: 2 index: 1003. (index mismatch)
I20260807 13:52:23.473825 2162 consensus_queue.cc:1048] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1003, Last known committed idx: 1002, Time since last communication: 0.000s
I20260807 13:52:23.478811 2162 raft_consensus.cc:2955] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2 [term 2 LEADER]: Committing config change with OpId 2.1003: config changed from index 789 to 1003, VOTER 9da72b03880d4414b034964abe86d4fe (127.23.107.130) evicted. New config: { opid_index: 1003 OBSOLETE_local: false peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } } }
I20260807 13:52:23.486712 28383 catalog_manager.cc:5697] T 3fefa1bc622f43ca8344ddfe3522ce46 P ed5ae0647048435da282261048c04db2 reported cstate change: config changed from index 789 to 1003, VOTER 9da72b03880d4414b034964abe86d4fe (127.23.107.130) evicted. New cstate: current_term: 2 leader_uuid: "ed5ae0647048435da282261048c04db2" committed_config { opid_index: 1003 OBSOLETE_local: false peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } } }
I20260807 13:52:23.487047 30241 raft_consensus.cc:2955] T 3fefa1bc622f43ca8344ddfe3522ce46 P c45d5217722649e6bdbccee30863591b [term 2 FOLLOWER]: Committing config change with OpId 2.1003: config changed from index 789 to 1003, VOTER 9da72b03880d4414b034964abe86d4fe (127.23.107.130) evicted. New config: { opid_index: 1003 OBSOLETE_local: false peers { permanent_uuid: "c45d5217722649e6bdbccee30863591b" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 34213 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } } }
I20260807 13:52:23.574785 28724 tablet_service.cc:1558] Processing DeleteTablet for tablet 3fefa1bc622f43ca8344ddfe3522ce46 with delete_type TABLET_DATA_TOMBSTONED (TS 9da72b03880d4414b034964abe86d4fe not found in new config with opid_index 1003) from {username='slave'} at 127.0.0.1:55848
I20260807 13:52:23.765065 2393 tablet_replica.cc:333] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe: stopping tablet replica
I20260807 13:52:23.765944 2393 raft_consensus.cc:2243] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:52:23.766235 2393 raft_consensus.cc:2272] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:52:23.767648 2393 ts_tablet_manager.cc:1916] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260807 13:52:23.960781 28831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.135:39559, user_credentials={real_user=slave}} blocked reactor thread for 61670us
I20260807 13:52:23.985517 2393 ts_tablet_manager.cc:1929] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.1002
I20260807 13:52:23.985788 2393 log.cc:1199] T 3fefa1bc622f43ca8344ddfe3522ce46 P 9da72b03880d4414b034964abe86d4fe: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/3fefa1bc622f43ca8344ddfe3522ce46
I20260807 13:52:23.994809 28375 catalog_manager.cc:5028] TS 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223): tablet 3fefa1bc622f43ca8344ddfe3522ce46 (table rebalance_test_table_2 [id=46bf349795f3453589935822245c96b1]) successfully deleted
I20260807 13:52:25.387651 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:25.475811 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:25.532027 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:25.619140 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:25.650468 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:25.891659 30758 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:25.910878 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:27.385365 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:27.392243 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:27.473030 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:27.546681 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:27.547916 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:27.635279 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:27.636073 30758 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:30.714876 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:30.807669 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:30.836268 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:30.870916 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:30.888742 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:30.942091 30758 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:30.959666 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260807 13:52:31.027890 28661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.135:39559, user_credentials={real_user=slave}} blocked reactor thread for 103477us
W20260807 13:52:31.044354 28662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:34213, user_credentials={real_user=slave}} blocked reactor thread for 80575.8us
I20260807 13:52:31.903318 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:31.950215 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:31.984375 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:32.018450 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:32.033041 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:32.043395 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:32.066670 30758 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:32.875385 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:32.906958 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:32.909000 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:32.921128 30758 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:32.925666 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:32.947505 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:32.948441 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
5b0e99a8c47049999ab224df5400bc2c | 127.23.107.190:39563 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
allow_unsafe_replication_factor | true | runtime,unsafe | all 1 server(s) checked
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.23.107.148:41209 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
0ea2e5a5c2b0429985eb26f907033c9b | 127.23.107.129:37223 | HEALTHY | <none> | 4 | 0
22b9a9a4b1bf44daa35fcecd47b8856a | 127.23.107.134:41561 | HEALTHY | <none> | 1 | 0
9da72b03880d4414b034964abe86d4fe | 127.23.107.130:43223 | HEALTHY | <none> | 4 | 0
c11aeb9ac7f04cceb63233785ce00503 | 127.23.107.131:41571 | HEALTHY | <none> | 5 | 0
c45d5217722649e6bdbccee30863591b | 127.23.107.132:34213 | HEALTHY | <none> | 0 | 0
ed5ae0647048435da282261048c04db2 | 127.23.107.133:34943 | HEALTHY | <none> | 1 | 0
f634a7b061e64a7caf1cb02a4731dadc | 127.23.107.135:39559 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 7
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
ipki_server_key_size | 768 | experimental | all 7 server(s) checked
local_ip_for_outbound_sockets | 127.23.107.129 | experimental | 127.23.107.129:37223
local_ip_for_outbound_sockets | 127.23.107.130 | experimental | 127.23.107.130:43223
local_ip_for_outbound_sockets | 127.23.107.131 | experimental | 127.23.107.131:41571
local_ip_for_outbound_sockets | 127.23.107.132 | experimental | 127.23.107.132:34213
local_ip_for_outbound_sockets | 127.23.107.133 | experimental | 127.23.107.133:34943
local_ip_for_outbound_sockets | 127.23.107.134 | experimental | 127.23.107.134:41561
local_ip_for_outbound_sockets | 127.23.107.135 | experimental | 127.23.107.135:39559
never_fsync | true | unsafe,advanced | all 7 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 7 server(s) checked
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 7 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 7 server(s) checked
server_dump_info_format | pb | hidden | all 7 server(s) checked
server_dump_info_path | /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.23.107.129:37223
server_dump_info_path | /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.23.107.130:43223
server_dump_info_path | /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.23.107.131:41571
server_dump_info_path | /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/info.pb | hidden | 127.23.107.132:34213
server_dump_info_path | /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/info.pb | hidden | 127.23.107.133:34943
server_dump_info_path | /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/info.pb | hidden | 127.23.107.134:41561
server_dump_info_path | /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data/info.pb | hidden | 127.23.107.135:39559
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.23.107.148:41209 | all 7 server(s) checked
time_source | builtin | all 7 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 8 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
------------------------+----+---------+---------------+---------+------------+------------------+-------------
TestTable | 2 | HEALTHY | 1 | 1 | 0 | 0 | 0
rebalance_test_table_0 | 2 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_1 | 2 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_2 | 2 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_3 | 2 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_4 | 2 | HEALTHY | 3 | 3 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 4
First Quartile | 4
Median | 5
Third Quartile | 5
Maximum | 5
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 7
Tables | 6
Tablets | 16
Replicas | 32
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260807 13:52:33.064205 23982 log_verifier.cc:126] Checking tablet 024803a9deb6450dad724e4b614213e1
I20260807 13:52:33.091444 23982 log_verifier.cc:177] Verified matching terms for 2 ops in tablet 024803a9deb6450dad724e4b614213e1
I20260807 13:52:33.091543 23982 log_verifier.cc:126] Checking tablet 04f1daf8b6a44274bf2cc578e93c8303
I20260807 13:52:33.553292 23982 log_verifier.cc:177] Verified matching terms for 1215 ops in tablet 04f1daf8b6a44274bf2cc578e93c8303
I20260807 13:52:33.554733 23982 log_verifier.cc:126] Checking tablet 1592525dd2a646de874117d51026e771
I20260807 13:52:34.009462 23982 log_verifier.cc:177] Verified matching terms for 1074 ops in tablet 1592525dd2a646de874117d51026e771
I20260807 13:52:34.010598 23982 log_verifier.cc:126] Checking tablet 3da3196623e04606aca463b8847ab6cd
I20260807 13:52:34.420756 23982 log_verifier.cc:177] Verified matching terms for 1149 ops in tablet 3da3196623e04606aca463b8847ab6cd
I20260807 13:52:34.421947 23982 log_verifier.cc:126] Checking tablet 3fefa1bc622f43ca8344ddfe3522ce46
I20260807 13:52:34.828781 23982 log_verifier.cc:177] Verified matching terms for 1171 ops in tablet 3fefa1bc622f43ca8344ddfe3522ce46
I20260807 13:52:34.830029 23982 log_verifier.cc:126] Checking tablet 5daf3681a6ba460385331aadffabfa8f
I20260807 13:52:35.242297 23982 log_verifier.cc:177] Verified matching terms for 1174 ops in tablet 5daf3681a6ba460385331aadffabfa8f
I20260807 13:52:35.243445 23982 log_verifier.cc:126] Checking tablet 79268a57a70b4612aff6405c6d587f33
I20260807 13:52:35.609535 23982 log_verifier.cc:177] Verified matching terms for 1036 ops in tablet 79268a57a70b4612aff6405c6d587f33
I20260807 13:52:35.610741 23982 log_verifier.cc:126] Checking tablet 7a7f0c232a674615a2cf5c3c06abd8a8
I20260807 13:52:36.055879 23982 log_verifier.cc:177] Verified matching terms for 1153 ops in tablet 7a7f0c232a674615a2cf5c3c06abd8a8
I20260807 13:52:36.057220 23982 log_verifier.cc:126] Checking tablet ae179f753242471eb4484553d9df106b
I20260807 13:52:36.601931 23982 log_verifier.cc:177] Verified matching terms for 1239 ops in tablet ae179f753242471eb4484553d9df106b
I20260807 13:52:36.603165 23982 log_verifier.cc:126] Checking tablet ba6d87b94369439dac8c8355d744a7f3
I20260807 13:52:37.044708 23982 log_verifier.cc:177] Verified matching terms for 1051 ops in tablet ba6d87b94369439dac8c8355d744a7f3
I20260807 13:52:37.045881 23982 log_verifier.cc:126] Checking tablet be0c7339d6fd43c781879ef4c2c76fbd
I20260807 13:52:37.436939 23982 log_verifier.cc:177] Verified matching terms for 1120 ops in tablet be0c7339d6fd43c781879ef4c2c76fbd
I20260807 13:52:37.438104 23982 log_verifier.cc:126] Checking tablet c2891223f5fd43979439c00fec9fca3d
I20260807 13:52:37.843039 23982 log_verifier.cc:177] Verified matching terms for 1127 ops in tablet c2891223f5fd43979439c00fec9fca3d
I20260807 13:52:37.844257 23982 log_verifier.cc:126] Checking tablet c72c9d7fb3364b2485475585dc6f244a
I20260807 13:52:38.265636 23982 log_verifier.cc:177] Verified matching terms for 1177 ops in tablet c72c9d7fb3364b2485475585dc6f244a
I20260807 13:52:38.267261 23982 log_verifier.cc:126] Checking tablet e88a325f491a4cbc97d05562c44efccd
I20260807 13:52:38.740975 23982 log_verifier.cc:177] Verified matching terms for 1117 ops in tablet e88a325f491a4cbc97d05562c44efccd
I20260807 13:52:38.742264 23982 log_verifier.cc:126] Checking tablet f726c2f0034d4cc8b36c2f706f5e5b04
I20260807 13:52:39.194434 23982 log_verifier.cc:177] Verified matching terms for 1145 ops in tablet f726c2f0034d4cc8b36c2f706f5e5b04
I20260807 13:52:39.195565 23982 log_verifier.cc:126] Checking tablet f9f996c0ec5849d98b1cc0fc83cc51a6
I20260807 13:52:39.631587 23982 log_verifier.cc:177] Verified matching terms for 1221 ops in tablet f9f996c0ec5849d98b1cc0fc83cc51a6
I20260807 13:52:39.646381 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.136:0
--local_ip_for_outbound_sockets=127.23.107.136
--webserver_interface=127.23.107.136
--webserver_port=0
--tserver_master_addrs=127.23.107.190:39563
--builtin_ntp_servers=127.23.107.148:41209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
W20260807 13:52:40.287925 2896 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:52:40.288450 2896 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:52:40.288681 2896 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:52:40.303120 2896 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:52:40.303329 2896 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:52:40.303666 2896 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.136
I20260807 13:52:40.319648 2896 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:41209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.136:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--webserver_interface=127.23.107.136
--webserver_port=0
--tserver_master_addrs=127.23.107.190:39563
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.136
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:52:40.321887 2896 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:52:40.324512 2896 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:52:40.340219 2904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:52:40.340327 2906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:52:40.341380 2903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:52:40.342660 2896 server_base.cc:1061] running on GCE node
I20260807 13:52:40.343540 2896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:52:40.345151 2896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:52:40.346541 2896 hybrid_clock.cc:648] HybridClock initialized: now 1786110760346341 us; error 66 us; skew 500 ppm
I20260807 13:52:40.347010 2896 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:52:40.350754 2896 webserver.cc:533] Webserver started at http://127.23.107.136:37955/ using document root <none> and password file <none>
I20260807 13:52:40.351796 2896 fs_manager.cc:362] Metadata directory not provided
I20260807 13:52:40.352005 2896 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:52:40.352496 2896 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:52:40.355913 2896 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/data/instance:
uuid: "98735d0ea16b40ab80333722c35a13e4"
format_stamp: "Formatted at 2026-08-07 13:52:40 on dist-test-slave-bw88"
I20260807 13:52:40.356899 2896 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/wal/instance:
uuid: "98735d0ea16b40ab80333722c35a13e4"
format_stamp: "Formatted at 2026-08-07 13:52:40 on dist-test-slave-bw88"
I20260807 13:52:40.365168 2896 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.000s sys 0.006s
I20260807 13:52:40.370285 2913 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:52:40.371974 2896 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260807 13:52:40.372238 2896 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/wal
uuid: "98735d0ea16b40ab80333722c35a13e4"
format_stamp: "Formatted at 2026-08-07 13:52:40 on dist-test-slave-bw88"
I20260807 13:52:40.372597 2896 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:52:40.401160 2896 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:52:40.403007 2896 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:52:40.403616 2896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:52:40.405181 2896 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:52:40.408103 2896 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:52:40.408279 2896 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:52:40.408538 2896 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:52:40.408702 2896 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:52:40.502058 2896 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.136:36793
I20260807 13:52:40.502210 3066 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.136:36793 every 8 connection(s)
I20260807 13:52:40.503610 2896 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/data/info.pb
I20260807 13:52:40.512598 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 2896
I20260807 13:52:40.512841 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/wal/instance
I20260807 13:52:40.524895 3067 heartbeater.cc:344] Connected to a master server at 127.23.107.190:39563
I20260807 13:52:40.525395 3067 heartbeater.cc:461] Registering TS with master...
I20260807 13:52:40.526860 3067 heartbeater.cc:507] Master 127.23.107.190:39563 requested a full tablet report, sending...
I20260807 13:52:40.528990 28388 ts_manager.cc:194] Registered new tserver with Master: 98735d0ea16b40ab80333722c35a13e4 (127.23.107.136:36793)
I20260807 13:52:40.530386 28388 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.136:50029
I20260807 13:52:41.369903 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:41.370216 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:41.400297 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:41.401607 2984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:41.461237 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:41.495132 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:41.518707 30758 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:41.519899 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:41.538632 3067 heartbeater.cc:499] Master 127.23.107.190:39563 was elected leader, sending a full tablet report...
I20260807 13:52:41.792460 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:41.805979 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:41.806195 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:41.832170 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:41.832436 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:41.836411 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:41.860085 30758 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:41.861258 2984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:42.000581 28920 consensus_queue.cc:237] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1145, Committed index: 1145, Last appended: 1.1145, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1146 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } }
I20260807 13:52:42.003690 28749 raft_consensus.cc:1275] T f726c2f0034d4cc8b36c2f706f5e5b04 P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Refusing update from remote peer c11aeb9ac7f04cceb63233785ce00503: Log matching property violated. Preceding OpId in replica: term: 1 index: 1145. Preceding OpId from leader: term: 1 index: 1146. (index mismatch)
I20260807 13:52:42.004390 3205 consensus_queue.cc:1048] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1146, Last known committed idx: 1145, Time since last communication: 0.000s
I20260807 13:52:42.008024 2877 raft_consensus.cc:2955] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 [term 1 LEADER]: Committing config change with OpId 1.1146: config changed from index -1 to 1146, VOTER 98735d0ea16b40ab80333722c35a13e4 (127.23.107.136) added. New config: { opid_index: 1146 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } } }
I20260807 13:52:42.009073 28749 raft_consensus.cc:2955] T f726c2f0034d4cc8b36c2f706f5e5b04 P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Committing config change with OpId 1.1146: config changed from index -1 to 1146, VOTER 98735d0ea16b40ab80333722c35a13e4 (127.23.107.136) added. New config: { opid_index: 1146 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } } }
I20260807 13:52:42.015343 28383 catalog_manager.cc:5697] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 reported cstate change: config changed from index -1 to 1146, VOTER 98735d0ea16b40ab80333722c35a13e4 (127.23.107.136) added. New cstate: current_term: 1 leader_uuid: "c11aeb9ac7f04cceb63233785ce00503" committed_config { opid_index: 1146 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } } }
W20260807 13:52:42.018276 28830 consensus_peers.cc:597] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 -> Peer 98735d0ea16b40ab80333722c35a13e4 (127.23.107.136:36793): Couldn't send request to peer 98735d0ea16b40ab80333722c35a13e4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f726c2f0034d4cc8b36c2f706f5e5b04. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:52:42.090176 28920 consensus_queue.cc:237] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1117, Committed index: 1117, Last appended: 1.1117, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1118 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } }
W20260807 13:52:42.093181 28830 consensus_peers.cc:597] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 -> Peer 98735d0ea16b40ab80333722c35a13e4 (127.23.107.136:36793): Couldn't send request to peer 98735d0ea16b40ab80333722c35a13e4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e88a325f491a4cbc97d05562c44efccd. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:52:42.093195 28577 raft_consensus.cc:1275] T e88a325f491a4cbc97d05562c44efccd P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Refusing update from remote peer c11aeb9ac7f04cceb63233785ce00503: Log matching property violated. Preceding OpId in replica: term: 1 index: 1117. Preceding OpId from leader: term: 1 index: 1118. (index mismatch)
I20260807 13:52:42.093873 2877 consensus_queue.cc:1048] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1118, Last known committed idx: 1117, Time since last communication: 0.000s
I20260807 13:52:42.096483 3205 raft_consensus.cc:2955] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 [term 1 LEADER]: Committing config change with OpId 1.1118: config changed from index -1 to 1118, VOTER 98735d0ea16b40ab80333722c35a13e4 (127.23.107.136) added. New config: { opid_index: 1118 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } } }
I20260807 13:52:42.097147 28577 raft_consensus.cc:2955] T e88a325f491a4cbc97d05562c44efccd P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Committing config change with OpId 1.1118: config changed from index -1 to 1118, VOTER 98735d0ea16b40ab80333722c35a13e4 (127.23.107.136) added. New config: { opid_index: 1118 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } } }
I20260807 13:52:42.102569 28388 catalog_manager.cc:5697] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 reported cstate change: config changed from index -1 to 1118, VOTER 98735d0ea16b40ab80333722c35a13e4 (127.23.107.136) added. New cstate: current_term: 1 leader_uuid: "c11aeb9ac7f04cceb63233785ce00503" committed_config { opid_index: 1118 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } } }
I20260807 13:52:42.140223 28577 consensus_queue.cc:237] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1153, Committed index: 1153, Last appended: 1.1153, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1154 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } }
I20260807 13:52:42.143321 30595 raft_consensus.cc:1275] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Refusing update from remote peer 0ea2e5a5c2b0429985eb26f907033c9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1153. Preceding OpId from leader: term: 1 index: 1154. (index mismatch)
I20260807 13:52:42.144106 2727 consensus_queue.cc:1048] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1154, Last known committed idx: 1153, Time since last communication: 0.000s
I20260807 13:52:42.147097 3251 raft_consensus.cc:2955] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 LEADER]: Committing config change with OpId 1.1154: config changed from index 637 to 1154, VOTER 98735d0ea16b40ab80333722c35a13e4 (127.23.107.136) added. New config: { opid_index: 1154 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } } }
I20260807 13:52:42.147742 30595 raft_consensus.cc:2955] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Committing config change with OpId 1.1154: config changed from index 637 to 1154, VOTER 98735d0ea16b40ab80333722c35a13e4 (127.23.107.136) added. New config: { opid_index: 1154 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } } }
W20260807 13:52:42.150343 28489 consensus_peers.cc:597] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b -> Peer 98735d0ea16b40ab80333722c35a13e4 (127.23.107.136:36793): Couldn't send request to peer 98735d0ea16b40ab80333722c35a13e4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7a7f0c232a674615a2cf5c3c06abd8a8. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:52:42.153385 28383 catalog_manager.cc:5697] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b reported cstate change: config changed from index 637 to 1154, VOTER 98735d0ea16b40ab80333722c35a13e4 (127.23.107.136) added. New cstate: current_term: 1 leader_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" committed_config { opid_index: 1154 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } } }
I20260807 13:52:42.188998 28920 consensus_queue.cc:237] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1177, Committed index: 1177, Last appended: 1.1177, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1178 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } }
I20260807 13:52:42.191763 30595 raft_consensus.cc:1275] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Refusing update from remote peer c11aeb9ac7f04cceb63233785ce00503: Log matching property violated. Preceding OpId in replica: term: 1 index: 1177. Preceding OpId from leader: term: 1 index: 1178. (index mismatch)
W20260807 13:52:42.192142 28830 consensus_peers.cc:597] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 -> Peer 98735d0ea16b40ab80333722c35a13e4 (127.23.107.136:36793): Couldn't send request to peer 98735d0ea16b40ab80333722c35a13e4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c72c9d7fb3364b2485475585dc6f244a. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:52:42.192473 2877 consensus_queue.cc:1048] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1178, Last known committed idx: 1177, Time since last communication: 0.000s
I20260807 13:52:42.195652 3205 raft_consensus.cc:2955] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [term 1 LEADER]: Committing config change with OpId 1.1178: config changed from index 721 to 1178, VOTER 98735d0ea16b40ab80333722c35a13e4 (127.23.107.136) added. New config: { opid_index: 1178 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } } }
I20260807 13:52:42.196199 30595 raft_consensus.cc:2955] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Committing config change with OpId 1.1178: config changed from index 721 to 1178, VOTER 98735d0ea16b40ab80333722c35a13e4 (127.23.107.136) added. New config: { opid_index: 1178 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } } }
I20260807 13:52:42.201856 28388 catalog_manager.cc:5697] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 reported cstate change: config changed from index 721 to 1178, VOTER 98735d0ea16b40ab80333722c35a13e4 (127.23.107.136) added. New cstate: current_term: 1 leader_uuid: "c11aeb9ac7f04cceb63233785ce00503" committed_config { opid_index: 1178 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } } }
I20260807 13:52:42.322595 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:42.342288 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:42.348069 2984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:42.355031 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:42.363605 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:42.389696 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:42.443634 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:42.455452 30758 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:42.526974 3331 ts_tablet_manager.cc:933] T e88a325f491a4cbc97d05562c44efccd P 98735d0ea16b40ab80333722c35a13e4: Initiating tablet copy from peer c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571)
I20260807 13:52:42.528535 3331 tablet_copy_client.cc:323] T e88a325f491a4cbc97d05562c44efccd P 98735d0ea16b40ab80333722c35a13e4: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:41571
I20260807 13:52:42.536999 28943 tablet_copy_service.cc:140] P c11aeb9ac7f04cceb63233785ce00503: Received BeginTabletCopySession request for tablet e88a325f491a4cbc97d05562c44efccd from peer 98735d0ea16b40ab80333722c35a13e4 ({username='slave'} at 127.23.107.136:37257)
I20260807 13:52:42.537338 28943 tablet_copy_service.cc:161] P c11aeb9ac7f04cceb63233785ce00503: Beginning new tablet copy session on tablet e88a325f491a4cbc97d05562c44efccd from peer 98735d0ea16b40ab80333722c35a13e4 at {username='slave'} at 127.23.107.136:37257: session id = 98735d0ea16b40ab80333722c35a13e4-e88a325f491a4cbc97d05562c44efccd
I20260807 13:52:42.542922 28943 tablet_copy_source_session.cc:215] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:52:42.546521 3334 ts_tablet_manager.cc:933] T f726c2f0034d4cc8b36c2f706f5e5b04 P 98735d0ea16b40ab80333722c35a13e4: Initiating tablet copy from peer c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571)
I20260807 13:52:42.551553 3331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e88a325f491a4cbc97d05562c44efccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:52:42.558110 3334 tablet_copy_client.cc:323] T f726c2f0034d4cc8b36c2f706f5e5b04 P 98735d0ea16b40ab80333722c35a13e4: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:41571
I20260807 13:52:42.559055 28943 tablet_copy_service.cc:140] P c11aeb9ac7f04cceb63233785ce00503: Received BeginTabletCopySession request for tablet f726c2f0034d4cc8b36c2f706f5e5b04 from peer 98735d0ea16b40ab80333722c35a13e4 ({username='slave'} at 127.23.107.136:37257)
I20260807 13:52:42.559286 28943 tablet_copy_service.cc:161] P c11aeb9ac7f04cceb63233785ce00503: Beginning new tablet copy session on tablet f726c2f0034d4cc8b36c2f706f5e5b04 from peer 98735d0ea16b40ab80333722c35a13e4 at {username='slave'} at 127.23.107.136:37257: session id = 98735d0ea16b40ab80333722c35a13e4-f726c2f0034d4cc8b36c2f706f5e5b04
I20260807 13:52:42.562983 28943 tablet_copy_source_session.cc:215] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:52:42.565024 3334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f726c2f0034d4cc8b36c2f706f5e5b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:52:42.571695 3331 tablet_copy_client.cc:806] T e88a325f491a4cbc97d05562c44efccd P 98735d0ea16b40ab80333722c35a13e4: tablet copy: Starting download of 0 data blocks...
I20260807 13:52:42.575496 3334 tablet_copy_client.cc:806] T f726c2f0034d4cc8b36c2f706f5e5b04 P 98735d0ea16b40ab80333722c35a13e4: tablet copy: Starting download of 0 data blocks...
I20260807 13:52:42.575850 3334 tablet_copy_client.cc:670] T f726c2f0034d4cc8b36c2f706f5e5b04 P 98735d0ea16b40ab80333722c35a13e4: tablet copy: Starting download of 1 WAL segments...
I20260807 13:52:42.576062 3331 tablet_copy_client.cc:670] T e88a325f491a4cbc97d05562c44efccd P 98735d0ea16b40ab80333722c35a13e4: tablet copy: Starting download of 1 WAL segments...
I20260807 13:52:42.592235 3331 tablet_copy_client.cc:538] T e88a325f491a4cbc97d05562c44efccd P 98735d0ea16b40ab80333722c35a13e4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:52:42.601756 3331 tablet_bootstrap.cc:492] T e88a325f491a4cbc97d05562c44efccd P 98735d0ea16b40ab80333722c35a13e4: Bootstrap starting.
I20260807 13:52:42.604370 3334 tablet_copy_client.cc:538] T f726c2f0034d4cc8b36c2f706f5e5b04 P 98735d0ea16b40ab80333722c35a13e4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:52:42.611900 3334 tablet_bootstrap.cc:492] T f726c2f0034d4cc8b36c2f706f5e5b04 P 98735d0ea16b40ab80333722c35a13e4: Bootstrap starting.
I20260807 13:52:42.642144 3349 ts_tablet_manager.cc:933] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 98735d0ea16b40ab80333722c35a13e4: Initiating tablet copy from peer 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223)
I20260807 13:52:42.645689 3349 tablet_copy_client.cc:323] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 98735d0ea16b40ab80333722c35a13e4: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:37223
I20260807 13:52:42.662792 28602 tablet_copy_service.cc:140] P 0ea2e5a5c2b0429985eb26f907033c9b: Received BeginTabletCopySession request for tablet 7a7f0c232a674615a2cf5c3c06abd8a8 from peer 98735d0ea16b40ab80333722c35a13e4 ({username='slave'} at 127.23.107.136:35471)
I20260807 13:52:42.663111 28602 tablet_copy_service.cc:161] P 0ea2e5a5c2b0429985eb26f907033c9b: Beginning new tablet copy session on tablet 7a7f0c232a674615a2cf5c3c06abd8a8 from peer 98735d0ea16b40ab80333722c35a13e4 at {username='slave'} at 127.23.107.136:35471: session id = 98735d0ea16b40ab80333722c35a13e4-7a7f0c232a674615a2cf5c3c06abd8a8
I20260807 13:52:42.667616 28602 tablet_copy_source_session.cc:215] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:52:42.669546 3349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a7f0c232a674615a2cf5c3c06abd8a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:52:42.679613 3349 tablet_copy_client.cc:806] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 98735d0ea16b40ab80333722c35a13e4: tablet copy: Starting download of 0 data blocks...
I20260807 13:52:42.680035 3349 tablet_copy_client.cc:670] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 98735d0ea16b40ab80333722c35a13e4: tablet copy: Starting download of 1 WAL segments...
I20260807 13:52:42.690435 3349 tablet_copy_client.cc:538] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 98735d0ea16b40ab80333722c35a13e4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:52:42.695204 3349 tablet_bootstrap.cc:492] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 98735d0ea16b40ab80333722c35a13e4: Bootstrap starting.
I20260807 13:52:42.766083 3362 ts_tablet_manager.cc:933] T c72c9d7fb3364b2485475585dc6f244a P 98735d0ea16b40ab80333722c35a13e4: Initiating tablet copy from peer c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571)
I20260807 13:52:42.777624 3362 tablet_copy_client.cc:323] T c72c9d7fb3364b2485475585dc6f244a P 98735d0ea16b40ab80333722c35a13e4: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:41571
I20260807 13:52:42.778851 28943 tablet_copy_service.cc:140] P c11aeb9ac7f04cceb63233785ce00503: Received BeginTabletCopySession request for tablet c72c9d7fb3364b2485475585dc6f244a from peer 98735d0ea16b40ab80333722c35a13e4 ({username='slave'} at 127.23.107.136:37257)
I20260807 13:52:42.779117 28943 tablet_copy_service.cc:161] P c11aeb9ac7f04cceb63233785ce00503: Beginning new tablet copy session on tablet c72c9d7fb3364b2485475585dc6f244a from peer 98735d0ea16b40ab80333722c35a13e4 at {username='slave'} at 127.23.107.136:37257: session id = 98735d0ea16b40ab80333722c35a13e4-c72c9d7fb3364b2485475585dc6f244a
I20260807 13:52:42.788659 28943 tablet_copy_source_session.cc:215] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:52:42.798178 3362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72c9d7fb3364b2485475585dc6f244a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:52:42.812923 3362 tablet_copy_client.cc:806] T c72c9d7fb3364b2485475585dc6f244a P 98735d0ea16b40ab80333722c35a13e4: tablet copy: Starting download of 0 data blocks...
I20260807 13:52:42.813329 3362 tablet_copy_client.cc:670] T c72c9d7fb3364b2485475585dc6f244a P 98735d0ea16b40ab80333722c35a13e4: tablet copy: Starting download of 1 WAL segments...
I20260807 13:52:42.827241 3362 tablet_copy_client.cc:538] T c72c9d7fb3364b2485475585dc6f244a P 98735d0ea16b40ab80333722c35a13e4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:52:42.832026 3362 tablet_bootstrap.cc:492] T c72c9d7fb3364b2485475585dc6f244a P 98735d0ea16b40ab80333722c35a13e4: Bootstrap starting.
I20260807 13:52:42.909735 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:42.971189 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:43.048892 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:43.063692 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:43.108386 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:43.113184 2984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:43.133136 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:43.136415 30758 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:43.220382 3331 log.cc:826] T e88a325f491a4cbc97d05562c44efccd P 98735d0ea16b40ab80333722c35a13e4: Log is configured to *not* fsync() on all Append() calls
I20260807 13:52:43.679993 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:43.703543 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:43.766476 2984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:43.812147 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:43.849967 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:43.851007 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:43.888195 30758 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:43.911409 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:44.523797 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:44.574821 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:44.604175 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:44.617982 2984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:44.629539 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:44.684204 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:44.732931 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:44.742228 30758 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260807 13:52:45.118506 28830 consensus_peers.cc:597] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 -> Peer 98735d0ea16b40ab80333722c35a13e4 (127.23.107.136:36793): Couldn't send request to peer 98735d0ea16b40ab80333722c35a13e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260807 13:52:45.363695 28489 consensus_peers.cc:597] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b -> Peer 98735d0ea16b40ab80333722c35a13e4 (127.23.107.136:36793): Couldn't send request to peer 98735d0ea16b40ab80333722c35a13e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260807 13:52:45.377413 28830 consensus_peers.cc:597] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 -> Peer 98735d0ea16b40ab80333722c35a13e4 (127.23.107.136:36793): Couldn't send request to peer 98735d0ea16b40ab80333722c35a13e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260807 13:52:45.434270 28830 consensus_peers.cc:597] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 -> Peer 98735d0ea16b40ab80333722c35a13e4 (127.23.107.136:36793): Couldn't send request to peer 98735d0ea16b40ab80333722c35a13e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260807 13:52:45.475396 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:45.511516 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:45.581409 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:45.602788 2984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:45.626642 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:45.671104 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:45.711426 30758 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:45.725600 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:45.855720 3331 tablet_bootstrap.cc:492] T e88a325f491a4cbc97d05562c44efccd P 98735d0ea16b40ab80333722c35a13e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1118 overwritten=0 applied=1118 ignored=0} inserts{seen=1749 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:52:45.859321 3331 tablet_bootstrap.cc:492] T e88a325f491a4cbc97d05562c44efccd P 98735d0ea16b40ab80333722c35a13e4: Bootstrap complete.
I20260807 13:52:45.862339 3331 ts_tablet_manager.cc:1403] T e88a325f491a4cbc97d05562c44efccd P 98735d0ea16b40ab80333722c35a13e4: Time spent bootstrapping tablet: real 3.261s user 1.451s sys 0.237s
I20260807 13:52:45.871619 3331 raft_consensus.cc:359] T e88a325f491a4cbc97d05562c44efccd P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 1118 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } }
I20260807 13:52:45.872273 3331 raft_consensus.cc:740] T e88a325f491a4cbc97d05562c44efccd P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98735d0ea16b40ab80333722c35a13e4, State: Initialized, Role: FOLLOWER
I20260807 13:52:45.873313 3331 consensus_queue.cc:260] T e88a325f491a4cbc97d05562c44efccd P 98735d0ea16b40ab80333722c35a13e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1118, Last appended: 1.1118, Last appended by leader: 1118, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 1118 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } }
I20260807 13:52:45.890053 3331 ts_tablet_manager.cc:1434] T e88a325f491a4cbc97d05562c44efccd P 98735d0ea16b40ab80333722c35a13e4: Time spent starting tablet: real 0.027s user 0.007s sys 0.016s
I20260807 13:52:45.891789 28943 tablet_copy_service.cc:342] P c11aeb9ac7f04cceb63233785ce00503: Request end of tablet copy session 98735d0ea16b40ab80333722c35a13e4-e88a325f491a4cbc97d05562c44efccd received from {username='slave'} at 127.23.107.136:37257
I20260807 13:52:45.891963 28943 tablet_copy_service.cc:434] P c11aeb9ac7f04cceb63233785ce00503: ending tablet copy session 98735d0ea16b40ab80333722c35a13e4-e88a325f491a4cbc97d05562c44efccd on tablet e88a325f491a4cbc97d05562c44efccd with peer 98735d0ea16b40ab80333722c35a13e4
I20260807 13:52:46.040576 3349 tablet_bootstrap.cc:492] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 98735d0ea16b40ab80333722c35a13e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1154 overwritten=0 applied=1154 ignored=0} inserts{seen=1783 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:52:46.041328 3349 tablet_bootstrap.cc:492] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 98735d0ea16b40ab80333722c35a13e4: Bootstrap complete.
I20260807 13:52:46.041872 3349 ts_tablet_manager.cc:1403] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 98735d0ea16b40ab80333722c35a13e4: Time spent bootstrapping tablet: real 3.347s user 1.431s sys 0.224s
I20260807 13:52:46.043159 3349 raft_consensus.cc:359] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 1154 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } }
I20260807 13:52:46.043496 3349 raft_consensus.cc:740] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98735d0ea16b40ab80333722c35a13e4, State: Initialized, Role: FOLLOWER
I20260807 13:52:46.043926 3349 consensus_queue.cc:260] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 98735d0ea16b40ab80333722c35a13e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1154, Last appended: 1.1154, Last appended by leader: 1154, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 1154 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } }
I20260807 13:52:46.048276 3349 ts_tablet_manager.cc:1434] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 98735d0ea16b40ab80333722c35a13e4: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260807 13:52:46.058378 28602 tablet_copy_service.cc:342] P 0ea2e5a5c2b0429985eb26f907033c9b: Request end of tablet copy session 98735d0ea16b40ab80333722c35a13e4-7a7f0c232a674615a2cf5c3c06abd8a8 received from {username='slave'} at 127.23.107.136:35471
I20260807 13:52:46.058590 28602 tablet_copy_service.cc:434] P 0ea2e5a5c2b0429985eb26f907033c9b: ending tablet copy session 98735d0ea16b40ab80333722c35a13e4-7a7f0c232a674615a2cf5c3c06abd8a8 on tablet 7a7f0c232a674615a2cf5c3c06abd8a8 with peer 98735d0ea16b40ab80333722c35a13e4
I20260807 13:52:46.063530 3362 tablet_bootstrap.cc:492] T c72c9d7fb3364b2485475585dc6f244a P 98735d0ea16b40ab80333722c35a13e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1178 overwritten=0 applied=1178 ignored=0} inserts{seen=1848 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:52:46.064123 3362 tablet_bootstrap.cc:492] T c72c9d7fb3364b2485475585dc6f244a P 98735d0ea16b40ab80333722c35a13e4: Bootstrap complete.
I20260807 13:52:46.064621 3362 ts_tablet_manager.cc:1403] T c72c9d7fb3364b2485475585dc6f244a P 98735d0ea16b40ab80333722c35a13e4: Time spent bootstrapping tablet: real 3.233s user 1.481s sys 0.241s
I20260807 13:52:46.065589 3362 raft_consensus.cc:359] T c72c9d7fb3364b2485475585dc6f244a P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 1178 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } }
I20260807 13:52:46.065905 3362 raft_consensus.cc:740] T c72c9d7fb3364b2485475585dc6f244a P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98735d0ea16b40ab80333722c35a13e4, State: Initialized, Role: FOLLOWER
I20260807 13:52:46.066250 3362 consensus_queue.cc:260] T c72c9d7fb3364b2485475585dc6f244a P 98735d0ea16b40ab80333722c35a13e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1178, Last appended: 1.1178, Last appended by leader: 1178, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 1178 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } }
I20260807 13:52:46.067106 3362 ts_tablet_manager.cc:1434] T c72c9d7fb3364b2485475585dc6f244a P 98735d0ea16b40ab80333722c35a13e4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:52:46.067895 28943 tablet_copy_service.cc:342] P c11aeb9ac7f04cceb63233785ce00503: Request end of tablet copy session 98735d0ea16b40ab80333722c35a13e4-c72c9d7fb3364b2485475585dc6f244a received from {username='slave'} at 127.23.107.136:37257
I20260807 13:52:46.068043 28943 tablet_copy_service.cc:434] P c11aeb9ac7f04cceb63233785ce00503: ending tablet copy session 98735d0ea16b40ab80333722c35a13e4-c72c9d7fb3364b2485475585dc6f244a on tablet c72c9d7fb3364b2485475585dc6f244a with peer 98735d0ea16b40ab80333722c35a13e4
I20260807 13:52:46.119935 3334 tablet_bootstrap.cc:492] T f726c2f0034d4cc8b36c2f706f5e5b04 P 98735d0ea16b40ab80333722c35a13e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1146 overwritten=0 applied=1146 ignored=0} inserts{seen=1818 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:52:46.120416 3334 tablet_bootstrap.cc:492] T f726c2f0034d4cc8b36c2f706f5e5b04 P 98735d0ea16b40ab80333722c35a13e4: Bootstrap complete.
I20260807 13:52:46.120796 3334 ts_tablet_manager.cc:1403] T f726c2f0034d4cc8b36c2f706f5e5b04 P 98735d0ea16b40ab80333722c35a13e4: Time spent bootstrapping tablet: real 3.509s user 1.437s sys 0.235s
I20260807 13:52:46.121598 3334 raft_consensus.cc:359] T f726c2f0034d4cc8b36c2f706f5e5b04 P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 1146 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } }
I20260807 13:52:46.121879 3334 raft_consensus.cc:740] T f726c2f0034d4cc8b36c2f706f5e5b04 P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98735d0ea16b40ab80333722c35a13e4, State: Initialized, Role: FOLLOWER
I20260807 13:52:46.122224 3334 consensus_queue.cc:260] T f726c2f0034d4cc8b36c2f706f5e5b04 P 98735d0ea16b40ab80333722c35a13e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1146, Last appended: 1.1146, Last appended by leader: 1146, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 1146 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } }
I20260807 13:52:46.122745 3334 ts_tablet_manager.cc:1434] T f726c2f0034d4cc8b36c2f706f5e5b04 P 98735d0ea16b40ab80333722c35a13e4: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
I20260807 13:52:46.123616 28943 tablet_copy_service.cc:342] P c11aeb9ac7f04cceb63233785ce00503: Request end of tablet copy session 98735d0ea16b40ab80333722c35a13e4-f726c2f0034d4cc8b36c2f706f5e5b04 received from {username='slave'} at 127.23.107.136:37257
I20260807 13:52:46.123795 28943 tablet_copy_service.cc:434] P c11aeb9ac7f04cceb63233785ce00503: ending tablet copy session 98735d0ea16b40ab80333722c35a13e4-f726c2f0034d4cc8b36c2f706f5e5b04 on tablet f726c2f0034d4cc8b36c2f706f5e5b04 with peer 98735d0ea16b40ab80333722c35a13e4
I20260807 13:52:46.186331 3010 raft_consensus.cc:1217] T f726c2f0034d4cc8b36c2f706f5e5b04 P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.1145->[1.1146-1.1146] Dedup: 1.1146->[]
I20260807 13:52:46.212749 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:46.220183 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:46.231379 3010 raft_consensus.cc:1217] T e88a325f491a4cbc97d05562c44efccd P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.1117->[1.1118-1.1118] Dedup: 1.1118->[]
I20260807 13:52:46.254707 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:46.260701 2984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:46.276940 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:46.294044 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:46.308974 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:46.338824 30758 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:46.365952 3010 raft_consensus.cc:1217] T c72c9d7fb3364b2485475585dc6f244a P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.1177->[1.1178-1.1178] Dedup: 1.1178->[]
I20260807 13:52:46.430482 3010 raft_consensus.cc:1217] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.1153->[1.1154-1.1154] Dedup: 1.1154->[]
I20260807 13:52:46.525825 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:46.546739 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:46.559186 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:46.561879 2984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:46.576792 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:46.590421 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:46.637607 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:46.672195 30758 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:46.878149 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:46.904143 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:46.908614 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:46.932410 2984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:46.942490 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:46.943229 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:46.950858 30758 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:46.960919 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:47.133659 28577 consensus_queue.cc:237] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1154, Committed index: 1154, Last appended: 1.1154, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1155 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } }
I20260807 13:52:47.135859 3010 raft_consensus.cc:1275] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Refusing update from remote peer 0ea2e5a5c2b0429985eb26f907033c9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1154. Preceding OpId from leader: term: 1 index: 1155. (index mismatch)
I20260807 13:52:47.136705 3575 consensus_queue.cc:1048] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1155, Last known committed idx: 1154, Time since last communication: 0.000s
I20260807 13:52:47.140690 3761 raft_consensus.cc:2955] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 LEADER]: Committing config change with OpId 1.1155: config changed from index 1154 to 1155, VOTER 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134) evicted. New config: { opid_index: 1155 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } } }
I20260807 13:52:47.141614 3010 raft_consensus.cc:2955] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Committing config change with OpId 1.1155: config changed from index 1154 to 1155, VOTER 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134) evicted. New config: { opid_index: 1155 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } } }
I20260807 13:52:47.147620 28382 catalog_manager.cc:5697] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 0ea2e5a5c2b0429985eb26f907033c9b reported cstate change: config changed from index 1154 to 1155, VOTER 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134) evicted. New cstate: current_term: 1 leader_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" committed_config { opid_index: 1155 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } } }
I20260807 13:52:47.162732 30565 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a7f0c232a674615a2cf5c3c06abd8a8 with delete_type TABLET_DATA_TOMBSTONED (TS 22b9a9a4b1bf44daa35fcecd47b8856a not found in new config with opid_index 1155) from {username='slave'} at 127.0.0.1:33906
I20260807 13:52:47.164147 3778 tablet_replica.cc:333] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 22b9a9a4b1bf44daa35fcecd47b8856a: stopping tablet replica
I20260807 13:52:47.164793 3778 raft_consensus.cc:2243] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:52:47.165390 3778 raft_consensus.cc:2272] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:52:47.168223 3778 ts_tablet_manager.cc:1916] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 22b9a9a4b1bf44daa35fcecd47b8856a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:52:47.173884 3778 ts_tablet_manager.cc:1929] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 22b9a9a4b1bf44daa35fcecd47b8856a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1154
I20260807 13:52:47.174037 3778 log.cc:1199] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 22b9a9a4b1bf44daa35fcecd47b8856a: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal/wals/7a7f0c232a674615a2cf5c3c06abd8a8
I20260807 13:52:47.175065 28375 catalog_manager.cc:5028] TS 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134:41561): tablet 7a7f0c232a674615a2cf5c3c06abd8a8 (table rebalance_test_table_1 [id=49c4a818a68345dca0cf504531ad490a]) successfully deleted
I20260807 13:52:47.279254 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:47.294512 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:47.294617 2984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:47.313256 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:47.319770 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:47.376163 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:47.406289 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:47.407400 30758 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:47.514151 28920 consensus_queue.cc:237] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1146, Committed index: 1146, Last appended: 1.1146, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1147 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } }
I20260807 13:52:47.516276 3010 raft_consensus.cc:1275] T f726c2f0034d4cc8b36c2f706f5e5b04 P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Refusing update from remote peer c11aeb9ac7f04cceb63233785ce00503: Log matching property violated. Preceding OpId in replica: term: 1 index: 1146. Preceding OpId from leader: term: 1 index: 1147. (index mismatch)
I20260807 13:52:47.516888 3205 consensus_queue.cc:1048] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1147, Last known committed idx: 1146, Time since last communication: 0.000s
I20260807 13:52:47.519855 3852 raft_consensus.cc:2955] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 [term 1 LEADER]: Committing config change with OpId 1.1147: config changed from index 1146 to 1147, VOTER 9da72b03880d4414b034964abe86d4fe (127.23.107.130) evicted. New config: { opid_index: 1147 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } } }
I20260807 13:52:47.520546 3010 raft_consensus.cc:2955] T f726c2f0034d4cc8b36c2f706f5e5b04 P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Committing config change with OpId 1.1147: config changed from index 1146 to 1147, VOTER 9da72b03880d4414b034964abe86d4fe (127.23.107.130) evicted. New config: { opid_index: 1147 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } } }
I20260807 13:52:47.524752 28388 catalog_manager.cc:5697] T f726c2f0034d4cc8b36c2f706f5e5b04 P c11aeb9ac7f04cceb63233785ce00503 reported cstate change: config changed from index 1146 to 1147, VOTER 9da72b03880d4414b034964abe86d4fe (127.23.107.130) evicted. New cstate: current_term: 1 leader_uuid: "c11aeb9ac7f04cceb63233785ce00503" committed_config { opid_index: 1147 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } } }
I20260807 13:52:47.529754 28724 tablet_service.cc:1558] Processing DeleteTablet for tablet f726c2f0034d4cc8b36c2f706f5e5b04 with delete_type TABLET_DATA_TOMBSTONED (TS 9da72b03880d4414b034964abe86d4fe not found in new config with opid_index 1147) from {username='slave'} at 127.0.0.1:55848
I20260807 13:52:47.530761 3856 tablet_replica.cc:333] T f726c2f0034d4cc8b36c2f706f5e5b04 P 9da72b03880d4414b034964abe86d4fe: stopping tablet replica
I20260807 13:52:47.531010 3856 raft_consensus.cc:2243] T f726c2f0034d4cc8b36c2f706f5e5b04 P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:52:47.531328 3856 raft_consensus.cc:2272] T f726c2f0034d4cc8b36c2f706f5e5b04 P 9da72b03880d4414b034964abe86d4fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:52:47.532832 3856 ts_tablet_manager.cc:1916] T f726c2f0034d4cc8b36c2f706f5e5b04 P 9da72b03880d4414b034964abe86d4fe: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:52:47.539351 3856 ts_tablet_manager.cc:1929] T f726c2f0034d4cc8b36c2f706f5e5b04 P 9da72b03880d4414b034964abe86d4fe: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1146
I20260807 13:52:47.539500 3856 log.cc:1199] T f726c2f0034d4cc8b36c2f706f5e5b04 P 9da72b03880d4414b034964abe86d4fe: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/f726c2f0034d4cc8b36c2f706f5e5b04
I20260807 13:52:47.540684 28375 catalog_manager.cc:5028] TS 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223): tablet f726c2f0034d4cc8b36c2f706f5e5b04 (table rebalance_test_table_3 [id=6232d7b2b0b5403c842e16fd04e72177]) successfully deleted
I20260807 13:52:47.651436 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:47.651643 2984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:47.672509 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:47.672927 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:47.673946 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:47.675115 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:47.703927 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:47.738255 30758 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:47.847735 28920 consensus_queue.cc:237] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1118, Committed index: 1118, Last appended: 1.1118, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1119 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } }
I20260807 13:52:47.849812 3010 raft_consensus.cc:1275] T e88a325f491a4cbc97d05562c44efccd P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Refusing update from remote peer c11aeb9ac7f04cceb63233785ce00503: Log matching property violated. Preceding OpId in replica: term: 1 index: 1118. Preceding OpId from leader: term: 1 index: 1119. (index mismatch)
I20260807 13:52:47.850435 3852 consensus_queue.cc:1048] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1119, Last known committed idx: 1118, Time since last communication: 0.000s
I20260807 13:52:47.853097 3205 raft_consensus.cc:2955] T e88a325f491a4cbc97d05562c44efccd P c11aeb9ac7f04cceb63233785ce00503 [term 1 LEADER]: Committing config change with OpId 1.1119: config changed from index 1118 to 1119, VOTER 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129) evicted. New config: { opid_index: 1119 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } } }
I20260807 13:52:47.853794 3010 raft_consensus.cc:2955] T e88a325f491a4cbc97d05562c44efccd P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Committing config change with OpId 1.1119: config changed from index 1118 to 1119, VOTER 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129) evicted. New config: { opid_index: 1119 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } } }
I20260807 13:52:47.860322 28382 catalog_manager.cc:5697] T e88a325f491a4cbc97d05562c44efccd P 98735d0ea16b40ab80333722c35a13e4 reported cstate change: config changed from index 1118 to 1119, VOTER 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129) evicted. New cstate: current_term: 1 leader_uuid: "c11aeb9ac7f04cceb63233785ce00503" committed_config { opid_index: 1119 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } } }
I20260807 13:52:47.864459 28551 tablet_service.cc:1558] Processing DeleteTablet for tablet e88a325f491a4cbc97d05562c44efccd with delete_type TABLET_DATA_TOMBSTONED (TS 0ea2e5a5c2b0429985eb26f907033c9b not found in new config with opid_index 1119) from {username='slave'} at 127.0.0.1:60692
I20260807 13:52:47.865434 3929 tablet_replica.cc:333] T e88a325f491a4cbc97d05562c44efccd P 0ea2e5a5c2b0429985eb26f907033c9b: stopping tablet replica
I20260807 13:52:47.865711 3929 raft_consensus.cc:2243] T e88a325f491a4cbc97d05562c44efccd P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:52:47.866039 3929 raft_consensus.cc:2272] T e88a325f491a4cbc97d05562c44efccd P 0ea2e5a5c2b0429985eb26f907033c9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:52:47.867825 3929 ts_tablet_manager.cc:1916] T e88a325f491a4cbc97d05562c44efccd P 0ea2e5a5c2b0429985eb26f907033c9b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:52:47.873750 3929 ts_tablet_manager.cc:1929] T e88a325f491a4cbc97d05562c44efccd P 0ea2e5a5c2b0429985eb26f907033c9b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1118
I20260807 13:52:47.873922 3929 log.cc:1199] T e88a325f491a4cbc97d05562c44efccd P 0ea2e5a5c2b0429985eb26f907033c9b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/wals/e88a325f491a4cbc97d05562c44efccd
I20260807 13:52:47.874953 28376 catalog_manager.cc:5028] TS 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223): tablet e88a325f491a4cbc97d05562c44efccd (table rebalance_test_table_2 [id=46bf349795f3453589935822245c96b1]) successfully deleted
I20260807 13:52:48.186031 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:48.202019 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:48.203771 30565 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:48.210443 2984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:48.273264 30758 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:48.275923 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:48.276465 28895 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:52:48.284294 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:48.347671 28379 maintenance_manager.cc:419] P 5b0e99a8c47049999ab224df5400bc2c: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033390
I20260807 13:52:48.365128 28920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c72c9d7fb3364b2485475585dc6f244a"
dest_uuid: "c11aeb9ac7f04cceb63233785ce00503"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:49706
I20260807 13:52:48.365481 28920 raft_consensus.cc:606] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [term 1 LEADER]: Received request to transfer leadership
I20260807 13:52:48.400731 28378 maintenance_manager.cc:643] P 5b0e99a8c47049999ab224df5400bc2c: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.052s user 0.036s sys 0.012s Metrics: {"bytes_written":12708,"cfile_init":1,"dirs.queue_time_us":425,"dirs.run_cpu_time_us":292,"dirs.run_wall_time_us":1095,"drs_written":1,"lbm_read_time_us":96,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1228,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":25,"thread_start_us":272,"threads_started":1}
I20260807 13:52:48.402290 28379 maintenance_manager.cc:419] P 5b0e99a8c47049999ab224df5400bc2c: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 3055 bytes on disk
I20260807 13:52:48.403193 28378 maintenance_manager.cc:643] P 5b0e99a8c47049999ab224df5400bc2c: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":88,"lbm_reads_lt_1ms":4}
I20260807 13:52:48.405706 4007 raft_consensus.cc:993] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503: : Instructing follower 22b9a9a4b1bf44daa35fcecd47b8856a to start an election
I20260807 13:52:48.406030 3205 raft_consensus.cc:1081] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [term 1 LEADER]: Signalling peer 22b9a9a4b1bf44daa35fcecd47b8856a to start an election
I20260807 13:52:48.407081 30595 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c72c9d7fb3364b2485475585dc6f244a"
dest_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a"
from {username='slave'} at 127.23.107.131:48025
I20260807 13:52:48.407341 30595 raft_consensus.cc:493] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:52:48.407495 30595 raft_consensus.cc:3060] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:52:48.409963 30595 raft_consensus.cc:515] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 1178 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } }
I20260807 13:52:48.412575 30595 leader_election.cc:290] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a [CANDIDATE]: Term 2 election: Requested vote from peers c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571), 98735d0ea16b40ab80333722c35a13e4 (127.23.107.136:36793)
I20260807 13:52:48.431113 28920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72c9d7fb3364b2485475585dc6f244a" candidate_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1178 } } ignore_live_leader: true dest_uuid: "c11aeb9ac7f04cceb63233785ce00503"
I20260807 13:52:48.431265 3010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72c9d7fb3364b2485475585dc6f244a" candidate_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1178 } } ignore_live_leader: true dest_uuid: "98735d0ea16b40ab80333722c35a13e4"
I20260807 13:52:48.431341 28920 raft_consensus.cc:3055] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:52:48.431417 28920 raft_consensus.cc:740] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c11aeb9ac7f04cceb63233785ce00503, State: Running, Role: LEADER
I20260807 13:52:48.431595 3010 raft_consensus.cc:3060] T c72c9d7fb3364b2485475585dc6f244a P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:52:48.431735 28920 consensus_queue.cc:260] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1178, Committed index: 1178, Last appended: 1.1178, Last appended by leader: 1178, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 1178 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } }
I20260807 13:52:48.432137 28920 raft_consensus.cc:3060] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:52:48.433966 3010 raft_consensus.cc:2468] T c72c9d7fb3364b2485475585dc6f244a P 98735d0ea16b40ab80333722c35a13e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22b9a9a4b1bf44daa35fcecd47b8856a in term 2.
I20260807 13:52:48.434444 30501 leader_election.cc:304] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22b9a9a4b1bf44daa35fcecd47b8856a, 98735d0ea16b40ab80333722c35a13e4; no voters:
I20260807 13:52:48.434813 3903 raft_consensus.cc:2804] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:52:48.435295 28920 raft_consensus.cc:2468] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22b9a9a4b1bf44daa35fcecd47b8856a in term 2.
I20260807 13:52:48.435343 3903 raft_consensus.cc:697] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a [term 2 LEADER]: Becoming Leader. State: Replica: 22b9a9a4b1bf44daa35fcecd47b8856a, State: Running, Role: LEADER
I20260807 13:52:48.435732 3903 consensus_queue.cc:237] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1178, Committed index: 1178, Last appended: 1.1178, Last appended by leader: 1178, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1178 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } }
I20260807 13:52:48.439107 28384 catalog_manager.cc:5697] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a reported cstate change: term changed from 1 to 2, leader changed from c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131) to 22b9a9a4b1bf44daa35fcecd47b8856a (127.23.107.134). New cstate: current_term: 2 leader_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" committed_config { opid_index: 1178 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } } }
I20260807 13:52:48.516338 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:48.532459 2984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:48.532694 30565 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:52:48.552029 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:48.581848 28895 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:48.594879 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:48.597469 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:48.638069 30758 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:48.844630 28920 raft_consensus.cc:1275] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [term 2 FOLLOWER]: Refusing update from remote peer 22b9a9a4b1bf44daa35fcecd47b8856a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1178. Preceding OpId from leader: term: 2 index: 1179. (index mismatch)
I20260807 13:52:48.845750 3903 consensus_queue.cc:1048] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1179, Last known committed idx: 1178, Time since last communication: 0.000s
I20260807 13:52:48.854722 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:48.858736 2984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:48.877041 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:48.881150 3010 raft_consensus.cc:1275] T c72c9d7fb3364b2485475585dc6f244a P 98735d0ea16b40ab80333722c35a13e4 [term 2 FOLLOWER]: Refusing update from remote peer 22b9a9a4b1bf44daa35fcecd47b8856a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1178. Preceding OpId from leader: term: 2 index: 1179. (index mismatch)
I20260807 13:52:48.882134 3903 consensus_queue.cc:1048] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a [LEADER]: Connected to new peer: Peer: permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1179, Last known committed idx: 1178, Time since last communication: 0.000s
I20260807 13:52:48.884652 30565 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:52:48.915998 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:48.922220 28895 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:48.939134 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:48.962045 30758 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:49.411679 30565 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:52:49.425457 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:49.462327 28895 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:49.463912 2984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:49.482800 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:49.491688 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:49.529045 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:49.555480 30758 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:49.695492 30595 consensus_queue.cc:237] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1179, Committed index: 1179, Last appended: 2.1179, Last appended by leader: 1178, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 1180 OBSOLETE_local: false peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } }
I20260807 13:52:49.697451 3010 raft_consensus.cc:1275] T c72c9d7fb3364b2485475585dc6f244a P 98735d0ea16b40ab80333722c35a13e4 [term 2 FOLLOWER]: Refusing update from remote peer 22b9a9a4b1bf44daa35fcecd47b8856a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1179. Preceding OpId from leader: term: 2 index: 1180. (index mismatch)
I20260807 13:52:49.698177 3903 consensus_queue.cc:1048] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a [LEADER]: Connected to new peer: Peer: permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1180, Last known committed idx: 1179, Time since last communication: 0.000s
I20260807 13:52:49.701040 4212 raft_consensus.cc:2955] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a [term 2 LEADER]: Committing config change with OpId 2.1180: config changed from index 1178 to 1180, VOTER c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131) evicted. New config: { opid_index: 1180 OBSOLETE_local: false peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } } }
I20260807 13:52:49.701820 3010 raft_consensus.cc:2955] T c72c9d7fb3364b2485475585dc6f244a P 98735d0ea16b40ab80333722c35a13e4 [term 2 FOLLOWER]: Committing config change with OpId 2.1180: config changed from index 1178 to 1180, VOTER c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131) evicted. New config: { opid_index: 1180 OBSOLETE_local: false peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } } }
I20260807 13:52:49.706442 28389 catalog_manager.cc:5697] T c72c9d7fb3364b2485475585dc6f244a P 22b9a9a4b1bf44daa35fcecd47b8856a reported cstate change: config changed from index 1178 to 1180, VOTER c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131) evicted. New cstate: current_term: 2 leader_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" committed_config { opid_index: 1180 OBSOLETE_local: false peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } } }
I20260807 13:52:49.712801 28895 tablet_service.cc:1558] Processing DeleteTablet for tablet c72c9d7fb3364b2485475585dc6f244a with delete_type TABLET_DATA_TOMBSTONED (TS c11aeb9ac7f04cceb63233785ce00503 not found in new config with opid_index 1180) from {username='slave'} at 127.0.0.1:39832
I20260807 13:52:49.713549 4219 tablet_replica.cc:333] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503: stopping tablet replica
I20260807 13:52:49.713775 4219 raft_consensus.cc:2243] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:52:49.713984 4219 raft_consensus.cc:2272] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:52:49.715684 4219 ts_tablet_manager.cc:1916] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:52:49.720657 4219 ts_tablet_manager.cc:1929] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.1179
I20260807 13:52:49.720794 4219 log.cc:1199] T c72c9d7fb3364b2485475585dc6f244a P c11aeb9ac7f04cceb63233785ce00503: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/wals/c72c9d7fb3364b2485475585dc6f244a
I20260807 13:52:49.721935 28375 catalog_manager.cc:5028] TS c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571): tablet c72c9d7fb3364b2485475585dc6f244a (table rebalance_test_table_0 [id=2f5b82068ed242bcb08a733f8a0d94df]) successfully deleted
I20260807 13:52:50.059497 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:50.104391 30565 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:52:50.104916 2984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:50.116777 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:50.167758 28895 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:50.175578 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:50.195261 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:50.224601 30758 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:50.416337 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:50.435875 2984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:50.440369 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:50.446943 30565 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:52:50.452248 30758 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:50.475490 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:50.476167 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:50.489506 28895 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:50.976207 30565 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:52:50.987273 28895 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:50.990592 28724 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:50.993000 28551 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:52:51.021353 2984 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:51.051128 30220 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:52:51.128232 30396 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:52:51.155016 30758 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
5b0e99a8c47049999ab224df5400bc2c | 127.23.107.190:39563 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
allow_unsafe_replication_factor | true | runtime,unsafe | all 1 server(s) checked
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.23.107.148:41209 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
0ea2e5a5c2b0429985eb26f907033c9b | 127.23.107.129:37223 | HEALTHY | <none> | 4 | 0
22b9a9a4b1bf44daa35fcecd47b8856a | 127.23.107.134:41561 | HEALTHY | <none> | 2 | 0
98735d0ea16b40ab80333722c35a13e4 | 127.23.107.136:36793 | HEALTHY | <none> | 0 | 0
9da72b03880d4414b034964abe86d4fe | 127.23.107.130:43223 | HEALTHY | <none> | 4 | 0
c11aeb9ac7f04cceb63233785ce00503 | 127.23.107.131:41571 | HEALTHY | <none> | 4 | 0
c45d5217722649e6bdbccee30863591b | 127.23.107.132:34213 | HEALTHY | <none> | 0 | 0
ed5ae0647048435da282261048c04db2 | 127.23.107.133:34943 | HEALTHY | <none> | 1 | 0
f634a7b061e64a7caf1cb02a4731dadc | 127.23.107.135:39559 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 8
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
ipki_server_key_size | 768 | experimental | all 8 server(s) checked
local_ip_for_outbound_sockets | 127.23.107.129 | experimental | 127.23.107.129:37223
local_ip_for_outbound_sockets | 127.23.107.130 | experimental | 127.23.107.130:43223
local_ip_for_outbound_sockets | 127.23.107.131 | experimental | 127.23.107.131:41571
local_ip_for_outbound_sockets | 127.23.107.132 | experimental | 127.23.107.132:34213
local_ip_for_outbound_sockets | 127.23.107.133 | experimental | 127.23.107.133:34943
local_ip_for_outbound_sockets | 127.23.107.134 | experimental | 127.23.107.134:41561
local_ip_for_outbound_sockets | 127.23.107.135 | experimental | 127.23.107.135:39559
local_ip_for_outbound_sockets | 127.23.107.136 | experimental | 127.23.107.136:36793
never_fsync | true | unsafe,advanced | all 8 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 8 server(s) checked
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 8 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 8 server(s) checked
server_dump_info_format | pb | hidden | all 8 server(s) checked
server_dump_info_path | /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.23.107.129:37223
server_dump_info_path | /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.23.107.130:43223
server_dump_info_path | /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.23.107.131:41571
server_dump_info_path | /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/info.pb | hidden | 127.23.107.132:34213
server_dump_info_path | /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/info.pb | hidden | 127.23.107.133:34943
server_dump_info_path | /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/info.pb | hidden | 127.23.107.134:41561
server_dump_info_path | /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data/info.pb | hidden | 127.23.107.135:39559
server_dump_info_path | /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalanceParamTest.Rebalance_2.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/data/info.pb | hidden | 127.23.107.136:36793
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.23.107.148:41209 | all 8 server(s) checked
time_source | builtin | all 8 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 9 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
------------------------+----+---------+---------------+---------+------------+------------------+-------------
TestTable | 2 | HEALTHY | 1 | 1 | 0 | 0 | 0
rebalance_test_table_0 | 2 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_1 | 2 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_2 | 2 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_3 | 2 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_4 | 2 | HEALTHY | 3 | 3 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 4
First Quartile | 4
Median | 4
Third Quartile | 4
Maximum | 4
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 8
Tables | 6
Tablets | 16
Replicas | 32
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260807 13:52:51.206076 23982 log_verifier.cc:126] Checking tablet 024803a9deb6450dad724e4b614213e1
I20260807 13:52:51.220577 23982 log_verifier.cc:177] Verified matching terms for 2 ops in tablet 024803a9deb6450dad724e4b614213e1
I20260807 13:52:51.220718 23982 log_verifier.cc:126] Checking tablet 04f1daf8b6a44274bf2cc578e93c8303
I20260807 13:52:51.672554 23982 log_verifier.cc:177] Verified matching terms for 1215 ops in tablet 04f1daf8b6a44274bf2cc578e93c8303
I20260807 13:52:51.673923 23982 log_verifier.cc:126] Checking tablet 1592525dd2a646de874117d51026e771
I20260807 13:52:52.034363 23982 log_verifier.cc:177] Verified matching terms for 1074 ops in tablet 1592525dd2a646de874117d51026e771
I20260807 13:52:52.035467 23982 log_verifier.cc:126] Checking tablet 3da3196623e04606aca463b8847ab6cd
I20260807 13:52:52.458946 23982 log_verifier.cc:177] Verified matching terms for 1149 ops in tablet 3da3196623e04606aca463b8847ab6cd
I20260807 13:52:52.460239 23982 log_verifier.cc:126] Checking tablet 3fefa1bc622f43ca8344ddfe3522ce46
I20260807 13:52:52.853178 23982 log_verifier.cc:177] Verified matching terms for 1171 ops in tablet 3fefa1bc622f43ca8344ddfe3522ce46
I20260807 13:52:52.854499 23982 log_verifier.cc:126] Checking tablet 5daf3681a6ba460385331aadffabfa8f
I20260807 13:52:53.283330 23982 log_verifier.cc:177] Verified matching terms for 1174 ops in tablet 5daf3681a6ba460385331aadffabfa8f
I20260807 13:52:53.284500 23982 log_verifier.cc:126] Checking tablet 79268a57a70b4612aff6405c6d587f33
I20260807 13:52:53.619151 23982 log_verifier.cc:177] Verified matching terms for 1036 ops in tablet 79268a57a70b4612aff6405c6d587f33
I20260807 13:52:53.620184 23982 log_verifier.cc:126] Checking tablet 7a7f0c232a674615a2cf5c3c06abd8a8
I20260807 13:52:54.032974 23982 log_verifier.cc:177] Verified matching terms for 1155 ops in tablet 7a7f0c232a674615a2cf5c3c06abd8a8
I20260807 13:52:54.034302 23982 log_verifier.cc:126] Checking tablet ae179f753242471eb4484553d9df106b
I20260807 13:52:54.420873 23982 log_verifier.cc:177] Verified matching terms for 1239 ops in tablet ae179f753242471eb4484553d9df106b
I20260807 13:52:54.422380 23982 log_verifier.cc:126] Checking tablet ba6d87b94369439dac8c8355d744a7f3
I20260807 13:52:54.808092 23982 log_verifier.cc:177] Verified matching terms for 1051 ops in tablet ba6d87b94369439dac8c8355d744a7f3
I20260807 13:52:54.809012 23982 log_verifier.cc:126] Checking tablet be0c7339d6fd43c781879ef4c2c76fbd
I20260807 13:52:55.165275 23982 log_verifier.cc:177] Verified matching terms for 1120 ops in tablet be0c7339d6fd43c781879ef4c2c76fbd
I20260807 13:52:55.166399 23982 log_verifier.cc:126] Checking tablet c2891223f5fd43979439c00fec9fca3d
I20260807 13:52:55.523268 23982 log_verifier.cc:177] Verified matching terms for 1127 ops in tablet c2891223f5fd43979439c00fec9fca3d
I20260807 13:52:55.524320 23982 log_verifier.cc:126] Checking tablet c72c9d7fb3364b2485475585dc6f244a
I20260807 13:52:55.939523 23982 log_verifier.cc:177] Verified matching terms for 1180 ops in tablet c72c9d7fb3364b2485475585dc6f244a
I20260807 13:52:55.940584 23982 log_verifier.cc:126] Checking tablet e88a325f491a4cbc97d05562c44efccd
I20260807 13:52:56.300446 23982 log_verifier.cc:177] Verified matching terms for 1119 ops in tablet e88a325f491a4cbc97d05562c44efccd
I20260807 13:52:56.301638 23982 log_verifier.cc:126] Checking tablet f726c2f0034d4cc8b36c2f706f5e5b04
I20260807 13:52:56.425906 28637 maintenance_manager.cc:419] P 0ea2e5a5c2b0429985eb26f907033c9b: Scheduling FlushMRSOp(f9f996c0ec5849d98b1cc0fc83cc51a6): perf score=0.033344
I20260807 13:52:56.453244 28807 maintenance_manager.cc:419] P 9da72b03880d4414b034964abe86d4fe: Scheduling FlushMRSOp(be0c7339d6fd43c781879ef4c2c76fbd): perf score=0.033357
I20260807 13:52:56.602665 28495 maintenance_manager.cc:643] P 0ea2e5a5c2b0429985eb26f907033c9b: FlushMRSOp(f9f996c0ec5849d98b1cc0fc83cc51a6) complete. Timing: real 0.176s user 0.123s sys 0.049s Metrics: {"bytes_written":41927,"cfile_init":1,"compiler_manager_pool.queue_time_us":414,"dirs.queue_time_us":6394,"dirs.run_cpu_time_us":273,"dirs.run_wall_time_us":11396,"drs_written":1,"lbm_read_time_us":123,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1317,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":1905,"thread_start_us":13486,"threads_started":3,"wal-append.queue_time_us":6417}
I20260807 13:52:56.604931 28637 maintenance_manager.cc:419] P 0ea2e5a5c2b0429985eb26f907033c9b: Scheduling UndoDeltaBlockGCOp(f9f996c0ec5849d98b1cc0fc83cc51a6): 19170 bytes on disk
I20260807 13:52:56.606004 28495 maintenance_manager.cc:643] P 0ea2e5a5c2b0429985eb26f907033c9b: UndoDeltaBlockGCOp(f9f996c0ec5849d98b1cc0fc83cc51a6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":118,"lbm_reads_lt_1ms":4}
I20260807 13:52:56.719192 28665 maintenance_manager.cc:643] P 9da72b03880d4414b034964abe86d4fe: FlushMRSOp(be0c7339d6fd43c781879ef4c2c76fbd) complete. Timing: real 0.265s user 0.135s sys 0.040s Metrics: {"bytes_written":39343,"cfile_init":1,"compiler_manager_pool.queue_time_us":12615,"dirs.queue_time_us":6604,"dirs.run_cpu_time_us":241,"dirs.run_wall_time_us":9662,"drs_written":1,"lbm_read_time_us":115,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1387,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":1750,"thread_start_us":28386,"threads_started":3,"wal-append.queue_time_us":8183}
I20260807 13:52:56.721225 28807 maintenance_manager.cc:419] P 9da72b03880d4414b034964abe86d4fe: Scheduling UndoDeltaBlockGCOp(be0c7339d6fd43c781879ef4c2c76fbd): 17636 bytes on disk
I20260807 13:52:56.722199 28665 maintenance_manager.cc:643] P 9da72b03880d4414b034964abe86d4fe: UndoDeltaBlockGCOp(be0c7339d6fd43c781879ef4c2c76fbd) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":109,"lbm_reads_lt_1ms":4}
I20260807 13:52:56.969419 23982 log_verifier.cc:177] Verified matching terms for 1147 ops in tablet f726c2f0034d4cc8b36c2f706f5e5b04
I20260807 13:52:56.971406 23982 log_verifier.cc:126] Checking tablet f9f996c0ec5849d98b1cc0fc83cc51a6
I20260807 13:52:57.466362 23982 log_verifier.cc:177] Verified matching terms for 1221 ops in tablet f9f996c0ec5849d98b1cc0fc83cc51a6
I20260807 13:52:57.480016 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 28467
I20260807 13:52:57.519081 28628 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:52:57.725404 28807 maintenance_manager.cc:419] P 9da72b03880d4414b034964abe86d4fe: Scheduling FlushMRSOp(3da3196623e04606aca463b8847ab6cd): perf score=0.033360
I20260807 13:52:57.780676 28978 maintenance_manager.cc:419] P c11aeb9ac7f04cceb63233785ce00503: Scheduling FlushMRSOp(c2891223f5fd43979439c00fec9fca3d): perf score=0.033380
I20260807 13:52:57.834779 28665 maintenance_manager.cc:643] P 9da72b03880d4414b034964abe86d4fe: FlushMRSOp(3da3196623e04606aca463b8847ab6cd) complete. Timing: real 0.109s user 0.063s sys 0.017s Metrics: {"bytes_written":40261,"cfile_init":1,"dirs.queue_time_us":441,"dirs.run_cpu_time_us":283,"dirs.run_wall_time_us":1876,"drs_written":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4,"lbm_write_time_us":830,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":1833,"thread_start_us":7597,"threads_started":2,"wal-append.queue_time_us":7407}
I20260807 13:52:57.835752 28807 maintenance_manager.cc:419] P 9da72b03880d4414b034964abe86d4fe: Scheduling UndoDeltaBlockGCOp(3da3196623e04606aca463b8847ab6cd): 18318 bytes on disk
I20260807 13:52:57.836433 28665 maintenance_manager.cc:643] P 9da72b03880d4414b034964abe86d4fe: UndoDeltaBlockGCOp(3da3196623e04606aca463b8847ab6cd) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":111,"lbm_reads_lt_1ms":4}
I20260807 13:52:57.912597 28637 maintenance_manager.cc:419] P 0ea2e5a5c2b0429985eb26f907033c9b: Scheduling FlushMRSOp(7a7f0c232a674615a2cf5c3c06abd8a8): perf score=0.033415
I20260807 13:52:57.913957 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 28467
I20260807 13:52:57.944964 28836 maintenance_manager.cc:643] P c11aeb9ac7f04cceb63233785ce00503: FlushMRSOp(c2891223f5fd43979439c00fec9fca3d) complete. Timing: real 0.163s user 0.106s sys 0.050s Metrics: {"bytes_written":39620,"cfile_init":1,"compiler_manager_pool.queue_time_us":400,"dirs.queue_time_us":472,"dirs.run_cpu_time_us":268,"dirs.run_wall_time_us":954,"drs_written":1,"lbm_read_time_us":107,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1254,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":1798,"thread_start_us":837,"threads_started":3,"wal-append.queue_time_us":432}
I20260807 13:52:57.947202 28978 maintenance_manager.cc:419] P c11aeb9ac7f04cceb63233785ce00503: Scheduling UndoDeltaBlockGCOp(c2891223f5fd43979439c00fec9fca3d): 17939 bytes on disk
I20260807 13:52:57.948284 28836 maintenance_manager.cc:643] P c11aeb9ac7f04cceb63233785ce00503: UndoDeltaBlockGCOp(c2891223f5fd43979439c00fec9fca3d) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":165,"lbm_reads_lt_1ms":4}
I20260807 13:52:57.988691 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 28642
W20260807 13:52:57.988664 2914 connection.cc:573] server connection from 127.23.107.129:41405 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 13:52:57.996411 28801 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:52:58.347862 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 28642
W20260807 13:52:58.427481 30163 connection.cc:573] server connection from 127.23.107.130:44943 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 13:52:58.427958 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 28809
W20260807 13:52:58.428117 28375 connection.cc:573] server connection from 127.23.107.130:35891 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 13:52:58.434715 28971 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:52:58.790817 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 28809
I20260807 13:52:58.823248 4422 raft_consensus.cc:493] T 5daf3681a6ba460385331aadffabfa8f P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ea2e5a5c2b0429985eb26f907033c9b)
I20260807 13:52:58.823572 4422 raft_consensus.cc:515] T 5daf3681a6ba460385331aadffabfa8f P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 671 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } }
I20260807 13:52:58.824788 4422 leader_election.cc:290] T 5daf3681a6ba460385331aadffabfa8f P ed5ae0647048435da282261048c04db2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223)
W20260807 13:52:58.825986 30338 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.107.129:37223: connect: Connection refused (error 111)
W20260807 13:52:58.827538 30338 leader_election.cc:336] T 5daf3681a6ba460385331aadffabfa8f P ed5ae0647048435da282261048c04db2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223): Network error: Client connection negotiation failed: client connection to 127.23.107.129:37223: connect: Connection refused (error 111)
I20260807 13:52:58.827682 30338 leader_election.cc:304] T 5daf3681a6ba460385331aadffabfa8f P ed5ae0647048435da282261048c04db2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: ed5ae0647048435da282261048c04db2; no voters: 0ea2e5a5c2b0429985eb26f907033c9b
I20260807 13:52:58.828020 4422 raft_consensus.cc:2749] T 5daf3681a6ba460385331aadffabfa8f P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:52:58.862164 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 30137
I20260807 13:52:58.868295 30307 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:52:58.939621 4212 raft_consensus.cc:493] T 1592525dd2a646de874117d51026e771 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0ea2e5a5c2b0429985eb26f907033c9b)
I20260807 13:52:58.939865 4212 raft_consensus.cc:515] T 1592525dd2a646de874117d51026e771 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 692 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "22b9a9a4b1bf44daa35fcecd47b8856a" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 41561 } }
I20260807 13:52:58.940515 4212 leader_election.cc:290] T 1592525dd2a646de874117d51026e771 P 22b9a9a4b1bf44daa35fcecd47b8856a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223)
W20260807 13:52:58.941833 30506 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.107.129:37223: connect: Connection refused (error 111)
W20260807 13:52:58.943222 30506 leader_election.cc:336] T 1592525dd2a646de874117d51026e771 P 22b9a9a4b1bf44daa35fcecd47b8856a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223): Network error: Client connection negotiation failed: client connection to 127.23.107.129:37223: connect: Connection refused (error 111)
I20260807 13:52:58.943378 30506 leader_election.cc:304] T 1592525dd2a646de874117d51026e771 P 22b9a9a4b1bf44daa35fcecd47b8856a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 22b9a9a4b1bf44daa35fcecd47b8856a; no voters: 0ea2e5a5c2b0429985eb26f907033c9b
I20260807 13:52:58.943655 4212 raft_consensus.cc:2749] T 1592525dd2a646de874117d51026e771 P 22b9a9a4b1bf44daa35fcecd47b8856a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:52:58.952023 4422 raft_consensus.cc:493] T f9f996c0ec5849d98b1cc0fc83cc51a6 P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ea2e5a5c2b0429985eb26f907033c9b)
I20260807 13:52:58.952230 4422 raft_consensus.cc:515] T f9f996c0ec5849d98b1cc0fc83cc51a6 P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 406 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "ed5ae0647048435da282261048c04db2" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 34943 } }
I20260807 13:52:58.952724 4422 leader_election.cc:290] T f9f996c0ec5849d98b1cc0fc83cc51a6 P ed5ae0647048435da282261048c04db2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223)
W20260807 13:52:58.954103 30338 leader_election.cc:336] T f9f996c0ec5849d98b1cc0fc83cc51a6 P ed5ae0647048435da282261048c04db2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223): Network error: Client connection negotiation failed: client connection to 127.23.107.129:37223: connect: Connection refused (error 111)
I20260807 13:52:58.954242 30338 leader_election.cc:304] T f9f996c0ec5849d98b1cc0fc83cc51a6 P ed5ae0647048435da282261048c04db2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: ed5ae0647048435da282261048c04db2; no voters: 0ea2e5a5c2b0429985eb26f907033c9b
I20260807 13:52:58.954505 4422 raft_consensus.cc:2749] T f9f996c0ec5849d98b1cc0fc83cc51a6 P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:52:59.169726 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 30137
I20260807 13:52:59.233866 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 30318
I20260807 13:52:59.240331 30471 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:52:59.359843 4441 raft_consensus.cc:493] T be0c7339d6fd43c781879ef4c2c76fbd P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da72b03880d4414b034964abe86d4fe)
I20260807 13:52:59.360102 4441 raft_consensus.cc:515] T be0c7339d6fd43c781879ef4c2c76fbd P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 211 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } }
I20260807 13:52:59.361014 4441 leader_election.cc:290] T be0c7339d6fd43c781879ef4c2c76fbd P f634a7b061e64a7caf1cb02a4731dadc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223)
W20260807 13:52:59.362252 30695 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.107.130:43223: connect: Connection refused (error 111)
W20260807 13:52:59.363791 30695 leader_election.cc:336] T be0c7339d6fd43c781879ef4c2c76fbd P f634a7b061e64a7caf1cb02a4731dadc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223): Network error: Client connection negotiation failed: client connection to 127.23.107.130:43223: connect: Connection refused (error 111)
I20260807 13:52:59.363941 30695 leader_election.cc:304] T be0c7339d6fd43c781879ef4c2c76fbd P f634a7b061e64a7caf1cb02a4731dadc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: f634a7b061e64a7caf1cb02a4731dadc; no voters: 9da72b03880d4414b034964abe86d4fe
I20260807 13:52:59.364318 4441 raft_consensus.cc:2749] T be0c7339d6fd43c781879ef4c2c76fbd P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:52:59.415956 4451 raft_consensus.cc:493] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ea2e5a5c2b0429985eb26f907033c9b)
I20260807 13:52:59.416232 4451 raft_consensus.cc:515] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1155 OBSOLETE_local: false peers { permanent_uuid: "0ea2e5a5c2b0429985eb26f907033c9b" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 37223 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } }
I20260807 13:52:59.417881 4451 leader_election.cc:290] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 98735d0ea16b40ab80333722c35a13e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223)
W20260807 13:52:59.419147 2918 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.107.129:37223: connect: Connection refused (error 111)
W20260807 13:52:59.420805 2918 leader_election.cc:336] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 98735d0ea16b40ab80333722c35a13e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0ea2e5a5c2b0429985eb26f907033c9b (127.23.107.129:37223): Network error: Client connection negotiation failed: client connection to 127.23.107.129:37223: connect: Connection refused (error 111)
I20260807 13:52:59.421005 2918 leader_election.cc:304] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 98735d0ea16b40ab80333722c35a13e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 98735d0ea16b40ab80333722c35a13e4; no voters: 0ea2e5a5c2b0429985eb26f907033c9b
I20260807 13:52:59.421398 4451 raft_consensus.cc:2749] T 7a7f0c232a674615a2cf5c3c06abd8a8 P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:52:59.478847 4441 raft_consensus.cc:493] T ae179f753242471eb4484553d9df106b P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da72b03880d4414b034964abe86d4fe)
I20260807 13:52:59.479128 4441 raft_consensus.cc:515] T ae179f753242471eb4484553d9df106b P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 631 OBSOLETE_local: false peers { permanent_uuid: "9da72b03880d4414b034964abe86d4fe" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 43223 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } }
I20260807 13:52:59.479823 4441 leader_election.cc:290] T ae179f753242471eb4484553d9df106b P f634a7b061e64a7caf1cb02a4731dadc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223)
W20260807 13:52:59.481469 30695 leader_election.cc:336] T ae179f753242471eb4484553d9df106b P f634a7b061e64a7caf1cb02a4731dadc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9da72b03880d4414b034964abe86d4fe (127.23.107.130:43223): Network error: Client connection negotiation failed: client connection to 127.23.107.130:43223: connect: Connection refused (error 111)
I20260807 13:52:59.481586 30695 leader_election.cc:304] T ae179f753242471eb4484553d9df106b P f634a7b061e64a7caf1cb02a4731dadc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: f634a7b061e64a7caf1cb02a4731dadc; no voters: 9da72b03880d4414b034964abe86d4fe
I20260807 13:52:59.481935 4441 raft_consensus.cc:2749] T ae179f753242471eb4484553d9df106b P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:52:59.485036 4451 raft_consensus.cc:493] T f726c2f0034d4cc8b36c2f706f5e5b04 P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c11aeb9ac7f04cceb63233785ce00503)
I20260807 13:52:59.485251 4451 raft_consensus.cc:515] T f726c2f0034d4cc8b36c2f706f5e5b04 P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1147 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } }
I20260807 13:52:59.485988 4451 leader_election.cc:290] T f726c2f0034d4cc8b36c2f706f5e5b04 P 98735d0ea16b40ab80333722c35a13e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571)
W20260807 13:52:59.487440 2917 leader_election.cc:336] T f726c2f0034d4cc8b36c2f706f5e5b04 P 98735d0ea16b40ab80333722c35a13e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571): Network error: Client connection negotiation failed: client connection to 127.23.107.131:41571: connect: Connection refused (error 111)
I20260807 13:52:59.487553 2917 leader_election.cc:304] T f726c2f0034d4cc8b36c2f706f5e5b04 P 98735d0ea16b40ab80333722c35a13e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 98735d0ea16b40ab80333722c35a13e4; no voters: c11aeb9ac7f04cceb63233785ce00503
I20260807 13:52:59.487823 4451 raft_consensus.cc:2749] T f726c2f0034d4cc8b36c2f706f5e5b04 P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:52:59.548694 4422 raft_consensus.cc:493] T c2891223f5fd43979439c00fec9fca3d P ed5ae0647048435da282261048c04db2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c11aeb9ac7f04cceb63233785ce00503)
I20260807 13:52:59.549898 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 30318
I20260807 13:52:59.584717 4451 raft_consensus.cc:493] T e88a325f491a4cbc97d05562c44efccd P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c11aeb9ac7f04cceb63233785ce00503)
I20260807 13:52:59.584992 4451 raft_consensus.cc:515] T e88a325f491a4cbc97d05562c44efccd P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1119 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "98735d0ea16b40ab80333722c35a13e4" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 36793 } }
I20260807 13:52:59.585695 4451 leader_election.cc:290] T e88a325f491a4cbc97d05562c44efccd P 98735d0ea16b40ab80333722c35a13e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571)
W20260807 13:52:59.587440 2917 leader_election.cc:336] T e88a325f491a4cbc97d05562c44efccd P 98735d0ea16b40ab80333722c35a13e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571): Network error: Client connection negotiation failed: client connection to 127.23.107.131:41571: connect: Connection refused (error 111)
I20260807 13:52:59.587551 2917 leader_election.cc:304] T e88a325f491a4cbc97d05562c44efccd P 98735d0ea16b40ab80333722c35a13e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 98735d0ea16b40ab80333722c35a13e4; no voters: c11aeb9ac7f04cceb63233785ce00503
I20260807 13:52:59.587858 4451 raft_consensus.cc:2749] T e88a325f491a4cbc97d05562c44efccd P 98735d0ea16b40ab80333722c35a13e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:52:59.615311 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 30483
W20260807 13:52:59.619143 30504 consensus_peers.cc:597] T 024803a9deb6450dad724e4b614213e1 P 22b9a9a4b1bf44daa35fcecd47b8856a -> Peer c45d5217722649e6bdbccee30863591b (127.23.107.132:34213): Couldn't send request to peer c45d5217722649e6bdbccee30863591b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:34213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:52:59.621806 30661 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:52:59.708078 4441 raft_consensus.cc:493] T 79268a57a70b4612aff6405c6d587f33 P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c11aeb9ac7f04cceb63233785ce00503)
I20260807 13:52:59.708354 4441 raft_consensus.cc:515] T 79268a57a70b4612aff6405c6d587f33 P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 530 OBSOLETE_local: false peers { permanent_uuid: "c11aeb9ac7f04cceb63233785ce00503" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 41571 } } peers { permanent_uuid: "f634a7b061e64a7caf1cb02a4731dadc" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 39559 } }
I20260807 13:52:59.709113 4441 leader_election.cc:290] T 79268a57a70b4612aff6405c6d587f33 P f634a7b061e64a7caf1cb02a4731dadc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571)
W20260807 13:52:59.710742 30695 leader_election.cc:336] T 79268a57a70b4612aff6405c6d587f33 P f634a7b061e64a7caf1cb02a4731dadc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c11aeb9ac7f04cceb63233785ce00503 (127.23.107.131:41571): Network error: Client connection negotiation failed: client connection to 127.23.107.131:41571: connect: Connection refused (error 111)
I20260807 13:52:59.710870 30695 leader_election.cc:304] T 79268a57a70b4612aff6405c6d587f33 P f634a7b061e64a7caf1cb02a4731dadc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: f634a7b061e64a7caf1cb02a4731dadc; no voters: c11aeb9ac7f04cceb63233785ce00503
I20260807 13:52:59.711231 4441 raft_consensus.cc:2749] T 79268a57a70b4612aff6405c6d587f33 P f634a7b061e64a7caf1cb02a4731dadc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:52:59.917930 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 30483
W20260807 13:52:59.981456 28375 connection.cc:573] server connection from 127.23.107.134:35601 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 13:52:59.981720 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 30674
I20260807 13:52:59.987730 30835 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:53:00.282493 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 30674
I20260807 13:53:00.350214 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 2896
I20260807 13:53:00.362035 3061 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:53:00.571914 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 2896
I20260807 13:53:00.615597 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 28351
I20260807 13:53:00.616786 28432 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:53:00.894140 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 28351
2026-08-07T13:53:00Z chronyd exiting
[ OK ] RebalanceParamTest.Rebalance/2 (133503 ms)
[----------] 1 test from RebalanceParamTest (133503 ms total)
[----------] 1 test from ConcurrentRebalancersTest
[ RUN ] ConcurrentRebalancersTest.TwoConcurrentRebalancers/0
I20260807 13:53:01.065814 23982 ts_itest-base.cc:115] Starting cluster with:
I20260807 13:53:01.065922 23982 ts_itest-base.cc:116] --------------
I20260807 13:53:01.065969 23982 ts_itest-base.cc:117] 8 tablet servers
I20260807 13:53:01.066025 23982 ts_itest-base.cc:118] 3 replicas per TS
I20260807 13:53:01.066076 23982 ts_itest-base.cc:119] --------------
2026-08-07T13:53:01Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-07T13:53:01Z Disabled control of system clock
I20260807 13:53:01.167958 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.107.190:41317
--webserver_interface=127.23.107.190
--webserver_port=0
--builtin_ntp_servers=127.23.107.148:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.107.190:41317
--tserver_unresponsive_timeout_ms=3000
--enable_range_replica_placement=false
--raft_prepare_replacement_before_eviction=false
--enable_range_replica_placement=false with env {}
W20260807 13:53:01.566610 4483 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:01.566998 4483 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:53:01.567130 4483 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:53:01.575906 4483 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:53:01.576028 4483 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 13:53:01.576136 4483 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:53:01.576208 4483 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 13:53:01.576298 4483 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260807 13:53:01.586879 4483 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal
--enable_range_replica_placement=false
--ipki_ca_key_size=768
--master_addresses=127.23.107.190:41317
--tserver_unresponsive_timeout_ms=3000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.107.190:41317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.23.107.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:53:01.588744 4483 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:53:01.590698 4483 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:53:01.600227 4494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:53:01.600320 4491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:53:01.600133 4490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:53:01.601300 4483 server_base.cc:1061] running on GCE node
I20260807 13:53:01.602140 4483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:53:01.603644 4483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:53:01.604885 4483 hybrid_clock.cc:648] HybridClock initialized: now 1786110781604822 us; error 29 us; skew 500 ppm
I20260807 13:53:01.605268 4483 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:53:01.607738 4483 webserver.cc:533] Webserver started at http://127.23.107.190:40631/ using document root <none> and password file <none>
I20260807 13:53:01.608525 4483 fs_manager.cc:362] Metadata directory not provided
I20260807 13:53:01.608667 4483 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:53:01.609056 4483 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:53:01.611603 4483 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "8cbfb811b4254ad3a53fc5ab7e02474d"
format_stamp: "Formatted at 2026-08-07 13:53:01 on dist-test-slave-bw88"
I20260807 13:53:01.612464 4483 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "8cbfb811b4254ad3a53fc5ab7e02474d"
format_stamp: "Formatted at 2026-08-07 13:53:01 on dist-test-slave-bw88"
I20260807 13:53:01.618027 4483 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.001s sys 0.006s
I20260807 13:53:01.621690 4501 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:01.623116 4483 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 13:53:01.623311 4483 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal
uuid: "8cbfb811b4254ad3a53fc5ab7e02474d"
format_stamp: "Formatted at 2026-08-07 13:53:01 on dist-test-slave-bw88"
I20260807 13:53:01.623548 4483 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:53:01.643088 4483 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:53:01.644011 4483 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:53:01.644351 4483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:53:01.665982 4483 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.190:41317
I20260807 13:53:01.666002 4567 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.190:41317 every 8 connection(s)
I20260807 13:53:01.667728 4483 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260807 13:53:01.669207 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 4483
I20260807 13:53:01.669461 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260807 13:53:01.673691 4568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:01.684505 4568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cbfb811b4254ad3a53fc5ab7e02474d: Bootstrap starting.
I20260807 13:53:01.687901 4568 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8cbfb811b4254ad3a53fc5ab7e02474d: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:01.689177 4568 log.cc:826] T 00000000000000000000000000000000 P 8cbfb811b4254ad3a53fc5ab7e02474d: Log is configured to *not* fsync() on all Append() calls
I20260807 13:53:01.691959 4568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cbfb811b4254ad3a53fc5ab7e02474d: No bootstrap required, opened a new log
I20260807 13:53:01.697570 4568 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8cbfb811b4254ad3a53fc5ab7e02474d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbfb811b4254ad3a53fc5ab7e02474d" member_type: VOTER last_known_addr { host: "127.23.107.190" port: 41317 } }
I20260807 13:53:01.697954 4568 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8cbfb811b4254ad3a53fc5ab7e02474d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:01.698089 4568 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8cbfb811b4254ad3a53fc5ab7e02474d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cbfb811b4254ad3a53fc5ab7e02474d, State: Initialized, Role: FOLLOWER
I20260807 13:53:01.698784 4568 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8cbfb811b4254ad3a53fc5ab7e02474d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbfb811b4254ad3a53fc5ab7e02474d" member_type: VOTER last_known_addr { host: "127.23.107.190" port: 41317 } }
I20260807 13:53:01.698972 4568 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8cbfb811b4254ad3a53fc5ab7e02474d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 13:53:01.699128 4568 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8cbfb811b4254ad3a53fc5ab7e02474d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 13:53:01.699302 4568 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8cbfb811b4254ad3a53fc5ab7e02474d [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:01.701803 4568 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8cbfb811b4254ad3a53fc5ab7e02474d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbfb811b4254ad3a53fc5ab7e02474d" member_type: VOTER last_known_addr { host: "127.23.107.190" port: 41317 } }
I20260807 13:53:01.702335 4568 leader_election.cc:304] T 00000000000000000000000000000000 P 8cbfb811b4254ad3a53fc5ab7e02474d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8cbfb811b4254ad3a53fc5ab7e02474d; no voters:
I20260807 13:53:01.702994 4568 leader_election.cc:290] T 00000000000000000000000000000000 P 8cbfb811b4254ad3a53fc5ab7e02474d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 13:53:01.703202 4577 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8cbfb811b4254ad3a53fc5ab7e02474d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:01.703944 4577 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8cbfb811b4254ad3a53fc5ab7e02474d [term 1 LEADER]: Becoming Leader. State: Replica: 8cbfb811b4254ad3a53fc5ab7e02474d, State: Running, Role: LEADER
I20260807 13:53:01.704511 4577 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8cbfb811b4254ad3a53fc5ab7e02474d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbfb811b4254ad3a53fc5ab7e02474d" member_type: VOTER last_known_addr { host: "127.23.107.190" port: 41317 } }
I20260807 13:53:01.705266 4568 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8cbfb811b4254ad3a53fc5ab7e02474d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 13:53:01.707943 4581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cbfb811b4254ad3a53fc5ab7e02474d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8cbfb811b4254ad3a53fc5ab7e02474d. Latest consensus state: current_term: 1 leader_uuid: "8cbfb811b4254ad3a53fc5ab7e02474d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbfb811b4254ad3a53fc5ab7e02474d" member_type: VOTER last_known_addr { host: "127.23.107.190" port: 41317 } } }
I20260807 13:53:01.708416 4581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cbfb811b4254ad3a53fc5ab7e02474d [sys.catalog]: This master's current role is: LEADER
I20260807 13:53:01.708316 4580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cbfb811b4254ad3a53fc5ab7e02474d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8cbfb811b4254ad3a53fc5ab7e02474d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbfb811b4254ad3a53fc5ab7e02474d" member_type: VOTER last_known_addr { host: "127.23.107.190" port: 41317 } } }
I20260807 13:53:01.708561 4580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cbfb811b4254ad3a53fc5ab7e02474d [sys.catalog]: This master's current role is: LEADER
I20260807 13:53:01.716032 4586 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260807 13:53:01.722863 4586 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260807 13:53:01.731961 4586 catalog_manager.cc:1383] Generated new cluster ID: 6820a625d16f494f95c0d6f319be0640
I20260807 13:53:01.732123 4586 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260807 13:53:01.741513 4586 catalog_manager.cc:1406] Generated new certificate authority record
I20260807 13:53:01.742908 4586 catalog_manager.cc:1540] Loading token signing keys...
I20260807 13:53:01.752096 4586 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8cbfb811b4254ad3a53fc5ab7e02474d: Generated new TSK 0
I20260807 13:53:01.753008 4586 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260807 13:53:01.769255 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.129:0
--local_ip_for_outbound_sockets=127.23.107.129
--webserver_interface=127.23.107.129
--webserver_port=0
--tserver_master_addrs=127.23.107.190:41317
--builtin_ntp_servers=127.23.107.148:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
W20260807 13:53:02.165684 4609 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:02.166080 4609 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:53:02.166220 4609 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:53:02.174923 4609 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:53:02.175064 4609 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:53:02.175256 4609 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.129
I20260807 13:53:02.188517 4609 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.23.107.129
--webserver_port=0
--tserver_master_addrs=127.23.107.190:41317
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.129
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:53:02.190912 4609 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:53:02.193538 4609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:53:02.204335 4615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:53:02.204147 4617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:53:02.204115 4620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:53:02.205394 4609 server_base.cc:1061] running on GCE node
I20260807 13:53:02.206017 4609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:53:02.206987 4609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:53:02.208230 4609 hybrid_clock.cc:648] HybridClock initialized: now 1786110782208158 us; error 61 us; skew 500 ppm
I20260807 13:53:02.208643 4609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:53:02.210988 4609 webserver.cc:533] Webserver started at http://127.23.107.129:39373/ using document root <none> and password file <none>
I20260807 13:53:02.211808 4609 fs_manager.cc:362] Metadata directory not provided
I20260807 13:53:02.211947 4609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:53:02.212325 4609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:53:02.214972 4609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
format_stamp: "Formatted at 2026-08-07 13:53:02 on dist-test-slave-bw88"
I20260807 13:53:02.215775 4609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
format_stamp: "Formatted at 2026-08-07 13:53:02 on dist-test-slave-bw88"
I20260807 13:53:02.221529 4609 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260807 13:53:02.225003 4627 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:02.226409 4609 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 13:53:02.226591 4609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
format_stamp: "Formatted at 2026-08-07 13:53:02 on dist-test-slave-bw88"
I20260807 13:53:02.226816 4609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:53:02.256018 4609 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:53:02.257004 4609 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:53:02.257331 4609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:53:02.258369 4609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:53:02.260512 4609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:53:02.260633 4609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:02.260788 4609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:53:02.260864 4609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:02.299371 4609 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.129:32841
I20260807 13:53:02.299407 4777 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.129:32841 every 8 connection(s)
I20260807 13:53:02.300917 4609 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260807 13:53:02.303572 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 4609
I20260807 13:53:02.303836 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260807 13:53:02.308318 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.130:0
--local_ip_for_outbound_sockets=127.23.107.130
--webserver_interface=127.23.107.130
--webserver_port=0
--tserver_master_addrs=127.23.107.190:41317
--builtin_ntp_servers=127.23.107.148:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260807 13:53:02.317022 4778 heartbeater.cc:344] Connected to a master server at 127.23.107.190:41317
I20260807 13:53:02.317462 4778 heartbeater.cc:461] Registering TS with master...
I20260807 13:53:02.318449 4778 heartbeater.cc:507] Master 127.23.107.190:41317 requested a full tablet report, sending...
I20260807 13:53:02.320948 4520 ts_manager.cc:194] Registered new tserver with Master: fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:53:02.323181 4520 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.129:39933
W20260807 13:53:02.698487 4783 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:02.698876 4783 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:53:02.699016 4783 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:53:02.707854 4783 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:53:02.708009 4783 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:53:02.708204 4783 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.130
I20260807 13:53:02.718716 4783 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.23.107.130
--webserver_port=0
--tserver_master_addrs=127.23.107.190:41317
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.130
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:53:02.720494 4783 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:53:02.722443 4783 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:53:02.732897 4789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:53:02.732897 4791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:53:02.733875 4793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:53:02.734661 4783 server_base.cc:1061] running on GCE node
I20260807 13:53:02.735198 4783 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:53:02.736128 4783 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:53:02.737381 4783 hybrid_clock.cc:648] HybridClock initialized: now 1786110782737280 us; error 38 us; skew 500 ppm
I20260807 13:53:02.737691 4783 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:53:02.739869 4783 webserver.cc:533] Webserver started at http://127.23.107.130:37865/ using document root <none> and password file <none>
I20260807 13:53:02.740648 4783 fs_manager.cc:362] Metadata directory not provided
I20260807 13:53:02.740788 4783 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:53:02.741147 4783 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:53:02.743691 4783 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "c9d2944272bc447dafce7620ac2dbd4b"
format_stamp: "Formatted at 2026-08-07 13:53:02 on dist-test-slave-bw88"
I20260807 13:53:02.744510 4783 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "c9d2944272bc447dafce7620ac2dbd4b"
format_stamp: "Formatted at 2026-08-07 13:53:02 on dist-test-slave-bw88"
I20260807 13:53:02.750063 4783 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 13:53:02.753711 4802 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:02.755303 4783 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260807 13:53:02.755492 4783 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "c9d2944272bc447dafce7620ac2dbd4b"
format_stamp: "Formatted at 2026-08-07 13:53:02 on dist-test-slave-bw88"
I20260807 13:53:02.755707 4783 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:53:02.779075 4783 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:53:02.780216 4783 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:53:02.780558 4783 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:53:02.781704 4783 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:53:02.783581 4783 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:53:02.783663 4783 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:02.783812 4783 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:53:02.783864 4783 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:02.821388 4783 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.130:37489
I20260807 13:53:02.821452 4953 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.130:37489 every 8 connection(s)
I20260807 13:53:02.822888 4783 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260807 13:53:02.829281 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 4783
I20260807 13:53:02.829592 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260807 13:53:02.833284 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.131:0
--local_ip_for_outbound_sockets=127.23.107.131
--webserver_interface=127.23.107.131
--webserver_port=0
--tserver_master_addrs=127.23.107.190:41317
--builtin_ntp_servers=127.23.107.148:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260807 13:53:02.841511 4954 heartbeater.cc:344] Connected to a master server at 127.23.107.190:41317
I20260807 13:53:02.841912 4954 heartbeater.cc:461] Registering TS with master...
I20260807 13:53:02.843078 4954 heartbeater.cc:507] Master 127.23.107.190:41317 requested a full tablet report, sending...
I20260807 13:53:02.844866 4520 ts_manager.cc:194] Registered new tserver with Master: c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:53:02.846038 4520 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.130:38443
W20260807 13:53:03.216785 4959 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:03.217089 4959 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:53:03.217253 4959 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:53:03.225828 4959 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:53:03.225925 4959 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:53:03.226125 4959 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.131
I20260807 13:53:03.236363 4959 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.23.107.131
--webserver_port=0
--tserver_master_addrs=127.23.107.190:41317
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.131
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:53:03.238255 4959 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:53:03.240103 4959 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:53:03.250701 4965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:53:03.251068 4968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:53:03.251459 4966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:53:03.252060 4959 server_base.cc:1061] running on GCE node
I20260807 13:53:03.252676 4959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:53:03.253698 4959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:53:03.254963 4959 hybrid_clock.cc:648] HybridClock initialized: now 1786110783254885 us; error 46 us; skew 500 ppm
I20260807 13:53:03.255298 4959 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:53:03.257833 4959 webserver.cc:533] Webserver started at http://127.23.107.131:34101/ using document root <none> and password file <none>
I20260807 13:53:03.258651 4959 fs_manager.cc:362] Metadata directory not provided
I20260807 13:53:03.258805 4959 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:53:03.259196 4959 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:53:03.261977 4959 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "01adf83af3e04875b5fac9470d4da915"
format_stamp: "Formatted at 2026-08-07 13:53:03 on dist-test-slave-bw88"
I20260807 13:53:03.263289 4959 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "01adf83af3e04875b5fac9470d4da915"
format_stamp: "Formatted at 2026-08-07 13:53:03 on dist-test-slave-bw88"
I20260807 13:53:03.269039 4959 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 13:53:03.272662 4978 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:03.274103 4959 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 13:53:03.274329 4959 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "01adf83af3e04875b5fac9470d4da915"
format_stamp: "Formatted at 2026-08-07 13:53:03 on dist-test-slave-bw88"
I20260807 13:53:03.274529 4959 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:53:03.309885 4959 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:53:03.310884 4959 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:53:03.311194 4959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:53:03.312186 4959 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:53:03.313988 4959 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:53:03.314070 4959 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:03.314235 4959 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:53:03.314286 4959 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:03.326999 4778 heartbeater.cc:499] Master 127.23.107.190:41317 was elected leader, sending a full tablet report...
I20260807 13:53:03.350708 4959 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.131:40441
I20260807 13:53:03.350762 5127 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.131:40441 every 8 connection(s)
I20260807 13:53:03.352223 4959 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260807 13:53:03.353713 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 4959
I20260807 13:53:03.353931 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260807 13:53:03.358399 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.132:0
--local_ip_for_outbound_sockets=127.23.107.132
--webserver_interface=127.23.107.132
--webserver_port=0
--tserver_master_addrs=127.23.107.190:41317
--builtin_ntp_servers=127.23.107.148:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260807 13:53:03.366639 5128 heartbeater.cc:344] Connected to a master server at 127.23.107.190:41317
I20260807 13:53:03.367053 5128 heartbeater.cc:461] Registering TS with master...
I20260807 13:53:03.368044 5128 heartbeater.cc:507] Master 127.23.107.190:41317 requested a full tablet report, sending...
I20260807 13:53:03.369868 4520 ts_manager.cc:194] Registered new tserver with Master: 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:03.370887 4520 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.131:39735
W20260807 13:53:03.742105 5132 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:03.742481 5132 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:53:03.742630 5132 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:53:03.751114 5132 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:53:03.751258 5132 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:53:03.751463 5132 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.132
I20260807 13:53:03.761669 5132 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.23.107.132
--webserver_port=0
--tserver_master_addrs=127.23.107.190:41317
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.132
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:53:03.763439 5132 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:53:03.765462 5132 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:53:03.775369 5139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:53:03.775580 5138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:53:03.776552 5141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:53:03.776943 5132 server_base.cc:1061] running on GCE node
I20260807 13:53:03.777614 5132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:53:03.778494 5132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:53:03.779734 5132 hybrid_clock.cc:648] HybridClock initialized: now 1786110783779629 us; error 48 us; skew 500 ppm
I20260807 13:53:03.780050 5132 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:53:03.782387 5132 webserver.cc:533] Webserver started at http://127.23.107.132:42043/ using document root <none> and password file <none>
I20260807 13:53:03.783146 5132 fs_manager.cc:362] Metadata directory not provided
I20260807 13:53:03.783278 5132 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:53:03.783672 5132 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:53:03.786300 5132 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "edf940ebcc1140cfa0c23214e0c0f179"
format_stamp: "Formatted at 2026-08-07 13:53:03 on dist-test-slave-bw88"
I20260807 13:53:03.787093 5132 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "edf940ebcc1140cfa0c23214e0c0f179"
format_stamp: "Formatted at 2026-08-07 13:53:03 on dist-test-slave-bw88"
I20260807 13:53:03.792484 5132 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 13:53:03.795924 5150 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:03.797281 5132 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 13:53:03.797490 5132 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "edf940ebcc1140cfa0c23214e0c0f179"
format_stamp: "Formatted at 2026-08-07 13:53:03 on dist-test-slave-bw88"
I20260807 13:53:03.797698 5132 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:53:03.847007 5132 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:53:03.847920 5132 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:53:03.848248 5132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:53:03.848830 4954 heartbeater.cc:499] Master 127.23.107.190:41317 was elected leader, sending a full tablet report...
I20260807 13:53:03.849426 5132 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:53:03.851580 5132 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:53:03.851671 5132 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:03.851832 5132 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:53:03.851907 5132 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:03.888613 5132 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.132:41217
I20260807 13:53:03.888648 5304 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.132:41217 every 8 connection(s)
I20260807 13:53:03.890173 5132 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20260807 13:53:03.899437 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 5132
I20260807 13:53:03.899668 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20260807 13:53:03.903775 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.133:0
--local_ip_for_outbound_sockets=127.23.107.133
--webserver_interface=127.23.107.133
--webserver_port=0
--tserver_master_addrs=127.23.107.190:41317
--builtin_ntp_servers=127.23.107.148:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260807 13:53:03.904176 5305 heartbeater.cc:344] Connected to a master server at 127.23.107.190:41317
I20260807 13:53:03.904531 5305 heartbeater.cc:461] Registering TS with master...
I20260807 13:53:03.905275 5305 heartbeater.cc:507] Master 127.23.107.190:41317 requested a full tablet report, sending...
I20260807 13:53:03.907253 4520 ts_manager.cc:194] Registered new tserver with Master: edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:03.908324 4520 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.132:38699
W20260807 13:53:04.302775 5310 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:04.303117 5310 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:53:04.303201 5310 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:53:04.312240 5310 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:53:04.312381 5310 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:53:04.312587 5310 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.133
I20260807 13:53:04.323009 5310 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.133:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.23.107.133
--webserver_port=0
--tserver_master_addrs=127.23.107.190:41317
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.133
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:53:04.324786 5310 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:53:04.326882 5310 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:53:04.337581 5315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:53:04.337666 5320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:53:04.337625 5316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:53:04.338850 5310 server_base.cc:1061] running on GCE node
I20260807 13:53:04.339435 5310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:53:04.340392 5310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:53:04.341652 5310 hybrid_clock.cc:648] HybridClock initialized: now 1786110784341583 us; error 41 us; skew 500 ppm
I20260807 13:53:04.342008 5310 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:53:04.344355 5310 webserver.cc:533] Webserver started at http://127.23.107.133:34063/ using document root <none> and password file <none>
I20260807 13:53:04.345180 5310 fs_manager.cc:362] Metadata directory not provided
I20260807 13:53:04.345376 5310 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:53:04.345793 5310 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:53:04.348443 5310 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/instance:
uuid: "b77f2b2eade540c6bfd4f75e5229a3cd"
format_stamp: "Formatted at 2026-08-07 13:53:04 on dist-test-slave-bw88"
I20260807 13:53:04.349275 5310 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal/instance:
uuid: "b77f2b2eade540c6bfd4f75e5229a3cd"
format_stamp: "Formatted at 2026-08-07 13:53:04 on dist-test-slave-bw88"
I20260807 13:53:04.355633 5310 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 13:53:04.359449 5329 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:04.360910 5310 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 13:53:04.361119 5310 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "b77f2b2eade540c6bfd4f75e5229a3cd"
format_stamp: "Formatted at 2026-08-07 13:53:04 on dist-test-slave-bw88"
I20260807 13:53:04.361377 5310 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:53:04.374645 5128 heartbeater.cc:499] Master 127.23.107.190:41317 was elected leader, sending a full tablet report...
I20260807 13:53:04.384148 5310 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:53:04.385015 5310 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:53:04.385293 5310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:53:04.386320 5310 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:53:04.388042 5310 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:53:04.388134 5310 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:04.388230 5310 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:53:04.388275 5310 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:04.424053 5310 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.133:38075
I20260807 13:53:04.424109 5466 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.133:38075 every 8 connection(s)
I20260807 13:53:04.425631 5310 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20260807 13:53:04.433370 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 5310
I20260807 13:53:04.433602 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal/instance
I20260807 13:53:04.437306 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.134:0
--local_ip_for_outbound_sockets=127.23.107.134
--webserver_interface=127.23.107.134
--webserver_port=0
--tserver_master_addrs=127.23.107.190:41317
--builtin_ntp_servers=127.23.107.148:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260807 13:53:04.439751 5467 heartbeater.cc:344] Connected to a master server at 127.23.107.190:41317
I20260807 13:53:04.440137 5467 heartbeater.cc:461] Registering TS with master...
I20260807 13:53:04.440896 5467 heartbeater.cc:507] Master 127.23.107.190:41317 requested a full tablet report, sending...
I20260807 13:53:04.442580 4520 ts_manager.cc:194] Registered new tserver with Master: b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075)
I20260807 13:53:04.443728 4520 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.133:48663
W20260807 13:53:04.812952 5473 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:04.813422 5473 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:53:04.813539 5473 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:53:04.823074 5473 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:53:04.823192 5473 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:53:04.823376 5473 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.134
I20260807 13:53:04.833973 5473 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.134:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--webserver_interface=127.23.107.134
--webserver_port=0
--tserver_master_addrs=127.23.107.190:41317
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.134
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:53:04.835582 5473 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:53:04.837414 5473 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:53:04.847064 5480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:53:04.847064 5479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:53:04.847864 5483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:53:04.848330 5473 server_base.cc:1061] running on GCE node
I20260807 13:53:04.848928 5473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:53:04.849905 5473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:53:04.851158 5473 hybrid_clock.cc:648] HybridClock initialized: now 1786110784851094 us; error 35 us; skew 500 ppm
I20260807 13:53:04.851444 5473 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:53:04.854115 5473 webserver.cc:533] Webserver started at http://127.23.107.134:41459/ using document root <none> and password file <none>
I20260807 13:53:04.854879 5473 fs_manager.cc:362] Metadata directory not provided
I20260807 13:53:04.855031 5473 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:53:04.855412 5473 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:53:04.857939 5473 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/instance:
uuid: "12ab71778f2f4b378765aaed1a0676a5"
format_stamp: "Formatted at 2026-08-07 13:53:04 on dist-test-slave-bw88"
I20260807 13:53:04.858742 5473 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal/instance:
uuid: "12ab71778f2f4b378765aaed1a0676a5"
format_stamp: "Formatted at 2026-08-07 13:53:04 on dist-test-slave-bw88"
I20260807 13:53:04.864248 5473 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 13:53:04.867823 5491 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:04.869118 5473 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260807 13:53:04.869302 5473 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal
uuid: "12ab71778f2f4b378765aaed1a0676a5"
format_stamp: "Formatted at 2026-08-07 13:53:04 on dist-test-slave-bw88"
I20260807 13:53:04.869558 5473 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:53:04.898242 5473 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:53:04.899147 5473 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:53:04.899456 5473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:53:04.900450 5473 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:53:04.902240 5473 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:53:04.902347 5473 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:04.902490 5473 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:53:04.902653 5473 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260807 13:53:04.911039 5305 heartbeater.cc:499] Master 127.23.107.190:41317 was elected leader, sending a full tablet report...
I20260807 13:53:04.939718 5473 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.134:35975
I20260807 13:53:04.939898 5640 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.134:35975 every 8 connection(s)
I20260807 13:53:04.941293 5473 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/info.pb
I20260807 13:53:04.946738 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 5473
I20260807 13:53:04.946952 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal/instance
I20260807 13:53:04.950536 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.135:0
--local_ip_for_outbound_sockets=127.23.107.135
--webserver_interface=127.23.107.135
--webserver_port=0
--tserver_master_addrs=127.23.107.190:41317
--builtin_ntp_servers=127.23.107.148:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260807 13:53:04.955946 5641 heartbeater.cc:344] Connected to a master server at 127.23.107.190:41317
I20260807 13:53:04.956377 5641 heartbeater.cc:461] Registering TS with master...
I20260807 13:53:04.957285 5641 heartbeater.cc:507] Master 127.23.107.190:41317 requested a full tablet report, sending...
I20260807 13:53:04.959100 4520 ts_manager.cc:194] Registered new tserver with Master: 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975)
I20260807 13:53:04.960318 4520 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.134:56721
W20260807 13:53:05.343281 5647 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:05.343582 5647 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:53:05.343657 5647 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:53:05.351984 5647 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:53:05.352074 5647 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:53:05.352249 5647 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.135
I20260807 13:53:05.362316 5647 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.135:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--webserver_interface=127.23.107.135
--webserver_port=0
--tserver_master_addrs=127.23.107.190:41317
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.135
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:53:05.363957 5647 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:53:05.365943 5647 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:53:05.376510 5652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:53:05.376783 5653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:53:05.377321 5656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:53:05.378283 5647 server_base.cc:1061] running on GCE node
I20260807 13:53:05.378998 5647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:53:05.379940 5647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:53:05.381191 5647 hybrid_clock.cc:648] HybridClock initialized: now 1786110785381099 us; error 43 us; skew 500 ppm
I20260807 13:53:05.381616 5647 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:53:05.384603 5647 webserver.cc:533] Webserver started at http://127.23.107.135:43629/ using document root <none> and password file <none>
I20260807 13:53:05.385330 5647 fs_manager.cc:362] Metadata directory not provided
I20260807 13:53:05.385514 5647 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:53:05.385823 5647 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:53:05.388216 5647 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data/instance:
uuid: "8a9903f009ff46b4a6875490823076c4"
format_stamp: "Formatted at 2026-08-07 13:53:05 on dist-test-slave-bw88"
I20260807 13:53:05.388954 5647 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal/instance:
uuid: "8a9903f009ff46b4a6875490823076c4"
format_stamp: "Formatted at 2026-08-07 13:53:05 on dist-test-slave-bw88"
I20260807 13:53:05.394618 5647 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260807 13:53:05.397959 5663 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:05.399350 5647 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 13:53:05.399557 5647 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal
uuid: "8a9903f009ff46b4a6875490823076c4"
format_stamp: "Formatted at 2026-08-07 13:53:05 on dist-test-slave-bw88"
I20260807 13:53:05.399755 5647 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:53:05.414254 5647 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:53:05.415160 5647 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:53:05.415462 5647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:53:05.416433 5647 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:53:05.418386 5647 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:53:05.418497 5647 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:05.418637 5647 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:53:05.418710 5647 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:05.446570 5467 heartbeater.cc:499] Master 127.23.107.190:41317 was elected leader, sending a full tablet report...
I20260807 13:53:05.456694 5647 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.135:40385
I20260807 13:53:05.456745 5816 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.135:40385 every 8 connection(s)
I20260807 13:53:05.458240 5647 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data/info.pb
I20260807 13:53:05.462566 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 5647
I20260807 13:53:05.462805 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal/instance
I20260807 13:53:05.466765 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.136:0
--local_ip_for_outbound_sockets=127.23.107.136
--webserver_interface=127.23.107.136
--webserver_port=0
--tserver_master_addrs=127.23.107.190:41317
--builtin_ntp_servers=127.23.107.148:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260807 13:53:05.473384 5817 heartbeater.cc:344] Connected to a master server at 127.23.107.190:41317
I20260807 13:53:05.473887 5817 heartbeater.cc:461] Registering TS with master...
I20260807 13:53:05.474995 5817 heartbeater.cc:507] Master 127.23.107.190:41317 requested a full tablet report, sending...
I20260807 13:53:05.476886 4520 ts_manager.cc:194] Registered new tserver with Master: 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385)
I20260807 13:53:05.477779 4520 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.135:38225
W20260807 13:53:05.856693 5822 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:05.857010 5822 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:53:05.857158 5822 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:53:05.865733 5822 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:53:05.865834 5822 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:53:05.866026 5822 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.136
I20260807 13:53:05.876149 5822 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.136:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--webserver_interface=127.23.107.136
--webserver_port=0
--tserver_master_addrs=127.23.107.190:41317
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.136
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:53:05.877914 5822 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:53:05.880283 5822 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:53:05.892000 5829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:53:05.892071 5830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:53:05.893114 5832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:53:05.894362 5822 server_base.cc:1061] running on GCE node
I20260807 13:53:05.895042 5822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:53:05.896109 5822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:53:05.897439 5822 hybrid_clock.cc:648] HybridClock initialized: now 1786110785897307 us; error 53 us; skew 500 ppm
I20260807 13:53:05.897851 5822 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:53:05.900208 5822 webserver.cc:533] Webserver started at http://127.23.107.136:36743/ using document root <none> and password file <none>
I20260807 13:53:05.900990 5822 fs_manager.cc:362] Metadata directory not provided
I20260807 13:53:05.901110 5822 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:53:05.901548 5822 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:53:05.904222 5822 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/data/instance:
uuid: "31d7630573c8475a9f84978d4ebfb879"
format_stamp: "Formatted at 2026-08-07 13:53:05 on dist-test-slave-bw88"
I20260807 13:53:05.905040 5822 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/wal/instance:
uuid: "31d7630573c8475a9f84978d4ebfb879"
format_stamp: "Formatted at 2026-08-07 13:53:05 on dist-test-slave-bw88"
I20260807 13:53:05.911132 5822 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260807 13:53:05.915069 5842 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:05.916755 5822 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260807 13:53:05.916962 5822 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/wal
uuid: "31d7630573c8475a9f84978d4ebfb879"
format_stamp: "Formatted at 2026-08-07 13:53:05 on dist-test-slave-bw88"
I20260807 13:53:05.917173 5822 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:53:05.945722 5822 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:53:05.946873 5822 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:53:05.947160 5822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:53:05.948144 5822 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:53:05.949980 5822 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:53:05.950066 5822 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:05.950158 5822 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:53:05.950220 5822 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:05.963969 5641 heartbeater.cc:499] Master 127.23.107.190:41317 was elected leader, sending a full tablet report...
I20260807 13:53:05.988399 5822 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.136:43729
I20260807 13:53:05.988444 5991 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.136:43729 every 8 connection(s)
I20260807 13:53:05.990088 5822 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/data/info.pb
I20260807 13:53:05.998291 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 5822
I20260807 13:53:05.998538 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/wal/instance
I20260807 13:53:06.004802 5992 heartbeater.cc:344] Connected to a master server at 127.23.107.190:41317
I20260807 13:53:06.005224 5992 heartbeater.cc:461] Registering TS with master...
I20260807 13:53:06.006100 5992 heartbeater.cc:507] Master 127.23.107.190:41317 requested a full tablet report, sending...
I20260807 13:53:06.007699 4520 ts_manager.cc:194] Registered new tserver with Master: 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729)
I20260807 13:53:06.008472 4520 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.136:39753
I20260807 13:53:06.015692 23982 external_mini_cluster.cc:955] 8 TS(s) registered with all masters
I20260807 13:53:06.033187 23982 external_mini_cluster.cc:955] 8 TS(s) registered with all masters
I20260807 13:53:06.033377 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 5310
I20260807 13:53:06.042073 5461 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:53:06.128083 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 5310
I20260807 13:53:06.154830 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 5473
I20260807 13:53:06.163998 5634 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:53:06.249919 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 5473
I20260807 13:53:06.274909 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 5647
I20260807 13:53:06.284459 5809 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:53:06.371402 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 5647
I20260807 13:53:06.397995 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 5822
I20260807 13:53:06.407023 5987 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:53:06.492027 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 5822
I20260807 13:53:10.268337 4520 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39098:
name: "rebalance_test_table_0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:53:10.322928 4865 tablet_service.cc:1511] Processing CreateTablet for tablet 16afb6ff06704a8795f1de84ffa81de0 (DEFAULT_TABLE table=rebalance_test_table_0 [id=14867b014aab43119171102f60bb134d]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:10.324021 4866 tablet_service.cc:1511] Processing CreateTablet for tablet d06f352d0ff34b45b753a2c20f65574f (DEFAULT_TABLE table=rebalance_test_table_0 [id=14867b014aab43119171102f60bb134d]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:10.325573 4866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06f352d0ff34b45b753a2c20f65574f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:10.329752 4865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16afb6ff06704a8795f1de84ffa81de0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:10.333197 5216 tablet_service.cc:1511] Processing CreateTablet for tablet e22d4edb78d24783bae07928b6c95fc2 (DEFAULT_TABLE table=rebalance_test_table_0 [id=14867b014aab43119171102f60bb134d]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:10.335223 5216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e22d4edb78d24783bae07928b6c95fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:10.339242 5220 tablet_service.cc:1511] Processing CreateTablet for tablet d06f352d0ff34b45b753a2c20f65574f (DEFAULT_TABLE table=rebalance_test_table_0 [id=14867b014aab43119171102f60bb134d]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:10.339407 4686 tablet_service.cc:1511] Processing CreateTablet for tablet e22d4edb78d24783bae07928b6c95fc2 (DEFAULT_TABLE table=rebalance_test_table_0 [id=14867b014aab43119171102f60bb134d]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:10.339869 5220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06f352d0ff34b45b753a2c20f65574f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:10.340070 5039 tablet_service.cc:1511] Processing CreateTablet for tablet 16afb6ff06704a8795f1de84ffa81de0 (DEFAULT_TABLE table=rebalance_test_table_0 [id=14867b014aab43119171102f60bb134d]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:10.340574 4686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e22d4edb78d24783bae07928b6c95fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:10.338871 4687 tablet_service.cc:1511] Processing CreateTablet for tablet 16afb6ff06704a8795f1de84ffa81de0 (DEFAULT_TABLE table=rebalance_test_table_0 [id=14867b014aab43119171102f60bb134d]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:10.341885 4687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16afb6ff06704a8795f1de84ffa81de0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:10.348117 5039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16afb6ff06704a8795f1de84ffa81de0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:10.357519 4688 tablet_service.cc:1511] Processing CreateTablet for tablet d06f352d0ff34b45b753a2c20f65574f (DEFAULT_TABLE table=rebalance_test_table_0 [id=14867b014aab43119171102f60bb134d]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:10.358235 4688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06f352d0ff34b45b753a2c20f65574f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:10.336817 5038 tablet_service.cc:1511] Processing CreateTablet for tablet e22d4edb78d24783bae07928b6c95fc2 (DEFAULT_TABLE table=rebalance_test_table_0 [id=14867b014aab43119171102f60bb134d]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:10.361061 5038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e22d4edb78d24783bae07928b6c95fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:10.380908 6029 tablet_bootstrap.cc:492] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:53:10.392212 6028 tablet_bootstrap.cc:492] T d06f352d0ff34b45b753a2c20f65574f P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:53:10.392376 6030 tablet_bootstrap.cc:492] T e22d4edb78d24783bae07928b6c95fc2 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:53:10.392901 6032 tablet_bootstrap.cc:492] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:53:10.395802 6028 tablet_bootstrap.cc:654] T d06f352d0ff34b45b753a2c20f65574f P c9d2944272bc447dafce7620ac2dbd4b: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:10.397117 6032 tablet_bootstrap.cc:654] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:10.397117 6030 tablet_bootstrap.cc:654] T e22d4edb78d24783bae07928b6c95fc2 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:10.397390 6028 log.cc:826] T d06f352d0ff34b45b753a2c20f65574f P c9d2944272bc447dafce7620ac2dbd4b: Log is configured to *not* fsync() on all Append() calls
I20260807 13:53:10.397622 6029 tablet_bootstrap.cc:654] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:10.398679 6030 log.cc:826] T e22d4edb78d24783bae07928b6c95fc2 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Log is configured to *not* fsync() on all Append() calls
I20260807 13:53:10.398679 6032 log.cc:826] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915: Log is configured to *not* fsync() on all Append() calls
I20260807 13:53:10.399288 6029 log.cc:826] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179: Log is configured to *not* fsync() on all Append() calls
I20260807 13:53:10.408422 6032 tablet_bootstrap.cc:492] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915: No bootstrap required, opened a new log
I20260807 13:53:10.408887 6032 ts_tablet_manager.cc:1403] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.004s
I20260807 13:53:10.410391 6030 tablet_bootstrap.cc:492] T e22d4edb78d24783bae07928b6c95fc2 P fa83b7af134b4e3b949ac3b4e4bcb5e7: No bootstrap required, opened a new log
I20260807 13:53:10.410846 6030 ts_tablet_manager.cc:1403] T e22d4edb78d24783bae07928b6c95fc2 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.022s user 0.009s sys 0.007s
I20260807 13:53:10.418646 6032 raft_consensus.cc:359] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:10.419234 6032 raft_consensus.cc:385] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:10.419395 6032 raft_consensus.cc:740] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:53:10.420282 6032 consensus_queue.cc:260] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:10.420214 6030 raft_consensus.cc:359] T e22d4edb78d24783bae07928b6c95fc2 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:10.420990 6028 tablet_bootstrap.cc:492] T d06f352d0ff34b45b753a2c20f65574f P c9d2944272bc447dafce7620ac2dbd4b: No bootstrap required, opened a new log
I20260807 13:53:10.421025 6030 raft_consensus.cc:385] T e22d4edb78d24783bae07928b6c95fc2 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:10.421118 6029 tablet_bootstrap.cc:492] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179: No bootstrap required, opened a new log
I20260807 13:53:10.421305 6030 raft_consensus.cc:740] T e22d4edb78d24783bae07928b6c95fc2 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:53:10.421442 6028 ts_tablet_manager.cc:1403] T d06f352d0ff34b45b753a2c20f65574f P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.030s user 0.007s sys 0.017s
I20260807 13:53:10.421620 6029 ts_tablet_manager.cc:1403] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.041s user 0.014s sys 0.016s
I20260807 13:53:10.422403 6030 consensus_queue.cc:260] T e22d4edb78d24783bae07928b6c95fc2 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:10.429812 6030 ts_tablet_manager.cc:1434] T e22d4edb78d24783bae07928b6c95fc2 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.019s user 0.008s sys 0.006s
I20260807 13:53:10.431006 6028 raft_consensus.cc:359] T d06f352d0ff34b45b753a2c20f65574f P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:10.431500 6028 raft_consensus.cc:385] T d06f352d0ff34b45b753a2c20f65574f P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:10.431620 6028 raft_consensus.cc:740] T d06f352d0ff34b45b753a2c20f65574f P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:53:10.432597 6028 consensus_queue.cc:260] T d06f352d0ff34b45b753a2c20f65574f P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:10.432840 6029 raft_consensus.cc:359] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:10.433378 6029 raft_consensus.cc:385] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:10.433503 6029 raft_consensus.cc:740] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:53:10.434384 6029 consensus_queue.cc:260] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:10.441612 6030 tablet_bootstrap.cc:492] T 16afb6ff06704a8795f1de84ffa81de0 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:53:10.444587 6030 tablet_bootstrap.cc:654] T 16afb6ff06704a8795f1de84ffa81de0 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:10.446945 6032 ts_tablet_manager.cc:1434] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.038s user 0.022s sys 0.013s
I20260807 13:53:10.447543 6032 tablet_bootstrap.cc:492] T e22d4edb78d24783bae07928b6c95fc2 P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:53:10.450013 6032 tablet_bootstrap.cc:654] T e22d4edb78d24783bae07928b6c95fc2 P 01adf83af3e04875b5fac9470d4da915: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:10.459569 6030 tablet_bootstrap.cc:492] T 16afb6ff06704a8795f1de84ffa81de0 P fa83b7af134b4e3b949ac3b4e4bcb5e7: No bootstrap required, opened a new log
I20260807 13:53:10.459887 6030 ts_tablet_manager.cc:1403] T 16afb6ff06704a8795f1de84ffa81de0 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.000s
I20260807 13:53:10.461661 6030 raft_consensus.cc:359] T 16afb6ff06704a8795f1de84ffa81de0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:10.462054 6030 raft_consensus.cc:385] T 16afb6ff06704a8795f1de84ffa81de0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:10.462225 6030 raft_consensus.cc:740] T 16afb6ff06704a8795f1de84ffa81de0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:53:10.462738 6030 consensus_queue.cc:260] T 16afb6ff06704a8795f1de84ffa81de0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:10.467072 6030 ts_tablet_manager.cc:1434] T 16afb6ff06704a8795f1de84ffa81de0 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260807 13:53:10.471778 6030 tablet_bootstrap.cc:492] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:53:10.474758 6030 tablet_bootstrap.cc:654] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:10.482321 6043 raft_consensus.cc:493] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:10.482812 6043 raft_consensus.cc:515] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:10.486080 6029 ts_tablet_manager.cc:1434] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.064s user 0.030s sys 0.032s
I20260807 13:53:10.487388 6029 tablet_bootstrap.cc:492] T d06f352d0ff34b45b753a2c20f65574f P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:53:10.487566 6028 ts_tablet_manager.cc:1434] T d06f352d0ff34b45b753a2c20f65574f P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.066s user 0.027s sys 0.021s
I20260807 13:53:10.488013 6028 tablet_bootstrap.cc:492] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:53:10.489744 6029 tablet_bootstrap.cc:654] T d06f352d0ff34b45b753a2c20f65574f P edf940ebcc1140cfa0c23214e0c0f179: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:10.489959 6028 tablet_bootstrap.cc:654] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:10.498842 6030 tablet_bootstrap.cc:492] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7: No bootstrap required, opened a new log
I20260807 13:53:10.498865 6032 tablet_bootstrap.cc:492] T e22d4edb78d24783bae07928b6c95fc2 P 01adf83af3e04875b5fac9470d4da915: No bootstrap required, opened a new log
I20260807 13:53:10.499070 6032 ts_tablet_manager.cc:1403] T e22d4edb78d24783bae07928b6c95fc2 P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.052s user 0.020s sys 0.019s
I20260807 13:53:10.499228 6030 ts_tablet_manager.cc:1403] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.006s
I20260807 13:53:10.500226 6030 raft_consensus.cc:359] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:10.500298 6032 raft_consensus.cc:359] T e22d4edb78d24783bae07928b6c95fc2 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:10.500487 6032 raft_consensus.cc:385] T e22d4edb78d24783bae07928b6c95fc2 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:10.500608 6032 raft_consensus.cc:740] T e22d4edb78d24783bae07928b6c95fc2 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:53:10.500640 6030 raft_consensus.cc:385] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:10.500840 6030 raft_consensus.cc:740] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:53:10.500937 6032 consensus_queue.cc:260] T e22d4edb78d24783bae07928b6c95fc2 P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:10.501760 6032 ts_tablet_manager.cc:1434] T e22d4edb78d24783bae07928b6c95fc2 P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260807 13:53:10.503924 6043 leader_election.cc:290] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:53:10.507671 6030 consensus_queue.cc:260] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:10.508363 6030 ts_tablet_manager.cc:1434] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260807 13:53:10.509466 6028 tablet_bootstrap.cc:492] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b: No bootstrap required, opened a new log
I20260807 13:53:10.509644 6028 ts_tablet_manager.cc:1403] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.015s
I20260807 13:53:10.509964 6029 tablet_bootstrap.cc:492] T d06f352d0ff34b45b753a2c20f65574f P edf940ebcc1140cfa0c23214e0c0f179: No bootstrap required, opened a new log
I20260807 13:53:10.510114 6029 ts_tablet_manager.cc:1403] T d06f352d0ff34b45b753a2c20f65574f P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.012s
I20260807 13:53:10.510778 6028 raft_consensus.cc:359] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:10.510985 6028 raft_consensus.cc:385] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:10.511090 6028 raft_consensus.cc:740] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:53:10.511341 6028 consensus_queue.cc:260] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:10.511421 6029 raft_consensus.cc:359] T d06f352d0ff34b45b753a2c20f65574f P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:10.511679 6029 raft_consensus.cc:385] T d06f352d0ff34b45b753a2c20f65574f P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:10.511787 6029 raft_consensus.cc:740] T d06f352d0ff34b45b753a2c20f65574f P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:53:10.511973 6028 ts_tablet_manager.cc:1434] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 13:53:10.512105 6029 consensus_queue.cc:260] T d06f352d0ff34b45b753a2c20f65574f P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:10.514819 6029 ts_tablet_manager.cc:1434] T d06f352d0ff34b45b753a2c20f65574f P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 13:53:10.518146 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d4edb78d24783bae07928b6c95fc2" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915" is_pre_election: true
I20260807 13:53:10.518507 4718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d4edb78d24783bae07928b6c95fc2" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" is_pre_election: true
I20260807 13:53:10.518810 5074 raft_consensus.cc:2468] T e22d4edb78d24783bae07928b6c95fc2 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 0.
I20260807 13:53:10.519052 4718 raft_consensus.cc:2468] T e22d4edb78d24783bae07928b6c95fc2 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 0.
I20260807 13:53:10.519695 5152 leader_election.cc:304] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, edf940ebcc1140cfa0c23214e0c0f179; no voters:
I20260807 13:53:10.520144 6043 raft_consensus.cc:2804] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:10.520326 6043 raft_consensus.cc:493] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:10.520442 6043 raft_consensus.cc:3060] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:10.520838 6039 raft_consensus.cc:493] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:10.521052 6039 raft_consensus.cc:515] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:10.522871 6043 raft_consensus.cc:515] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:10.523056 6039 leader_election.cc:290] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:53:10.524433 4718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d4edb78d24783bae07928b6c95fc2" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
I20260807 13:53:10.524688 4718 raft_consensus.cc:3060] T e22d4edb78d24783bae07928b6c95fc2 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:10.525627 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d4edb78d24783bae07928b6c95fc2" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915"
I20260807 13:53:10.525913 5074 raft_consensus.cc:3060] T e22d4edb78d24783bae07928b6c95fc2 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:10.529141 4718 raft_consensus.cc:2468] T e22d4edb78d24783bae07928b6c95fc2 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 1.
I20260807 13:53:10.529680 6043 leader_election.cc:290] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 election: Requested vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:53:10.530478 5154 leader_election.cc:304] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edf940ebcc1140cfa0c23214e0c0f179, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:10.530913 6043 raft_consensus.cc:2804] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:10.531112 6043 raft_consensus.cc:697] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Becoming Leader. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Running, Role: LEADER
I20260807 13:53:10.531695 5074 raft_consensus.cc:2468] T e22d4edb78d24783bae07928b6c95fc2 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 1.
I20260807 13:53:10.532228 6043 consensus_queue.cc:237] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:10.538316 4519 catalog_manager.cc:5697] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: term changed from 0 to 1, leader changed from <none> to edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132). New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:53:10.542598 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16afb6ff06704a8795f1de84ffa81de0" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b" is_pre_election: true
I20260807 13:53:10.542954 4718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16afb6ff06704a8795f1de84ffa81de0" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" is_pre_election: true
I20260807 13:53:10.543144 4897 raft_consensus.cc:2468] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 0.
I20260807 13:53:10.543262 4718 raft_consensus.cc:2468] T 16afb6ff06704a8795f1de84ffa81de0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 0.
I20260807 13:53:10.543875 4982 leader_election.cc:304] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:10.544328 6039 raft_consensus.cc:2804] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:10.544504 6039 raft_consensus.cc:493] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:10.544626 6039 raft_consensus.cc:3060] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:10.547151 6039 raft_consensus.cc:515] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:10.547922 6039 leader_election.cc:290] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 election: Requested vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:53:10.548404 4718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16afb6ff06704a8795f1de84ffa81de0" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
I20260807 13:53:10.548553 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16afb6ff06704a8795f1de84ffa81de0" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
I20260807 13:53:10.548688 4718 raft_consensus.cc:3060] T 16afb6ff06704a8795f1de84ffa81de0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:10.548832 4897 raft_consensus.cc:3060] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:10.551052 4718 raft_consensus.cc:2468] T 16afb6ff06704a8795f1de84ffa81de0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 1.
I20260807 13:53:10.551319 4897 raft_consensus.cc:2468] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 1.
I20260807 13:53:10.551664 4982 leader_election.cc:304] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:10.552109 6039 raft_consensus.cc:2804] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:10.552646 6039 raft_consensus.cc:697] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Becoming Leader. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Running, Role: LEADER
I20260807 13:53:10.553177 6039 consensus_queue.cc:237] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:10.558422 4519 catalog_manager.cc:5697] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01adf83af3e04875b5fac9470d4da915 (127.23.107.131). New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
W20260807 13:53:10.559551 4779 tablet.cc:2406] T 16afb6ff06704a8795f1de84ffa81de0 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 13:53:10.581736 4955 tablet.cc:2406] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 13:53:10.583019 6040 raft_consensus.cc:493] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:10.583276 6040 raft_consensus.cc:515] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:10.585130 6040 leader_election.cc:290] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:10.592753 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06f352d0ff34b45b753a2c20f65574f" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b" is_pre_election: true
I20260807 13:53:10.593039 4897 raft_consensus.cc:2468] T d06f352d0ff34b45b753a2c20f65574f P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 0.
I20260807 13:53:10.593118 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06f352d0ff34b45b753a2c20f65574f" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179" is_pre_election: true
I20260807 13:53:10.593590 5248 raft_consensus.cc:2468] T d06f352d0ff34b45b753a2c20f65574f P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 0.
I20260807 13:53:10.593650 4631 leader_election.cc:304] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:10.594125 6040 raft_consensus.cc:2804] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:10.594287 6040 raft_consensus.cc:493] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:10.594416 6040 raft_consensus.cc:3060] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:10.596627 6040 raft_consensus.cc:515] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:10.597319 6040 leader_election.cc:290] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 election: Requested vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:10.597958 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06f352d0ff34b45b753a2c20f65574f" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179"
I20260807 13:53:10.597954 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06f352d0ff34b45b753a2c20f65574f" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
I20260807 13:53:10.598218 5248 raft_consensus.cc:3060] T d06f352d0ff34b45b753a2c20f65574f P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:10.598263 4897 raft_consensus.cc:3060] T d06f352d0ff34b45b753a2c20f65574f P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:10.600551 4897 raft_consensus.cc:2468] T d06f352d0ff34b45b753a2c20f65574f P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 1.
I20260807 13:53:10.600782 5248 raft_consensus.cc:2468] T d06f352d0ff34b45b753a2c20f65574f P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 1.
I20260807 13:53:10.601094 4631 leader_election.cc:304] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:10.601539 6040 raft_consensus.cc:2804] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:10.602062 6040 raft_consensus.cc:697] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Becoming Leader. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Running, Role: LEADER
I20260807 13:53:10.602726 6040 consensus_queue.cc:237] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:10.607553 4519 catalog_manager.cc:5697] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129). New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
W20260807 13:53:10.610843 5129 tablet.cc:2406] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 13:53:10.647511 5306 tablet.cc:2406] T d06f352d0ff34b45b753a2c20f65574f P edf940ebcc1140cfa0c23214e0c0f179: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 13:53:10.920529 6043 consensus_queue.cc:1048] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:10.928653 6043 consensus_queue.cc:1048] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:10.992848 6040 consensus_queue.cc:1048] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:10.996868 6039 consensus_queue.cc:1048] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:11.001612 6065 consensus_queue.cc:1048] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:11.007184 6060 consensus_queue.cc:1048] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:53:11.045307 6068 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:11.045794 6068 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_0'
INSERT report
rows total: 2000
time total: 331.187 ms
time per row: 0.165593 ms
I20260807 13:53:11.603658 4519 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39098:
name: "rebalance_test_table_1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:53:11.614161 5039 tablet_service.cc:1511] Processing CreateTablet for tablet bdac11c33b2b486eb34bc93def74489c (DEFAULT_TABLE table=rebalance_test_table_1 [id=7f1d26639edd4cb398339b2b0d3659a3]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:11.614732 5039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdac11c33b2b486eb34bc93def74489c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:11.614707 4866 tablet_service.cc:1511] Processing CreateTablet for tablet bdac11c33b2b486eb34bc93def74489c (DEFAULT_TABLE table=rebalance_test_table_1 [id=7f1d26639edd4cb398339b2b0d3659a3]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:11.615198 4866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdac11c33b2b486eb34bc93def74489c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:11.616137 5216 tablet_service.cc:1511] Processing CreateTablet for tablet bdac11c33b2b486eb34bc93def74489c (DEFAULT_TABLE table=rebalance_test_table_1 [id=7f1d26639edd4cb398339b2b0d3659a3]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:11.616580 5216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdac11c33b2b486eb34bc93def74489c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:11.616570 4865 tablet_service.cc:1511] Processing CreateTablet for tablet 80898a5a2cf046f1b7344dfceb175bbd (DEFAULT_TABLE table=rebalance_test_table_1 [id=7f1d26639edd4cb398339b2b0d3659a3]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:11.616971 4865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80898a5a2cf046f1b7344dfceb175bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:11.617841 4687 tablet_service.cc:1511] Processing CreateTablet for tablet 68717842b14e4f06b528c08a65acd3b7 (DEFAULT_TABLE table=rebalance_test_table_1 [id=7f1d26639edd4cb398339b2b0d3659a3]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:11.618302 4687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68717842b14e4f06b528c08a65acd3b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:11.618587 5038 tablet_service.cc:1511] Processing CreateTablet for tablet 80898a5a2cf046f1b7344dfceb175bbd (DEFAULT_TABLE table=rebalance_test_table_1 [id=7f1d26639edd4cb398339b2b0d3659a3]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:11.618975 5038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80898a5a2cf046f1b7344dfceb175bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:11.620889 5220 tablet_service.cc:1511] Processing CreateTablet for tablet 80898a5a2cf046f1b7344dfceb175bbd (DEFAULT_TABLE table=rebalance_test_table_1 [id=7f1d26639edd4cb398339b2b0d3659a3]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:11.621307 5220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80898a5a2cf046f1b7344dfceb175bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:11.625983 5037 tablet_service.cc:1511] Processing CreateTablet for tablet 68717842b14e4f06b528c08a65acd3b7 (DEFAULT_TABLE table=rebalance_test_table_1 [id=7f1d26639edd4cb398339b2b0d3659a3]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:11.626572 5037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68717842b14e4f06b528c08a65acd3b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:11.627076 4863 tablet_service.cc:1511] Processing CreateTablet for tablet 68717842b14e4f06b528c08a65acd3b7 (DEFAULT_TABLE table=rebalance_test_table_1 [id=7f1d26639edd4cb398339b2b0d3659a3]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:11.627537 4863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68717842b14e4f06b528c08a65acd3b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:11.636765 6150 tablet_bootstrap.cc:492] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:53:11.637841 6149 tablet_bootstrap.cc:492] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:53:11.638628 6151 tablet_bootstrap.cc:492] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:53:11.638876 6148 tablet_bootstrap.cc:492] T 80898a5a2cf046f1b7344dfceb175bbd P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:53:11.640940 6151 tablet_bootstrap.cc:654] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:11.640954 6150 tablet_bootstrap.cc:654] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:11.640954 6148 tablet_bootstrap.cc:654] T 80898a5a2cf046f1b7344dfceb175bbd P c9d2944272bc447dafce7620ac2dbd4b: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:11.641440 6149 tablet_bootstrap.cc:654] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:11.646817 6151 tablet_bootstrap.cc:492] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915: No bootstrap required, opened a new log
I20260807 13:53:11.646984 6151 ts_tablet_manager.cc:1403] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.005s
I20260807 13:53:11.647576 6148 tablet_bootstrap.cc:492] T 80898a5a2cf046f1b7344dfceb175bbd P c9d2944272bc447dafce7620ac2dbd4b: No bootstrap required, opened a new log
I20260807 13:53:11.647675 6149 tablet_bootstrap.cc:492] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7: No bootstrap required, opened a new log
I20260807 13:53:11.647766 6148 ts_tablet_manager.cc:1403] T 80898a5a2cf046f1b7344dfceb175bbd P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260807 13:53:11.647871 6149 ts_tablet_manager.cc:1403] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20260807 13:53:11.648015 6150 tablet_bootstrap.cc:492] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: No bootstrap required, opened a new log
I20260807 13:53:11.648226 6150 ts_tablet_manager.cc:1403] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.007s
I20260807 13:53:11.648173 6151 raft_consensus.cc:359] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:11.648490 6151 raft_consensus.cc:385] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:11.648651 6151 raft_consensus.cc:740] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:53:11.648653 6148 raft_consensus.cc:359] T 80898a5a2cf046f1b7344dfceb175bbd P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:11.648782 6149 raft_consensus.cc:359] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:11.648888 6148 raft_consensus.cc:385] T 80898a5a2cf046f1b7344dfceb175bbd P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:11.648995 6148 raft_consensus.cc:740] T 80898a5a2cf046f1b7344dfceb175bbd P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:53:11.649039 6149 raft_consensus.cc:385] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:11.649040 6150 raft_consensus.cc:359] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:11.649178 6149 raft_consensus.cc:740] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:53:11.649300 6150 raft_consensus.cc:385] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:11.649151 6151 consensus_queue.cc:260] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:11.649360 6148 consensus_queue.cc:260] T 80898a5a2cf046f1b7344dfceb175bbd P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:11.649477 6150 raft_consensus.cc:740] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:53:11.649505 6149 consensus_queue.cc:260] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:11.649720 6150 consensus_queue.cc:260] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:11.650286 6150 ts_tablet_manager.cc:1434] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260807 13:53:11.650870 6150 tablet_bootstrap.cc:492] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:53:11.652766 6150 tablet_bootstrap.cc:654] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:11.655187 6151 ts_tablet_manager.cc:1434] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260807 13:53:11.656510 6151 tablet_bootstrap.cc:492] T bdac11c33b2b486eb34bc93def74489c P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:53:11.650205 6149 ts_tablet_manager.cc:1434] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 13:53:11.659346 6151 tablet_bootstrap.cc:654] T bdac11c33b2b486eb34bc93def74489c P 01adf83af3e04875b5fac9470d4da915: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:11.663101 6148 ts_tablet_manager.cc:1434] T 80898a5a2cf046f1b7344dfceb175bbd P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.015s user 0.003s sys 0.011s
I20260807 13:53:11.663165 6151 tablet_bootstrap.cc:492] T bdac11c33b2b486eb34bc93def74489c P 01adf83af3e04875b5fac9470d4da915: No bootstrap required, opened a new log
I20260807 13:53:11.663368 6151 ts_tablet_manager.cc:1403] T bdac11c33b2b486eb34bc93def74489c P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260807 13:53:11.663480 6148 tablet_bootstrap.cc:492] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:53:11.664288 6151 raft_consensus.cc:359] T bdac11c33b2b486eb34bc93def74489c P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:11.664584 6151 raft_consensus.cc:385] T bdac11c33b2b486eb34bc93def74489c P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:11.664639 6150 tablet_bootstrap.cc:492] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179: No bootstrap required, opened a new log
I20260807 13:53:11.664718 6151 raft_consensus.cc:740] T bdac11c33b2b486eb34bc93def74489c P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:53:11.664817 6150 ts_tablet_manager.cc:1403] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.006s
I20260807 13:53:11.665001 6151 consensus_queue.cc:260] T bdac11c33b2b486eb34bc93def74489c P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:11.665292 6148 tablet_bootstrap.cc:654] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:11.665588 6151 ts_tablet_manager.cc:1434] T bdac11c33b2b486eb34bc93def74489c P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 13:53:11.665825 6150 raft_consensus.cc:359] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:11.666321 6151 tablet_bootstrap.cc:492] T 68717842b14e4f06b528c08a65acd3b7 P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:53:11.666090 6150 raft_consensus.cc:385] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:11.667284 6150 raft_consensus.cc:740] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:53:11.667608 6150 consensus_queue.cc:260] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:11.668150 6150 ts_tablet_manager.cc:1434] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:53:11.668382 6151 tablet_bootstrap.cc:654] T 68717842b14e4f06b528c08a65acd3b7 P 01adf83af3e04875b5fac9470d4da915: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:11.677063 6151 tablet_bootstrap.cc:492] T 68717842b14e4f06b528c08a65acd3b7 P 01adf83af3e04875b5fac9470d4da915: No bootstrap required, opened a new log
I20260807 13:53:11.677353 6151 ts_tablet_manager.cc:1403] T 68717842b14e4f06b528c08a65acd3b7 P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.008s
I20260807 13:53:11.678225 6151 raft_consensus.cc:359] T 68717842b14e4f06b528c08a65acd3b7 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:11.678434 6151 raft_consensus.cc:385] T 68717842b14e4f06b528c08a65acd3b7 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:11.678524 6151 raft_consensus.cc:740] T 68717842b14e4f06b528c08a65acd3b7 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:53:11.678788 6151 consensus_queue.cc:260] T 68717842b14e4f06b528c08a65acd3b7 P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:11.679325 6151 ts_tablet_manager.cc:1434] T 68717842b14e4f06b528c08a65acd3b7 P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 13:53:11.681272 6148 tablet_bootstrap.cc:492] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b: No bootstrap required, opened a new log
I20260807 13:53:11.681515 6148 ts_tablet_manager.cc:1403] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.017s
I20260807 13:53:11.682803 6148 raft_consensus.cc:359] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:11.683028 6148 raft_consensus.cc:385] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:11.683136 6148 raft_consensus.cc:740] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:53:11.683410 6148 consensus_queue.cc:260] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:11.684111 6148 ts_tablet_manager.cc:1434] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 13:53:11.684540 6148 tablet_bootstrap.cc:492] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:53:11.686655 6148 tablet_bootstrap.cc:654] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:11.689126 6148 tablet_bootstrap.cc:492] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b: No bootstrap required, opened a new log
I20260807 13:53:11.689280 6148 ts_tablet_manager.cc:1403] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 13:53:11.689924 6148 raft_consensus.cc:359] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:11.690078 6148 raft_consensus.cc:385] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:11.690194 6148 raft_consensus.cc:740] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:53:11.690480 6148 consensus_queue.cc:260] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:11.691058 6148 ts_tablet_manager.cc:1434] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 13:53:11.743884 6137 raft_consensus.cc:493] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:11.744163 6137 raft_consensus.cc:515] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:11.745054 6137 leader_election.cc:290] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:53:11.745857 4896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68717842b14e4f06b528c08a65acd3b7" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b" is_pre_election: true
I20260807 13:53:11.746141 4896 raft_consensus.cc:2468] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 0.
I20260807 13:53:11.746713 4631 leader_election.cc:304] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:11.747071 6137 raft_consensus.cc:2804] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:11.747248 6137 raft_consensus.cc:493] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:11.747414 6137 raft_consensus.cc:3060] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:11.751546 6137 raft_consensus.cc:515] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:11.752883 6137 leader_election.cc:290] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 election: Requested vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:53:11.753213 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68717842b14e4f06b528c08a65acd3b7" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915" is_pre_election: true
I20260807 13:53:11.753259 4896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68717842b14e4f06b528c08a65acd3b7" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
I20260807 13:53:11.753384 5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68717842b14e4f06b528c08a65acd3b7" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915"
I20260807 13:53:11.753522 4896 raft_consensus.cc:3060] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:11.753510 5074 raft_consensus.cc:2468] T 68717842b14e4f06b528c08a65acd3b7 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 0.
I20260807 13:53:11.755852 4896 raft_consensus.cc:2468] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 1.
I20260807 13:53:11.756304 4631 leader_election.cc:304] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters: 01adf83af3e04875b5fac9470d4da915
I20260807 13:53:11.756693 6137 raft_consensus.cc:2804] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:11.756891 6137 raft_consensus.cc:697] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Becoming Leader. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Running, Role: LEADER
I20260807 13:53:11.757217 6137 consensus_queue.cc:237] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:11.760308 4517 catalog_manager.cc:5697] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129). New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:53:11.888549 6043 raft_consensus.cc:493] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:11.888852 6043 raft_consensus.cc:515] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:11.889859 6043 leader_election.cc:290] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:11.890652 5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80898a5a2cf046f1b7344dfceb175bbd" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915" is_pre_election: true
I20260807 13:53:11.890987 5072 raft_consensus.cc:2468] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 0.
I20260807 13:53:11.891696 5152 leader_election.cc:304] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, edf940ebcc1140cfa0c23214e0c0f179; no voters:
I20260807 13:53:11.892051 6043 raft_consensus.cc:2804] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:11.892185 6043 raft_consensus.cc:493] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:11.892284 6043 raft_consensus.cc:3060] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:11.895780 6043 raft_consensus.cc:515] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:11.896639 6043 leader_election.cc:290] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 election: Requested vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:11.896981 5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80898a5a2cf046f1b7344dfceb175bbd" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915"
I20260807 13:53:11.897235 5072 raft_consensus.cc:3060] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:11.900017 5072 raft_consensus.cc:2468] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 1.
I20260807 13:53:11.900406 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80898a5a2cf046f1b7344dfceb175bbd" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
I20260807 13:53:11.900326 4896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80898a5a2cf046f1b7344dfceb175bbd" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b" is_pre_election: true
I20260807 13:53:11.900641 4897 raft_consensus.cc:3060] T 80898a5a2cf046f1b7344dfceb175bbd P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:11.901539 5152 leader_election.cc:304] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, edf940ebcc1140cfa0c23214e0c0f179; no voters:
I20260807 13:53:11.901888 6043 raft_consensus.cc:2804] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:11.902108 6043 raft_consensus.cc:697] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Becoming Leader. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Running, Role: LEADER
I20260807 13:53:11.902544 6043 consensus_queue.cc:237] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:11.903693 4897 raft_consensus.cc:2468] T 80898a5a2cf046f1b7344dfceb175bbd P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 1.
I20260807 13:53:11.905756 4517 catalog_manager.cc:5697] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: term changed from 0 to 1, leader changed from <none> to edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132). New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:53:11.915161 6157 raft_consensus.cc:493] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:11.915411 6157 raft_consensus.cc:515] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:11.917613 6157 leader_election.cc:290] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:11.928735 5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdac11c33b2b486eb34bc93def74489c" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915" is_pre_election: true
I20260807 13:53:11.928871 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdac11c33b2b486eb34bc93def74489c" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179" is_pre_election: true
I20260807 13:53:11.929055 5072 raft_consensus.cc:2468] T bdac11c33b2b486eb34bc93def74489c P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 0.
I20260807 13:53:11.929100 5248 raft_consensus.cc:2468] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 0.
I20260807 13:53:11.929663 4806 leader_election.cc:304] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9d2944272bc447dafce7620ac2dbd4b, edf940ebcc1140cfa0c23214e0c0f179; no voters:
I20260807 13:53:11.930122 6157 raft_consensus.cc:2804] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:11.930267 6157 raft_consensus.cc:493] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:11.930395 6157 raft_consensus.cc:3060] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:11.933059 6157 raft_consensus.cc:515] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:11.933914 6157 leader_election.cc:290] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 election: Requested vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:11.934433 5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdac11c33b2b486eb34bc93def74489c" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179"
I20260807 13:53:11.934706 5246 raft_consensus.cc:3060] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:11.935467 5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdac11c33b2b486eb34bc93def74489c" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915"
I20260807 13:53:11.935639 5072 raft_consensus.cc:3060] T bdac11c33b2b486eb34bc93def74489c P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:11.936976 5246 raft_consensus.cc:2468] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 1.
I20260807 13:53:11.937476 4806 leader_election.cc:304] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9d2944272bc447dafce7620ac2dbd4b, edf940ebcc1140cfa0c23214e0c0f179; no voters:
I20260807 13:53:11.937796 6157 raft_consensus.cc:2804] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:11.937826 5072 raft_consensus.cc:2468] T bdac11c33b2b486eb34bc93def74489c P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 1.
I20260807 13:53:11.938267 6157 raft_consensus.cc:697] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Becoming Leader. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Running, Role: LEADER
I20260807 13:53:11.938868 6157 consensus_queue.cc:237] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:11.942070 4517 catalog_manager.cc:5697] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: term changed from 0 to 1, leader changed from <none> to c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130). New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:53:12.220705 6137 consensus_queue.cc:1048] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:12.226727 5072 raft_consensus.cc:3060] T 68717842b14e4f06b528c08a65acd3b7 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:12.230687 6065 consensus_queue.cc:1048] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:12.342751 6043 consensus_queue.cc:1048] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:12.348337 6043 consensus_queue.cc:1048] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:53:12.399156 6182 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:12.399487 6182 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260807 13:53:12.404662 6157 consensus_queue.cc:1048] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:12.410280 6157 consensus_queue.cc:1048] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Using table 'rebalance_test_table_1'
INSERT report
rows total: 2000
time total: 227.764 ms
time per row: 0.113882 ms
I20260807 13:53:12.797820 4519 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39098:
name: "rebalance_test_table_2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:53:12.806969 4865 tablet_service.cc:1511] Processing CreateTablet for tablet 782ac4fa94fb4183940fca514cc068b0 (DEFAULT_TABLE table=rebalance_test_table_2 [id=35d13981f3a742dd9369d1e7bf18498c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:12.807340 5216 tablet_service.cc:1511] Processing CreateTablet for tablet 782ac4fa94fb4183940fca514cc068b0 (DEFAULT_TABLE table=rebalance_test_table_2 [id=35d13981f3a742dd9369d1e7bf18498c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:12.807518 4865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 782ac4fa94fb4183940fca514cc068b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:12.807811 5216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 782ac4fa94fb4183940fca514cc068b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:12.808579 4686 tablet_service.cc:1511] Processing CreateTablet for tablet b414c896ad884facb339e5e4a0329065 (DEFAULT_TABLE table=rebalance_test_table_2 [id=35d13981f3a742dd9369d1e7bf18498c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:12.809092 4686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b414c896ad884facb339e5e4a0329065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:12.809409 4688 tablet_service.cc:1511] Processing CreateTablet for tablet 1715828a5d96455abecae985d1dca004 (DEFAULT_TABLE table=rebalance_test_table_2 [id=35d13981f3a742dd9369d1e7bf18498c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:12.809801 4688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1715828a5d96455abecae985d1dca004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:12.809844 5038 tablet_service.cc:1511] Processing CreateTablet for tablet b414c896ad884facb339e5e4a0329065 (DEFAULT_TABLE table=rebalance_test_table_2 [id=35d13981f3a742dd9369d1e7bf18498c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:12.810395 5038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b414c896ad884facb339e5e4a0329065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:12.814263 5220 tablet_service.cc:1511] Processing CreateTablet for tablet b414c896ad884facb339e5e4a0329065 (DEFAULT_TABLE table=rebalance_test_table_2 [id=35d13981f3a742dd9369d1e7bf18498c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:12.814672 5220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b414c896ad884facb339e5e4a0329065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:12.809717 4687 tablet_service.cc:1511] Processing CreateTablet for tablet 782ac4fa94fb4183940fca514cc068b0 (DEFAULT_TABLE table=rebalance_test_table_2 [id=35d13981f3a742dd9369d1e7bf18498c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:12.816890 4687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 782ac4fa94fb4183940fca514cc068b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:12.819236 4863 tablet_service.cc:1511] Processing CreateTablet for tablet 1715828a5d96455abecae985d1dca004 (DEFAULT_TABLE table=rebalance_test_table_2 [id=35d13981f3a742dd9369d1e7bf18498c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:12.819644 4863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1715828a5d96455abecae985d1dca004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:12.826040 6268 tablet_bootstrap.cc:492] T 1715828a5d96455abecae985d1dca004 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:53:12.827039 5220 tablet_service.cc:1511] Processing CreateTablet for tablet 1715828a5d96455abecae985d1dca004 (DEFAULT_TABLE table=rebalance_test_table_2 [id=35d13981f3a742dd9369d1e7bf18498c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:12.827613 5220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1715828a5d96455abecae985d1dca004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:12.834772 6269 tablet_bootstrap.cc:492] T 782ac4fa94fb4183940fca514cc068b0 P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:53:12.836752 6269 tablet_bootstrap.cc:654] T 782ac4fa94fb4183940fca514cc068b0 P edf940ebcc1140cfa0c23214e0c0f179: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:12.838064 6268 tablet_bootstrap.cc:654] T 1715828a5d96455abecae985d1dca004 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:12.838228 6270 tablet_bootstrap.cc:492] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:53:12.838877 6271 tablet_bootstrap.cc:492] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:53:12.841094 6271 tablet_bootstrap.cc:654] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:12.842406 6270 tablet_bootstrap.cc:654] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:12.846971 6269 tablet_bootstrap.cc:492] T 782ac4fa94fb4183940fca514cc068b0 P edf940ebcc1140cfa0c23214e0c0f179: No bootstrap required, opened a new log
I20260807 13:53:12.847123 6269 ts_tablet_manager.cc:1403] T 782ac4fa94fb4183940fca514cc068b0 P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.008s
I20260807 13:53:12.847934 6269 raft_consensus.cc:359] T 782ac4fa94fb4183940fca514cc068b0 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:12.848116 6269 raft_consensus.cc:385] T 782ac4fa94fb4183940fca514cc068b0 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:12.848191 6269 raft_consensus.cc:740] T 782ac4fa94fb4183940fca514cc068b0 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:53:12.848652 6269 consensus_queue.cc:260] T 782ac4fa94fb4183940fca514cc068b0 P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:12.848788 6270 tablet_bootstrap.cc:492] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915: No bootstrap required, opened a new log
I20260807 13:53:12.848965 6270 ts_tablet_manager.cc:1403] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.003s
I20260807 13:53:12.849895 6271 tablet_bootstrap.cc:492] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b: No bootstrap required, opened a new log
I20260807 13:53:12.849938 6270 raft_consensus.cc:359] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:12.850100 6271 ts_tablet_manager.cc:1403] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260807 13:53:12.850198 6270 raft_consensus.cc:385] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:12.850322 6270 raft_consensus.cc:740] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:53:12.850641 6270 consensus_queue.cc:260] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:12.851029 6271 raft_consensus.cc:359] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:12.851243 6271 raft_consensus.cc:385] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:12.851346 6271 raft_consensus.cc:740] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:53:12.851593 6271 consensus_queue.cc:260] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:12.852480 6270 ts_tablet_manager.cc:1434] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:53:12.853499 6271 ts_tablet_manager.cc:1434] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:53:12.853893 6271 tablet_bootstrap.cc:492] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:53:12.853787 6268 tablet_bootstrap.cc:492] T 1715828a5d96455abecae985d1dca004 P fa83b7af134b4e3b949ac3b4e4bcb5e7: No bootstrap required, opened a new log
I20260807 13:53:12.854506 6269 ts_tablet_manager.cc:1434] T 782ac4fa94fb4183940fca514cc068b0 P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260807 13:53:12.854825 6268 ts_tablet_manager.cc:1403] T 1715828a5d96455abecae985d1dca004 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.029s user 0.008s sys 0.000s
I20260807 13:53:12.856107 6271 tablet_bootstrap.cc:654] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:12.856326 6268 raft_consensus.cc:359] T 1715828a5d96455abecae985d1dca004 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:12.856782 6268 raft_consensus.cc:385] T 1715828a5d96455abecae985d1dca004 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:12.856916 6268 raft_consensus.cc:740] T 1715828a5d96455abecae985d1dca004 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:53:12.857301 6268 consensus_queue.cc:260] T 1715828a5d96455abecae985d1dca004 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:12.858076 6268 ts_tablet_manager.cc:1434] T 1715828a5d96455abecae985d1dca004 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:53:12.859185 6268 tablet_bootstrap.cc:492] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:53:12.861141 6268 tablet_bootstrap.cc:654] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:12.862807 6269 tablet_bootstrap.cc:492] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:53:12.864907 6269 tablet_bootstrap.cc:654] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:12.869150 6271 tablet_bootstrap.cc:492] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b: No bootstrap required, opened a new log
I20260807 13:53:12.869894 6271 ts_tablet_manager.cc:1403] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.005s
I20260807 13:53:12.871371 6269 tablet_bootstrap.cc:492] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179: No bootstrap required, opened a new log
I20260807 13:53:12.871179 6271 raft_consensus.cc:359] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:12.871515 6271 raft_consensus.cc:385] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:12.871632 6269 ts_tablet_manager.cc:1403] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.007s
I20260807 13:53:12.871752 6271 raft_consensus.cc:740] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:53:12.872227 6271 consensus_queue.cc:260] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:12.872437 6269 raft_consensus.cc:359] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:12.872684 6269 raft_consensus.cc:385] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:12.872781 6269 raft_consensus.cc:740] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:53:12.873060 6269 consensus_queue.cc:260] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:12.873355 6271 ts_tablet_manager.cc:1434] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:53:12.873626 6269 ts_tablet_manager.cc:1434] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:53:12.873997 6269 tablet_bootstrap.cc:492] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:53:12.875236 6268 tablet_bootstrap.cc:492] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7: No bootstrap required, opened a new log
I20260807 13:53:12.875528 6268 ts_tablet_manager.cc:1403] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.016s user 0.013s sys 0.003s
I20260807 13:53:12.875826 6269 tablet_bootstrap.cc:654] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:12.876504 6268 raft_consensus.cc:359] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:12.876704 6268 raft_consensus.cc:385] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:12.876787 6268 raft_consensus.cc:740] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:53:12.877049 6268 consensus_queue.cc:260] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:12.877796 6268 ts_tablet_manager.cc:1434] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 13:53:12.878211 6268 tablet_bootstrap.cc:492] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:53:12.880122 6268 tablet_bootstrap.cc:654] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:12.886904 6268 tablet_bootstrap.cc:492] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7: No bootstrap required, opened a new log
I20260807 13:53:12.887102 6268 ts_tablet_manager.cc:1403] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260807 13:53:12.887683 6269 tablet_bootstrap.cc:492] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179: No bootstrap required, opened a new log
I20260807 13:53:12.887853 6269 ts_tablet_manager.cc:1403] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.008s
I20260807 13:53:12.887974 6268 raft_consensus.cc:359] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:12.888187 6268 raft_consensus.cc:385] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:12.888293 6268 raft_consensus.cc:740] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:53:12.888578 6268 consensus_queue.cc:260] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:12.888711 6269 raft_consensus.cc:359] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:12.889235 6268 ts_tablet_manager.cc:1434] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260807 13:53:12.889698 6269 raft_consensus.cc:385] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:12.889846 6269 raft_consensus.cc:740] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:53:12.890257 6269 consensus_queue.cc:260] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:12.890908 6269 ts_tablet_manager.cc:1434] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260807 13:53:12.929416 6157 raft_consensus.cc:493] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:12.929677 6157 raft_consensus.cc:515] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:12.930508 6157 leader_election.cc:290] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:53:12.931124 5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "782ac4fa94fb4183940fca514cc068b0" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179" is_pre_election: true
I20260807 13:53:12.931391 5246 raft_consensus.cc:2468] T 782ac4fa94fb4183940fca514cc068b0 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 0.
I20260807 13:53:12.932309 4806 leader_election.cc:304] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9d2944272bc447dafce7620ac2dbd4b, edf940ebcc1140cfa0c23214e0c0f179; no voters:
I20260807 13:53:12.932626 6157 raft_consensus.cc:2804] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:12.932758 6157 raft_consensus.cc:493] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:12.932935 6157 raft_consensus.cc:3060] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:12.935250 6157 raft_consensus.cc:515] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:12.935932 6157 leader_election.cc:290] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 election: Requested vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:53:12.936352 5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "782ac4fa94fb4183940fca514cc068b0" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179"
I20260807 13:53:12.936589 5246 raft_consensus.cc:3060] T 782ac4fa94fb4183940fca514cc068b0 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:12.938378 4717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "782ac4fa94fb4183940fca514cc068b0" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" is_pre_election: true
I20260807 13:53:12.938488 4718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "782ac4fa94fb4183940fca514cc068b0" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
I20260807 13:53:12.938628 4717 raft_consensus.cc:2468] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 0.
I20260807 13:53:12.939414 5246 raft_consensus.cc:2468] T 782ac4fa94fb4183940fca514cc068b0 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 1.
I20260807 13:53:12.939878 4806 leader_election.cc:304] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9d2944272bc447dafce7620ac2dbd4b, edf940ebcc1140cfa0c23214e0c0f179; no voters: fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:53:12.940227 6157 raft_consensus.cc:2804] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:12.940407 6157 raft_consensus.cc:697] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Becoming Leader. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Running, Role: LEADER
I20260807 13:53:12.940718 6157 consensus_queue.cc:237] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:12.943785 4519 catalog_manager.cc:5697] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: term changed from 0 to 1, leader changed from <none> to c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130). New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:53:12.970125 6139 raft_consensus.cc:493] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:12.970309 6139 raft_consensus.cc:515] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:12.971117 6139 leader_election.cc:290] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:53:12.971683 4717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1715828a5d96455abecae985d1dca004" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" is_pre_election: true
I20260807 13:53:12.971777 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1715828a5d96455abecae985d1dca004" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b" is_pre_election: true
I20260807 13:53:12.971956 4717 raft_consensus.cc:2468] T 1715828a5d96455abecae985d1dca004 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 0.
I20260807 13:53:12.972075 4897 raft_consensus.cc:2468] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 0.
I20260807 13:53:12.972450 5154 leader_election.cc:304] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edf940ebcc1140cfa0c23214e0c0f179, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:12.972780 6139 raft_consensus.cc:2804] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:12.972906 6139 raft_consensus.cc:493] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:12.973016 6139 raft_consensus.cc:3060] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:12.975486 6139 raft_consensus.cc:515] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:12.976125 6139 leader_election.cc:290] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 election: Requested vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:53:12.976562 4717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1715828a5d96455abecae985d1dca004" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
I20260807 13:53:12.976579 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1715828a5d96455abecae985d1dca004" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
I20260807 13:53:12.976747 4717 raft_consensus.cc:3060] T 1715828a5d96455abecae985d1dca004 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:12.976794 4897 raft_consensus.cc:3060] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:12.978863 4897 raft_consensus.cc:2468] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 1.
I20260807 13:53:12.978869 4717 raft_consensus.cc:2468] T 1715828a5d96455abecae985d1dca004 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 1.
I20260807 13:53:12.979398 5153 leader_election.cc:304] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: c9d2944272bc447dafce7620ac2dbd4b, edf940ebcc1140cfa0c23214e0c0f179, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:12.979761 6139 raft_consensus.cc:2804] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:12.979954 6139 raft_consensus.cc:697] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Becoming Leader. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Running, Role: LEADER
I20260807 13:53:12.980309 6139 consensus_queue.cc:237] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:12.983155 4519 catalog_manager.cc:5697] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: term changed from 0 to 1, leader changed from <none> to edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132). New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:53:13.027063 6139 raft_consensus.cc:493] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:13.027360 6139 raft_consensus.cc:515] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:13.028090 6139 leader_election.cc:290] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:13.028752 4717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b414c896ad884facb339e5e4a0329065" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" is_pre_election: true
I20260807 13:53:13.028805 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b414c896ad884facb339e5e4a0329065" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915" is_pre_election: true
I20260807 13:53:13.029037 4717 raft_consensus.cc:2468] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 0.
I20260807 13:53:13.029075 5074 raft_consensus.cc:2468] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 0.
I20260807 13:53:13.029624 5154 leader_election.cc:304] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, edf940ebcc1140cfa0c23214e0c0f179, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:13.029939 6139 raft_consensus.cc:2804] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:13.030066 6139 raft_consensus.cc:493] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:13.030206 6139 raft_consensus.cc:3060] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:13.032514 6139 raft_consensus.cc:515] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:13.033178 6139 leader_election.cc:290] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 election: Requested vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:13.033667 4717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b414c896ad884facb339e5e4a0329065" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
I20260807 13:53:13.033720 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b414c896ad884facb339e5e4a0329065" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915"
I20260807 13:53:13.033926 5074 raft_consensus.cc:3060] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:13.033926 4717 raft_consensus.cc:3060] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:13.037072 4717 raft_consensus.cc:2468] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 1.
I20260807 13:53:13.037072 5074 raft_consensus.cc:2468] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 1.
I20260807 13:53:13.037598 5154 leader_election.cc:304] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, edf940ebcc1140cfa0c23214e0c0f179, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:13.037947 6139 raft_consensus.cc:2804] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:13.038131 6139 raft_consensus.cc:697] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Becoming Leader. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Running, Role: LEADER
I20260807 13:53:13.038443 6139 consensus_queue.cc:237] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:13.041443 4519 catalog_manager.cc:5697] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: term changed from 0 to 1, leader changed from <none> to edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132). New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:53:13.333112 6157 consensus_queue.cc:1048] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:13.341459 4717 raft_consensus.cc:3060] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:13.345487 6295 consensus_queue.cc:1048] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:53:13.463950 6289 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:13.464283 6289 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260807 13:53:13.488387 6139 consensus_queue.cc:1048] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:13.494334 6043 consensus_queue.cc:1048] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Using table 'rebalance_test_table_2'
I20260807 13:53:13.555835 6043 consensus_queue.cc:1048] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:13.561664 6139 consensus_queue.cc:1048] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 219.508 ms
time per row: 0.109754 ms
I20260807 13:53:13.857646 4510 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39098:
name: "rebalance_test_table_3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:53:13.867338 4863 tablet_service.cc:1511] Processing CreateTablet for tablet 0c1327c8461e44f2ac5d77f10c390eeb (DEFAULT_TABLE table=rebalance_test_table_3 [id=c2c7db1795a1414c8299bebbeaf60404]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:13.867745 5038 tablet_service.cc:1511] Processing CreateTablet for tablet 0c1327c8461e44f2ac5d77f10c390eeb (DEFAULT_TABLE table=rebalance_test_table_3 [id=c2c7db1795a1414c8299bebbeaf60404]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:13.867873 4863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c1327c8461e44f2ac5d77f10c390eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:13.868201 5038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c1327c8461e44f2ac5d77f10c390eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:13.869266 4688 tablet_service.cc:1511] Processing CreateTablet for tablet 739f4f0207104455bf3e87bc04f8d13c (DEFAULT_TABLE table=rebalance_test_table_3 [id=c2c7db1795a1414c8299bebbeaf60404]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:13.869776 4688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739f4f0207104455bf3e87bc04f8d13c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:13.871527 5037 tablet_service.cc:1511] Processing CreateTablet for tablet 739f4f0207104455bf3e87bc04f8d13c (DEFAULT_TABLE table=rebalance_test_table_3 [id=c2c7db1795a1414c8299bebbeaf60404]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:13.871677 5039 tablet_service.cc:1511] Processing CreateTablet for tablet c10b910e9f354933b60ae70f1baa9b6f (DEFAULT_TABLE table=rebalance_test_table_3 [id=c2c7db1795a1414c8299bebbeaf60404]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:13.871984 5037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739f4f0207104455bf3e87bc04f8d13c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:13.871984 5220 tablet_service.cc:1511] Processing CreateTablet for tablet 739f4f0207104455bf3e87bc04f8d13c (DEFAULT_TABLE table=rebalance_test_table_3 [id=c2c7db1795a1414c8299bebbeaf60404]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:13.872439 5220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739f4f0207104455bf3e87bc04f8d13c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:13.874307 5039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c10b910e9f354933b60ae70f1baa9b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:13.876233 4865 tablet_service.cc:1511] Processing CreateTablet for tablet c10b910e9f354933b60ae70f1baa9b6f (DEFAULT_TABLE table=rebalance_test_table_3 [id=c2c7db1795a1414c8299bebbeaf60404]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:13.877053 4687 tablet_service.cc:1511] Processing CreateTablet for tablet 0c1327c8461e44f2ac5d77f10c390eeb (DEFAULT_TABLE table=rebalance_test_table_3 [id=c2c7db1795a1414c8299bebbeaf60404]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:13.877632 4687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c1327c8461e44f2ac5d77f10c390eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:13.879868 6366 tablet_bootstrap.cc:492] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:53:13.880069 5216 tablet_service.cc:1511] Processing CreateTablet for tablet c10b910e9f354933b60ae70f1baa9b6f (DEFAULT_TABLE table=rebalance_test_table_3 [id=c2c7db1795a1414c8299bebbeaf60404]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:13.880550 5216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c10b910e9f354933b60ae70f1baa9b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:13.882041 6366 tablet_bootstrap.cc:654] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:13.884003 4865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c10b910e9f354933b60ae70f1baa9b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:13.896740 6369 tablet_bootstrap.cc:492] T c10b910e9f354933b60ae70f1baa9b6f P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:53:13.897020 6368 tablet_bootstrap.cc:492] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:53:13.898716 6369 tablet_bootstrap.cc:654] T c10b910e9f354933b60ae70f1baa9b6f P c9d2944272bc447dafce7620ac2dbd4b: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:13.898983 6368 tablet_bootstrap.cc:654] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:13.907922 6366 tablet_bootstrap.cc:492] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915: No bootstrap required, opened a new log
I20260807 13:53:13.908209 6366 ts_tablet_manager.cc:1403] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.029s user 0.011s sys 0.011s
I20260807 13:53:13.909201 6366 raft_consensus.cc:359] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:13.909588 6366 raft_consensus.cc:385] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:13.909752 6366 raft_consensus.cc:740] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:53:13.910164 6366 consensus_queue.cc:260] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:13.912178 6366 ts_tablet_manager.cc:1434] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260807 13:53:13.912528 6366 tablet_bootstrap.cc:492] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:53:13.914013 6373 tablet_bootstrap.cc:492] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:53:13.914942 6368 tablet_bootstrap.cc:492] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7: No bootstrap required, opened a new log
I20260807 13:53:13.915103 6368 ts_tablet_manager.cc:1403] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.010s
I20260807 13:53:13.915688 6369 tablet_bootstrap.cc:492] T c10b910e9f354933b60ae70f1baa9b6f P c9d2944272bc447dafce7620ac2dbd4b: No bootstrap required, opened a new log
I20260807 13:53:13.915966 6368 raft_consensus.cc:359] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:13.916231 6368 raft_consensus.cc:385] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:13.916368 6368 raft_consensus.cc:740] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:53:13.916355 6369 ts_tablet_manager.cc:1403] T c10b910e9f354933b60ae70f1baa9b6f P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.000s
I20260807 13:53:13.916697 6368 consensus_queue.cc:260] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:13.917884 6137 raft_consensus.cc:493] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:13.918018 6137 raft_consensus.cc:515] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:13.918766 6137 leader_election.cc:290] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:13.919672 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c1327c8461e44f2ac5d77f10c390eeb" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b" is_pre_election: true
I20260807 13:53:13.920256 6373 tablet_bootstrap.cc:654] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:13.920607 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c1327c8461e44f2ac5d77f10c390eeb" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915" is_pre_election: true
I20260807 13:53:13.920783 6366 tablet_bootstrap.cc:654] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:13.920850 5074 raft_consensus.cc:2468] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 0.
W20260807 13:53:13.921429 4631 leader_election.cc:343] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:53:13.917312 6369 raft_consensus.cc:359] T c10b910e9f354933b60ae70f1baa9b6f P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:13.921696 6369 raft_consensus.cc:385] T c10b910e9f354933b60ae70f1baa9b6f P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:13.921816 6369 raft_consensus.cc:740] T c10b910e9f354933b60ae70f1baa9b6f P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:53:13.921811 4630 leader_election.cc:304] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters: c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:53:13.921452 6368 ts_tablet_manager.cc:1434] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260807 13:53:13.922190 6369 consensus_queue.cc:260] T c10b910e9f354933b60ae70f1baa9b6f P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:13.922348 6137 raft_consensus.cc:2804] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:13.922478 6137 raft_consensus.cc:493] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:13.922616 6137 raft_consensus.cc:3060] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:13.922902 6368 tablet_bootstrap.cc:492] T 739f4f0207104455bf3e87bc04f8d13c P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:53:13.924818 6369 ts_tablet_manager.cc:1434] T c10b910e9f354933b60ae70f1baa9b6f P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260807 13:53:13.925034 6368 tablet_bootstrap.cc:654] T 739f4f0207104455bf3e87bc04f8d13c P fa83b7af134b4e3b949ac3b4e4bcb5e7: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:13.925487 6369 tablet_bootstrap.cc:492] T 0c1327c8461e44f2ac5d77f10c390eeb P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:53:13.925951 6137 raft_consensus.cc:515] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:13.927990 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c1327c8461e44f2ac5d77f10c390eeb" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
I20260807 13:53:13.928339 6369 tablet_bootstrap.cc:654] T 0c1327c8461e44f2ac5d77f10c390eeb P c9d2944272bc447dafce7620ac2dbd4b: Neither blocks nor log segments found. Creating new log.
W20260807 13:53:13.928752 4631 leader_election.cc:343] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:53:13.934664 6368 tablet_bootstrap.cc:492] T 739f4f0207104455bf3e87bc04f8d13c P fa83b7af134b4e3b949ac3b4e4bcb5e7: No bootstrap required, opened a new log
I20260807 13:53:13.934878 6368 ts_tablet_manager.cc:1403] T 739f4f0207104455bf3e87bc04f8d13c P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.007s
I20260807 13:53:13.935016 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c1327c8461e44f2ac5d77f10c390eeb" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915"
I20260807 13:53:13.935266 5074 raft_consensus.cc:3060] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:13.935804 6368 raft_consensus.cc:359] T 739f4f0207104455bf3e87bc04f8d13c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:13.936012 6368 raft_consensus.cc:385] T 739f4f0207104455bf3e87bc04f8d13c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:13.936093 6368 raft_consensus.cc:740] T 739f4f0207104455bf3e87bc04f8d13c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:53:13.936352 6368 consensus_queue.cc:260] T 739f4f0207104455bf3e87bc04f8d13c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:13.938010 6369 tablet_bootstrap.cc:492] T 0c1327c8461e44f2ac5d77f10c390eeb P c9d2944272bc447dafce7620ac2dbd4b: No bootstrap required, opened a new log
I20260807 13:53:13.938213 6369 ts_tablet_manager.cc:1403] T 0c1327c8461e44f2ac5d77f10c390eeb P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.001s
I20260807 13:53:13.938493 5074 raft_consensus.cc:2468] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 1.
I20260807 13:53:13.939013 4630 leader_election.cc:304] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters: c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:53:13.939179 6369 raft_consensus.cc:359] T 0c1327c8461e44f2ac5d77f10c390eeb P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:13.939392 6369 raft_consensus.cc:385] T 0c1327c8461e44f2ac5d77f10c390eeb P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:13.939467 6369 raft_consensus.cc:740] T 0c1327c8461e44f2ac5d77f10c390eeb P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:53:13.942080 6369 consensus_queue.cc:260] T 0c1327c8461e44f2ac5d77f10c390eeb P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:13.942679 6369 ts_tablet_manager.cc:1434] T 0c1327c8461e44f2ac5d77f10c390eeb P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260807 13:53:13.942212 6137 leader_election.cc:290] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 election: Requested vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:13.950065 6137 raft_consensus.cc:2804] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:13.950742 6137 raft_consensus.cc:697] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Becoming Leader. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Running, Role: LEADER
I20260807 13:53:13.951481 6137 consensus_queue.cc:237] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:13.965016 6368 ts_tablet_manager.cc:1434] T 739f4f0207104455bf3e87bc04f8d13c P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.030s user 0.004s sys 0.022s
I20260807 13:53:13.965551 6373 tablet_bootstrap.cc:492] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179: No bootstrap required, opened a new log
I20260807 13:53:13.965766 6373 ts_tablet_manager.cc:1403] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.052s user 0.007s sys 0.014s
I20260807 13:53:13.966137 4519 catalog_manager.cc:5697] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129). New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:53:13.966744 6373 raft_consensus.cc:359] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:13.966966 6373 raft_consensus.cc:385] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:13.967077 6373 raft_consensus.cc:740] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:53:13.967470 6373 consensus_queue.cc:260] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:13.969143 6366 tablet_bootstrap.cc:492] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915: No bootstrap required, opened a new log
I20260807 13:53:13.969369 6366 ts_tablet_manager.cc:1403] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.057s user 0.008s sys 0.024s
I20260807 13:53:13.970331 6366 raft_consensus.cc:359] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:13.970633 6366 raft_consensus.cc:385] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:13.970726 6366 raft_consensus.cc:740] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:53:13.970764 6373 ts_tablet_manager.cc:1434] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260807 13:53:13.971076 6366 consensus_queue.cc:260] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:13.971275 6373 tablet_bootstrap.cc:492] T 739f4f0207104455bf3e87bc04f8d13c P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:53:13.971661 6366 ts_tablet_manager.cc:1434] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 13:53:13.973075 6373 tablet_bootstrap.cc:654] T 739f4f0207104455bf3e87bc04f8d13c P edf940ebcc1140cfa0c23214e0c0f179: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:13.973081 6366 tablet_bootstrap.cc:492] T c10b910e9f354933b60ae70f1baa9b6f P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:53:13.975045 6366 tablet_bootstrap.cc:654] T c10b910e9f354933b60ae70f1baa9b6f P 01adf83af3e04875b5fac9470d4da915: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:13.977701 6366 tablet_bootstrap.cc:492] T c10b910e9f354933b60ae70f1baa9b6f P 01adf83af3e04875b5fac9470d4da915: No bootstrap required, opened a new log
I20260807 13:53:13.977861 6366 ts_tablet_manager.cc:1403] T c10b910e9f354933b60ae70f1baa9b6f P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 13:53:13.977964 6373 tablet_bootstrap.cc:492] T 739f4f0207104455bf3e87bc04f8d13c P edf940ebcc1140cfa0c23214e0c0f179: No bootstrap required, opened a new log
I20260807 13:53:13.978138 6373 ts_tablet_manager.cc:1403] T 739f4f0207104455bf3e87bc04f8d13c P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.003s
I20260807 13:53:13.978708 6366 raft_consensus.cc:359] T c10b910e9f354933b60ae70f1baa9b6f P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:13.978907 6366 raft_consensus.cc:385] T c10b910e9f354933b60ae70f1baa9b6f P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:13.978917 6373 raft_consensus.cc:359] T 739f4f0207104455bf3e87bc04f8d13c P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:13.979030 6366 raft_consensus.cc:740] T c10b910e9f354933b60ae70f1baa9b6f P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:53:13.979135 6373 raft_consensus.cc:385] T 739f4f0207104455bf3e87bc04f8d13c P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:13.979233 6373 raft_consensus.cc:740] T 739f4f0207104455bf3e87bc04f8d13c P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:53:13.979327 6366 consensus_queue.cc:260] T c10b910e9f354933b60ae70f1baa9b6f P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:13.979907 6366 ts_tablet_manager.cc:1434] T c10b910e9f354933b60ae70f1baa9b6f P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 13:53:13.979480 6373 consensus_queue.cc:260] T 739f4f0207104455bf3e87bc04f8d13c P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:13.980894 6373 ts_tablet_manager.cc:1434] T 739f4f0207104455bf3e87bc04f8d13c P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:53:13.986312 6039 raft_consensus.cc:493] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:13.986496 6039 raft_consensus.cc:515] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:13.987236 6039 leader_election.cc:290] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:13.987681 4717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f4f0207104455bf3e87bc04f8d13c" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" is_pre_election: true
I20260807 13:53:13.987967 4717 raft_consensus.cc:2468] T 739f4f0207104455bf3e87bc04f8d13c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 0.
I20260807 13:53:13.988488 4982 leader_election.cc:304] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:13.988862 6039 raft_consensus.cc:2804] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:13.989003 6039 raft_consensus.cc:493] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:13.989143 6039 raft_consensus.cc:3060] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:13.991688 6039 raft_consensus.cc:515] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:13.992285 6039 leader_election.cc:290] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 election: Requested vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:13.992805 4717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f4f0207104455bf3e87bc04f8d13c" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
I20260807 13:53:13.993037 4717 raft_consensus.cc:3060] T 739f4f0207104455bf3e87bc04f8d13c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:13.994450 5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f4f0207104455bf3e87bc04f8d13c" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179" is_pre_election: true
I20260807 13:53:13.994482 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f4f0207104455bf3e87bc04f8d13c" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179"
I20260807 13:53:13.994699 5246 raft_consensus.cc:2468] T 739f4f0207104455bf3e87bc04f8d13c P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 0.
I20260807 13:53:13.995676 4717 raft_consensus.cc:2468] T 739f4f0207104455bf3e87bc04f8d13c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 1.
I20260807 13:53:13.996083 4982 leader_election.cc:304] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters: edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:53:13.996413 6039 raft_consensus.cc:2804] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:13.996847 6039 raft_consensus.cc:697] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Becoming Leader. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Running, Role: LEADER
I20260807 13:53:13.997203 6039 consensus_queue.cc:237] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:14.000046 4510 catalog_manager.cc:5697] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01adf83af3e04875b5fac9470d4da915 (127.23.107.131). New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:53:14.028338 6295 raft_consensus.cc:493] T 0c1327c8461e44f2ac5d77f10c390eeb P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:14.028584 6295 raft_consensus.cc:515] T 0c1327c8461e44f2ac5d77f10c390eeb P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:14.029459 6295 leader_election.cc:290] T 0c1327c8461e44f2ac5d77f10c390eeb P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:53:14.030061 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c1327c8461e44f2ac5d77f10c390eeb" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915" is_pre_election: true
I20260807 13:53:14.030094 4717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c1327c8461e44f2ac5d77f10c390eeb" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" is_pre_election: true
I20260807 13:53:14.030391 5074 raft_consensus.cc:2393] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9d2944272bc447dafce7620ac2dbd4b in current term 1: Already voted for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in this term.
I20260807 13:53:14.030918 4804 leader_election.cc:304] T 0c1327c8461e44f2ac5d77f10c390eeb P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9d2944272bc447dafce7620ac2dbd4b; no voters: 01adf83af3e04875b5fac9470d4da915, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:53:14.031213 6295 raft_consensus.cc:3060] T 0c1327c8461e44f2ac5d77f10c390eeb P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:14.033527 6295 raft_consensus.cc:2749] T 0c1327c8461e44f2ac5d77f10c390eeb P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:53:14.185631 6139 raft_consensus.cc:493] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:14.185863 6139 raft_consensus.cc:515] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:14.186725 6139 leader_election.cc:290] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:53:14.187259 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c10b910e9f354933b60ae70f1baa9b6f" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915" is_pre_election: true
I20260807 13:53:14.187430 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c10b910e9f354933b60ae70f1baa9b6f" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b" is_pre_election: true
I20260807 13:53:14.187538 5074 raft_consensus.cc:2468] T c10b910e9f354933b60ae70f1baa9b6f P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 0.
I20260807 13:53:14.187712 4897 raft_consensus.cc:2468] T c10b910e9f354933b60ae70f1baa9b6f P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 0.
I20260807 13:53:14.188097 5152 leader_election.cc:304] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, edf940ebcc1140cfa0c23214e0c0f179; no voters:
I20260807 13:53:14.188387 6139 raft_consensus.cc:2804] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:14.188512 6139 raft_consensus.cc:493] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:14.188593 6139 raft_consensus.cc:3060] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:14.190562 6139 raft_consensus.cc:515] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:14.191264 6139 leader_election.cc:290] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 election: Requested vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:53:14.191732 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c10b910e9f354933b60ae70f1baa9b6f" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915"
I20260807 13:53:14.191809 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c10b910e9f354933b60ae70f1baa9b6f" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
I20260807 13:53:14.191979 5074 raft_consensus.cc:3060] T c10b910e9f354933b60ae70f1baa9b6f P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:14.191983 4897 raft_consensus.cc:3060] T c10b910e9f354933b60ae70f1baa9b6f P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:14.195046 4897 raft_consensus.cc:2468] T c10b910e9f354933b60ae70f1baa9b6f P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 1.
I20260807 13:53:14.195036 5074 raft_consensus.cc:2468] T c10b910e9f354933b60ae70f1baa9b6f P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 1.
I20260807 13:53:14.195509 5153 leader_election.cc:304] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9d2944272bc447dafce7620ac2dbd4b, edf940ebcc1140cfa0c23214e0c0f179; no voters:
I20260807 13:53:14.195850 6139 raft_consensus.cc:2804] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:14.196027 6139 raft_consensus.cc:697] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Becoming Leader. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Running, Role: LEADER
I20260807 13:53:14.196368 6139 consensus_queue.cc:237] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:14.199326 4510 catalog_manager.cc:5697] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: term changed from 0 to 1, leader changed from <none> to edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132). New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:53:14.429108 5248 raft_consensus.cc:3060] T 739f4f0207104455bf3e87bc04f8d13c P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:14.431581 6039 consensus_queue.cc:1048] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:14.434091 6039 consensus_queue.cc:1048] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:14.459791 6137 consensus_queue.cc:1048] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:14.475478 6381 consensus_queue.cc:1048] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:14.680712 6139 consensus_queue.cc:1048] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:14.728540 6412 consensus_queue.cc:1048] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:53:14.767985 6393 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:14.768499 6393 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_3'
INSERT report
rows total: 2000
time total: 248.141 ms
time per row: 0.124071 ms
I20260807 13:53:15.214335 4510 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39098:
name: "rebalance_test_table_4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:53:15.225694 5039 tablet_service.cc:1511] Processing CreateTablet for tablet 43f5461808a646c885d593f782538930 (DEFAULT_TABLE table=rebalance_test_table_4 [id=e242e42da20d4458a49a269a9569307a]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:15.226230 5039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f5461808a646c885d593f782538930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:15.226130 4865 tablet_service.cc:1511] Processing CreateTablet for tablet 43f5461808a646c885d593f782538930 (DEFAULT_TABLE table=rebalance_test_table_4 [id=e242e42da20d4458a49a269a9569307a]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:15.226611 4865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f5461808a646c885d593f782538930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:15.226712 4863 tablet_service.cc:1511] Processing CreateTablet for tablet 541201ddfdf041ed87b3d0e731763a37 (DEFAULT_TABLE table=rebalance_test_table_4 [id=e242e42da20d4458a49a269a9569307a]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:15.227128 4863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541201ddfdf041ed87b3d0e731763a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:15.227810 5216 tablet_service.cc:1511] Processing CreateTablet for tablet 541201ddfdf041ed87b3d0e731763a37 (DEFAULT_TABLE table=rebalance_test_table_4 [id=e242e42da20d4458a49a269a9569307a]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:15.228266 5216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541201ddfdf041ed87b3d0e731763a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:15.229844 4688 tablet_service.cc:1511] Processing CreateTablet for tablet 541201ddfdf041ed87b3d0e731763a37 (DEFAULT_TABLE table=rebalance_test_table_4 [id=e242e42da20d4458a49a269a9569307a]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:15.230319 4688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541201ddfdf041ed87b3d0e731763a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:15.225149 4687 tablet_service.cc:1511] Processing CreateTablet for tablet 43f5461808a646c885d593f782538930 (DEFAULT_TABLE table=rebalance_test_table_4 [id=e242e42da20d4458a49a269a9569307a]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:15.232733 4687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f5461808a646c885d593f782538930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:15.234090 5038 tablet_service.cc:1511] Processing CreateTablet for tablet 96bc42d66fa04fb69afa630969dbb579 (DEFAULT_TABLE table=rebalance_test_table_4 [id=e242e42da20d4458a49a269a9569307a]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:15.234516 5038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96bc42d66fa04fb69afa630969dbb579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:15.238842 5220 tablet_service.cc:1511] Processing CreateTablet for tablet 96bc42d66fa04fb69afa630969dbb579 (DEFAULT_TABLE table=rebalance_test_table_4 [id=e242e42da20d4458a49a269a9569307a]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:15.239413 5220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96bc42d66fa04fb69afa630969dbb579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:15.242063 4686 tablet_service.cc:1511] Processing CreateTablet for tablet 96bc42d66fa04fb69afa630969dbb579 (DEFAULT_TABLE table=rebalance_test_table_4 [id=e242e42da20d4458a49a269a9569307a]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:15.242488 4686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96bc42d66fa04fb69afa630969dbb579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:15.243997 6476 tablet_bootstrap.cc:492] T 43f5461808a646c885d593f782538930 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:53:15.250986 6475 tablet_bootstrap.cc:492] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:53:15.253688 6475 tablet_bootstrap.cc:654] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:15.256362 6476 tablet_bootstrap.cc:654] T 43f5461808a646c885d593f782538930 P c9d2944272bc447dafce7620ac2dbd4b: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:15.263085 6475 tablet_bootstrap.cc:492] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915: No bootstrap required, opened a new log
I20260807 13:53:15.263319 6475 ts_tablet_manager.cc:1403] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.005s
I20260807 13:53:15.264513 6475 raft_consensus.cc:359] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:15.264789 6475 raft_consensus.cc:385] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:15.264886 6475 raft_consensus.cc:740] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:53:15.265257 6475 consensus_queue.cc:260] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:15.265895 6475 ts_tablet_manager.cc:1434] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 13:53:15.268069 6475 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:53:15.269133 6477 tablet_bootstrap.cc:492] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:53:15.269637 6478 tablet_bootstrap.cc:492] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:53:15.270754 6476 tablet_bootstrap.cc:492] T 43f5461808a646c885d593f782538930 P c9d2944272bc447dafce7620ac2dbd4b: No bootstrap required, opened a new log
I20260807 13:53:15.271001 6475 tablet_bootstrap.cc:654] T 96bc42d66fa04fb69afa630969dbb579 P 01adf83af3e04875b5fac9470d4da915: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:15.270984 6476 ts_tablet_manager.cc:1403] T 43f5461808a646c885d593f782538930 P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.008s
I20260807 13:53:15.271329 6477 tablet_bootstrap.cc:654] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:15.271785 6478 tablet_bootstrap.cc:654] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:15.272006 6476 raft_consensus.cc:359] T 43f5461808a646c885d593f782538930 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:15.272286 6476 raft_consensus.cc:385] T 43f5461808a646c885d593f782538930 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:15.272408 6476 raft_consensus.cc:740] T 43f5461808a646c885d593f782538930 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:53:15.272713 6476 consensus_queue.cc:260] T 43f5461808a646c885d593f782538930 P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:15.273504 6476 ts_tablet_manager.cc:1434] T 43f5461808a646c885d593f782538930 P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260807 13:53:15.273989 6476 tablet_bootstrap.cc:492] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:53:15.278275 6476 tablet_bootstrap.cc:654] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:15.281436 6475 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P 01adf83af3e04875b5fac9470d4da915: No bootstrap required, opened a new log
I20260807 13:53:15.281731 6475 ts_tablet_manager.cc:1403] T 96bc42d66fa04fb69afa630969dbb579 P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.007s
I20260807 13:53:15.282847 6475 raft_consensus.cc:359] T 96bc42d66fa04fb69afa630969dbb579 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:15.283138 6475 raft_consensus.cc:385] T 96bc42d66fa04fb69afa630969dbb579 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:15.283237 6475 raft_consensus.cc:740] T 96bc42d66fa04fb69afa630969dbb579 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:53:15.283609 6475 consensus_queue.cc:260] T 96bc42d66fa04fb69afa630969dbb579 P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:15.284328 6475 ts_tablet_manager.cc:1434] T 96bc42d66fa04fb69afa630969dbb579 P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:53:15.292265 6477 tablet_bootstrap.cc:492] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7: No bootstrap required, opened a new log
I20260807 13:53:15.292269 6476 tablet_bootstrap.cc:492] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b: No bootstrap required, opened a new log
I20260807 13:53:15.292457 6478 tablet_bootstrap.cc:492] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179: No bootstrap required, opened a new log
I20260807 13:53:15.292455 6476 ts_tablet_manager.cc:1403] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.006s
I20260807 13:53:15.292481 6477 ts_tablet_manager.cc:1403] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.009s
I20260807 13:53:15.292696 6478 ts_tablet_manager.cc:1403] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.018s
I20260807 13:53:15.293258 6477 raft_consensus.cc:359] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:15.293370 6476 raft_consensus.cc:359] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:15.293520 6477 raft_consensus.cc:385] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:15.293627 6476 raft_consensus.cc:385] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:15.293622 6477 raft_consensus.cc:740] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:53:15.293713 6476 raft_consensus.cc:740] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:53:15.293592 6478 raft_consensus.cc:359] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:15.293807 6478 raft_consensus.cc:385] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:15.293931 6478 raft_consensus.cc:740] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:53:15.293905 6477 consensus_queue.cc:260] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:15.293973 6476 consensus_queue.cc:260] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:15.294198 6478 consensus_queue.cc:260] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:15.294545 6476 ts_tablet_manager.cc:1434] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:53:15.294654 6477 ts_tablet_manager.cc:1434] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 13:53:15.295245 6478 ts_tablet_manager.cc:1434] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:53:15.295111 6477 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:53:15.296109 6478 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:53:15.297575 6477 tablet_bootstrap.cc:654] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:15.297880 6478 tablet_bootstrap.cc:654] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:15.301578 6477 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7: No bootstrap required, opened a new log
I20260807 13:53:15.301803 6477 ts_tablet_manager.cc:1403] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.004s
I20260807 13:53:15.302265 6478 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: No bootstrap required, opened a new log
I20260807 13:53:15.302484 6478 ts_tablet_manager.cc:1403] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260807 13:53:15.302911 6477 raft_consensus.cc:359] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:15.303201 6477 raft_consensus.cc:385] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:15.303313 6477 raft_consensus.cc:740] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:53:15.303587 6477 consensus_queue.cc:260] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:15.303730 6478 raft_consensus.cc:359] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:15.304059 6478 raft_consensus.cc:385] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:15.304176 6478 raft_consensus.cc:740] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:53:15.304173 6477 ts_tablet_manager.cc:1434] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 13:53:15.304563 6477 tablet_bootstrap.cc:492] T 541201ddfdf041ed87b3d0e731763a37 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:53:15.305112 6478 consensus_queue.cc:260] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:15.305799 6478 ts_tablet_manager.cc:1434] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:53:15.306668 6477 tablet_bootstrap.cc:654] T 541201ddfdf041ed87b3d0e731763a37 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:15.310873 6477 tablet_bootstrap.cc:492] T 541201ddfdf041ed87b3d0e731763a37 P fa83b7af134b4e3b949ac3b4e4bcb5e7: No bootstrap required, opened a new log
I20260807 13:53:15.311067 6477 ts_tablet_manager.cc:1403] T 541201ddfdf041ed87b3d0e731763a37 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.003s
I20260807 13:53:15.311770 6477 raft_consensus.cc:359] T 541201ddfdf041ed87b3d0e731763a37 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:15.311925 6477 raft_consensus.cc:385] T 541201ddfdf041ed87b3d0e731763a37 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:15.312072 6477 raft_consensus.cc:740] T 541201ddfdf041ed87b3d0e731763a37 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:53:15.312371 6477 consensus_queue.cc:260] T 541201ddfdf041ed87b3d0e731763a37 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:15.312953 6477 ts_tablet_manager.cc:1434] T 541201ddfdf041ed87b3d0e731763a37 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 13:53:15.356230 6408 raft_consensus.cc:493] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:15.356505 6408 raft_consensus.cc:515] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:15.357296 6408 leader_election.cc:290] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:53:15.358500 5068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bc42d66fa04fb69afa630969dbb579" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915" is_pre_election: true
I20260807 13:53:15.358772 5068 raft_consensus.cc:2468] T 96bc42d66fa04fb69afa630969dbb579 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 0.
I20260807 13:53:15.358110 4717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bc42d66fa04fb69afa630969dbb579" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" is_pre_election: true
I20260807 13:53:15.359282 4717 raft_consensus.cc:2468] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 0.
I20260807 13:53:15.359357 5152 leader_election.cc:304] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, edf940ebcc1140cfa0c23214e0c0f179; no voters:
I20260807 13:53:15.359712 6408 raft_consensus.cc:2804] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:15.359855 6408 raft_consensus.cc:493] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:15.359956 6408 raft_consensus.cc:3060] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:15.362178 6408 raft_consensus.cc:515] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:15.362792 6408 leader_election.cc:290] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 election: Requested vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:53:15.363307 4717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bc42d66fa04fb69afa630969dbb579" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
I20260807 13:53:15.363322 5068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bc42d66fa04fb69afa630969dbb579" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915"
I20260807 13:53:15.363507 5068 raft_consensus.cc:3060] T 96bc42d66fa04fb69afa630969dbb579 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:15.363519 4717 raft_consensus.cc:3060] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:15.365794 4717 raft_consensus.cc:2468] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 1.
I20260807 13:53:15.366309 5154 leader_election.cc:304] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edf940ebcc1140cfa0c23214e0c0f179, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:15.366604 6408 raft_consensus.cc:2804] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:15.366739 5068 raft_consensus.cc:2468] T 96bc42d66fa04fb69afa630969dbb579 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 1.
I20260807 13:53:15.366771 6408 raft_consensus.cc:697] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Becoming Leader. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Running, Role: LEADER
I20260807 13:53:15.367105 6408 consensus_queue.cc:237] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:15.370378 4519 catalog_manager.cc:5697] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: term changed from 0 to 1, leader changed from <none> to edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132). New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:53:15.469362 6452 raft_consensus.cc:493] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:15.469566 6452 raft_consensus.cc:515] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:15.470350 6452 leader_election.cc:290] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:53:15.471067 4717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f5461808a646c885d593f782538930" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" is_pre_election: true
I20260807 13:53:15.471046 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f5461808a646c885d593f782538930" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b" is_pre_election: true
I20260807 13:53:15.471336 4717 raft_consensus.cc:2468] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 0.
I20260807 13:53:15.471359 4897 raft_consensus.cc:2468] T 43f5461808a646c885d593f782538930 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 0.
I20260807 13:53:15.471892 4982 leader_election.cc:304] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:15.472210 6452 raft_consensus.cc:2804] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:15.472335 6452 raft_consensus.cc:493] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:15.472447 6452 raft_consensus.cc:3060] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:15.474545 6452 raft_consensus.cc:515] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:15.475176 6452 leader_election.cc:290] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 election: Requested vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:53:15.475687 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f5461808a646c885d593f782538930" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
I20260807 13:53:15.475672 4717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f5461808a646c885d593f782538930" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
I20260807 13:53:15.475898 4717 raft_consensus.cc:3060] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:15.475914 4897 raft_consensus.cc:3060] T 43f5461808a646c885d593f782538930 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:15.479074 4717 raft_consensus.cc:2468] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 1.
I20260807 13:53:15.479058 4897 raft_consensus.cc:2468] T 43f5461808a646c885d593f782538930 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 1.
I20260807 13:53:15.479552 4981 leader_election.cc:304] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, c9d2944272bc447dafce7620ac2dbd4b; no voters:
I20260807 13:53:15.479843 6452 raft_consensus.cc:2804] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:15.480023 6452 raft_consensus.cc:697] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Becoming Leader. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Running, Role: LEADER
I20260807 13:53:15.480348 6452 consensus_queue.cc:237] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:15.483210 4519 catalog_manager.cc:5697] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01adf83af3e04875b5fac9470d4da915 (127.23.107.131). New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:53:15.505710 6295 raft_consensus.cc:493] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:15.505896 6295 raft_consensus.cc:515] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:15.506481 6295 leader_election.cc:290] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:53:15.507064 5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541201ddfdf041ed87b3d0e731763a37" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179" is_pre_election: true
I20260807 13:53:15.507066 4717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541201ddfdf041ed87b3d0e731763a37" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" is_pre_election: true
I20260807 13:53:15.507299 5246 raft_consensus.cc:2468] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 0.
I20260807 13:53:15.507321 4717 raft_consensus.cc:2468] T 541201ddfdf041ed87b3d0e731763a37 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 0.
I20260807 13:53:15.507790 4806 leader_election.cc:304] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9d2944272bc447dafce7620ac2dbd4b, edf940ebcc1140cfa0c23214e0c0f179; no voters:
I20260807 13:53:15.508069 6295 raft_consensus.cc:2804] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:15.508198 6295 raft_consensus.cc:493] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:15.508284 6295 raft_consensus.cc:3060] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:15.510432 6295 raft_consensus.cc:515] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:15.510946 6295 leader_election.cc:290] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 election: Requested vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:53:15.511482 4717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541201ddfdf041ed87b3d0e731763a37" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
I20260807 13:53:15.511514 5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541201ddfdf041ed87b3d0e731763a37" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179"
I20260807 13:53:15.511689 5246 raft_consensus.cc:3060] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:15.511705 4717 raft_consensus.cc:3060] T 541201ddfdf041ed87b3d0e731763a37 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:15.513784 5246 raft_consensus.cc:2468] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 1.
I20260807 13:53:15.513849 4717 raft_consensus.cc:2468] T 541201ddfdf041ed87b3d0e731763a37 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 1.
I20260807 13:53:15.514249 4806 leader_election.cc:304] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9d2944272bc447dafce7620ac2dbd4b, edf940ebcc1140cfa0c23214e0c0f179; no voters:
I20260807 13:53:15.514547 6295 raft_consensus.cc:2804] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:15.515018 6295 raft_consensus.cc:697] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Becoming Leader. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Running, Role: LEADER
I20260807 13:53:15.515412 6295 consensus_queue.cc:237] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:15.518707 4519 catalog_manager.cc:5697] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: term changed from 0 to 1, leader changed from <none> to c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130). New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:53:15.763120 6408 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:15.782469 6407 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:53:15.944766 6498 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:15.945140 6498 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_4'
I20260807 13:53:16.004325 6295 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:16.010658 6295 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:16.015743 6452 consensus_queue.cc:1048] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:16.051191 6535 consensus_queue.cc:1048] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 293.636 ms
time per row: 0.146818 ms
I20260807 13:53:16.415925 4519 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39098:
name: "rebalance_test_table_5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:53:16.426014 4863 tablet_service.cc:1511] Processing CreateTablet for tablet 312c7ed04e334b08b506c8908224a7da (DEFAULT_TABLE table=rebalance_test_table_5 [id=b6c061acc30c4e5aa6bee1f054e3a59a]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:16.426584 4863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 312c7ed04e334b08b506c8908224a7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:16.426882 4865 tablet_service.cc:1511] Processing CreateTablet for tablet a29bfc37eabb411f845203c281444086 (DEFAULT_TABLE table=rebalance_test_table_5 [id=b6c061acc30c4e5aa6bee1f054e3a59a]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:16.427254 4865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a29bfc37eabb411f845203c281444086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:16.427299 5220 tablet_service.cc:1511] Processing CreateTablet for tablet a29bfc37eabb411f845203c281444086 (DEFAULT_TABLE table=rebalance_test_table_5 [id=b6c061acc30c4e5aa6bee1f054e3a59a]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:16.427809 5220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a29bfc37eabb411f845203c281444086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:16.429309 4866 tablet_service.cc:1511] Processing CreateTablet for tablet 069a5f0089b24a609b27d4a07a3c4353 (DEFAULT_TABLE table=rebalance_test_table_5 [id=b6c061acc30c4e5aa6bee1f054e3a59a]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:16.429903 4866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 069a5f0089b24a609b27d4a07a3c4353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:16.431449 5216 tablet_service.cc:1511] Processing CreateTablet for tablet 312c7ed04e334b08b506c8908224a7da (DEFAULT_TABLE table=rebalance_test_table_5 [id=b6c061acc30c4e5aa6bee1f054e3a59a]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:16.431833 5216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 312c7ed04e334b08b506c8908224a7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:16.437959 4687 tablet_service.cc:1511] Processing CreateTablet for tablet 069a5f0089b24a609b27d4a07a3c4353 (DEFAULT_TABLE table=rebalance_test_table_5 [id=b6c061acc30c4e5aa6bee1f054e3a59a]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:16.438575 4687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 069a5f0089b24a609b27d4a07a3c4353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:16.439579 5038 tablet_service.cc:1511] Processing CreateTablet for tablet 312c7ed04e334b08b506c8908224a7da (DEFAULT_TABLE table=rebalance_test_table_5 [id=b6c061acc30c4e5aa6bee1f054e3a59a]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:16.439684 5039 tablet_service.cc:1511] Processing CreateTablet for tablet a29bfc37eabb411f845203c281444086 (DEFAULT_TABLE table=rebalance_test_table_5 [id=b6c061acc30c4e5aa6bee1f054e3a59a]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:16.440053 5038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 312c7ed04e334b08b506c8908224a7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:16.440258 5039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a29bfc37eabb411f845203c281444086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:16.445791 5037 tablet_service.cc:1511] Processing CreateTablet for tablet 069a5f0089b24a609b27d4a07a3c4353 (DEFAULT_TABLE table=rebalance_test_table_5 [id=b6c061acc30c4e5aa6bee1f054e3a59a]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:16.446264 5037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 069a5f0089b24a609b27d4a07a3c4353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:16.448956 6580 tablet_bootstrap.cc:492] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:53:16.451150 6580 tablet_bootstrap.cc:654] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:16.455452 6585 tablet_bootstrap.cc:492] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:53:16.456565 6581 tablet_bootstrap.cc:492] T a29bfc37eabb411f845203c281444086 P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:53:16.457173 6582 tablet_bootstrap.cc:492] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:53:16.459389 6582 tablet_bootstrap.cc:654] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:16.459379 6581 tablet_bootstrap.cc:654] T a29bfc37eabb411f845203c281444086 P edf940ebcc1140cfa0c23214e0c0f179: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:16.462154 6580 tablet_bootstrap.cc:492] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b: No bootstrap required, opened a new log
I20260807 13:53:16.462251 6585 tablet_bootstrap.cc:654] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:16.462370 6580 ts_tablet_manager.cc:1403] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.004s
I20260807 13:53:16.462617 6581 tablet_bootstrap.cc:492] T a29bfc37eabb411f845203c281444086 P edf940ebcc1140cfa0c23214e0c0f179: No bootstrap required, opened a new log
I20260807 13:53:16.462838 6581 ts_tablet_manager.cc:1403] T a29bfc37eabb411f845203c281444086 P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20260807 13:53:16.463171 6582 tablet_bootstrap.cc:492] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915: No bootstrap required, opened a new log
I20260807 13:53:16.463409 6582 ts_tablet_manager.cc:1403] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 13:53:16.463368 6580 raft_consensus.cc:359] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:16.463694 6580 raft_consensus.cc:385] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:16.463704 6581 raft_consensus.cc:359] T a29bfc37eabb411f845203c281444086 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:16.463857 6580 raft_consensus.cc:740] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:53:16.463975 6581 raft_consensus.cc:385] T a29bfc37eabb411f845203c281444086 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:16.464124 6581 raft_consensus.cc:740] T a29bfc37eabb411f845203c281444086 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:53:16.464213 6580 consensus_queue.cc:260] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:16.464416 6581 consensus_queue.cc:260] T a29bfc37eabb411f845203c281444086 P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:16.464371 6582 raft_consensus.cc:359] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:16.464651 6582 raft_consensus.cc:385] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:16.464814 6582 raft_consensus.cc:740] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:53:16.464986 6580 ts_tablet_manager.cc:1434] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260807 13:53:16.465196 6582 consensus_queue.cc:260] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:16.465452 6580 tablet_bootstrap.cc:492] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:53:16.465837 6582 ts_tablet_manager.cc:1434] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 13:53:16.466152 6581 ts_tablet_manager.cc:1434] T a29bfc37eabb411f845203c281444086 P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260807 13:53:16.466171 6582 tablet_bootstrap.cc:492] T a29bfc37eabb411f845203c281444086 P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:53:16.466538 6581 tablet_bootstrap.cc:492] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:53:16.467329 6580 tablet_bootstrap.cc:654] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:16.468045 6582 tablet_bootstrap.cc:654] T a29bfc37eabb411f845203c281444086 P 01adf83af3e04875b5fac9470d4da915: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:16.468398 6581 tablet_bootstrap.cc:654] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:16.476529 6582 tablet_bootstrap.cc:492] T a29bfc37eabb411f845203c281444086 P 01adf83af3e04875b5fac9470d4da915: No bootstrap required, opened a new log
I20260807 13:53:16.476794 6582 ts_tablet_manager.cc:1403] T a29bfc37eabb411f845203c281444086 P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.006s
I20260807 13:53:16.477414 6581 tablet_bootstrap.cc:492] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179: No bootstrap required, opened a new log
I20260807 13:53:16.477736 6581 ts_tablet_manager.cc:1403] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.011s user 0.010s sys 0.000s
I20260807 13:53:16.477773 6582 raft_consensus.cc:359] T a29bfc37eabb411f845203c281444086 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:16.478051 6582 raft_consensus.cc:385] T a29bfc37eabb411f845203c281444086 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:16.478173 6582 raft_consensus.cc:740] T a29bfc37eabb411f845203c281444086 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:53:16.478489 6582 consensus_queue.cc:260] T a29bfc37eabb411f845203c281444086 P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:16.479182 6582 ts_tablet_manager.cc:1434] T a29bfc37eabb411f845203c281444086 P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:53:16.479063 6581 raft_consensus.cc:359] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:16.479326 6581 raft_consensus.cc:385] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:16.479481 6581 raft_consensus.cc:740] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:53:16.479643 6582 tablet_bootstrap.cc:492] T 069a5f0089b24a609b27d4a07a3c4353 P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:53:16.479972 6581 consensus_queue.cc:260] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:16.481624 6582 tablet_bootstrap.cc:654] T 069a5f0089b24a609b27d4a07a3c4353 P 01adf83af3e04875b5fac9470d4da915: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:16.481877 6581 ts_tablet_manager.cc:1434] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260807 13:53:16.484424 6582 tablet_bootstrap.cc:492] T 069a5f0089b24a609b27d4a07a3c4353 P 01adf83af3e04875b5fac9470d4da915: No bootstrap required, opened a new log
I20260807 13:53:16.484683 6582 ts_tablet_manager.cc:1403] T 069a5f0089b24a609b27d4a07a3c4353 P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260807 13:53:16.485971 6582 raft_consensus.cc:359] T 069a5f0089b24a609b27d4a07a3c4353 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:16.487345 6582 raft_consensus.cc:385] T 069a5f0089b24a609b27d4a07a3c4353 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:16.487555 6582 raft_consensus.cc:740] T 069a5f0089b24a609b27d4a07a3c4353 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:53:16.487950 6582 consensus_queue.cc:260] T 069a5f0089b24a609b27d4a07a3c4353 P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:16.488749 6582 ts_tablet_manager.cc:1434] T 069a5f0089b24a609b27d4a07a3c4353 P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260807 13:53:16.491724 6580 tablet_bootstrap.cc:492] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: No bootstrap required, opened a new log
I20260807 13:53:16.491786 6585 tablet_bootstrap.cc:492] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7: No bootstrap required, opened a new log
I20260807 13:53:16.491938 6580 ts_tablet_manager.cc:1403] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.027s user 0.010s sys 0.015s
I20260807 13:53:16.491976 6585 ts_tablet_manager.cc:1403] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.037s user 0.005s sys 0.005s
I20260807 13:53:16.492749 6585 raft_consensus.cc:359] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:16.492954 6585 raft_consensus.cc:385] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:16.492864 6580 raft_consensus.cc:359] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:16.493058 6585 raft_consensus.cc:740] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:53:16.493146 6580 raft_consensus.cc:385] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:16.493279 6580 raft_consensus.cc:740] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:53:16.493408 6585 consensus_queue.cc:260] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:16.493587 6580 consensus_queue.cc:260] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:16.494035 6585 ts_tablet_manager.cc:1434] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:53:16.494169 6580 ts_tablet_manager.cc:1434] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:53:16.494561 6580 tablet_bootstrap.cc:492] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:53:16.496407 6580 tablet_bootstrap.cc:654] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:16.500298 6580 tablet_bootstrap.cc:492] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b: No bootstrap required, opened a new log
I20260807 13:53:16.500478 6580 ts_tablet_manager.cc:1403] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 13:53:16.501221 6580 raft_consensus.cc:359] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:16.501420 6580 raft_consensus.cc:385] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:16.501520 6580 raft_consensus.cc:740] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:53:16.501791 6580 consensus_queue.cc:260] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:16.502296 6580 ts_tablet_manager.cc:1434] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 13:53:16.514057 6295 raft_consensus.cc:493] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:16.514300 6295 raft_consensus.cc:515] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:16.515074 6295 leader_election.cc:290] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:16.515565 5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29bfc37eabb411f845203c281444086" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179" is_pre_election: true
I20260807 13:53:16.515725 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29bfc37eabb411f845203c281444086" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915" is_pre_election: true
I20260807 13:53:16.515825 5246 raft_consensus.cc:2468] T a29bfc37eabb411f845203c281444086 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 0.
I20260807 13:53:16.516036 5074 raft_consensus.cc:2468] T a29bfc37eabb411f845203c281444086 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 0.
I20260807 13:53:16.516410 4806 leader_election.cc:304] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9d2944272bc447dafce7620ac2dbd4b, edf940ebcc1140cfa0c23214e0c0f179; no voters:
I20260807 13:53:16.516728 6295 raft_consensus.cc:2804] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:16.516812 6295 raft_consensus.cc:493] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:16.516932 6295 raft_consensus.cc:3060] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:16.519201 6295 raft_consensus.cc:515] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:16.519789 6295 leader_election.cc:290] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 election: Requested vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:16.520324 5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29bfc37eabb411f845203c281444086" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179"
I20260807 13:53:16.520355 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29bfc37eabb411f845203c281444086" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915"
I20260807 13:53:16.520536 5074 raft_consensus.cc:3060] T a29bfc37eabb411f845203c281444086 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:16.520596 5246 raft_consensus.cc:3060] T a29bfc37eabb411f845203c281444086 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:16.523690 5074 raft_consensus.cc:2468] T a29bfc37eabb411f845203c281444086 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 1.
I20260807 13:53:16.523684 5246 raft_consensus.cc:2468] T a29bfc37eabb411f845203c281444086 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 1.
I20260807 13:53:16.524152 4806 leader_election.cc:304] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, c9d2944272bc447dafce7620ac2dbd4b, edf940ebcc1140cfa0c23214e0c0f179; no voters:
I20260807 13:53:16.524468 6295 raft_consensus.cc:2804] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:16.524660 6295 raft_consensus.cc:697] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Becoming Leader. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Running, Role: LEADER
I20260807 13:53:16.524936 6295 consensus_queue.cc:237] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:16.528033 4519 catalog_manager.cc:5697] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: term changed from 0 to 1, leader changed from <none> to c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130). New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:53:16.548882 6295 raft_consensus.cc:493] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:16.549105 6295 raft_consensus.cc:515] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:16.549858 6295 leader_election.cc:290] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:16.550491 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312c7ed04e334b08b506c8908224a7da" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915" is_pre_election: true
I20260807 13:53:16.550499 5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312c7ed04e334b08b506c8908224a7da" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179" is_pre_election: true
I20260807 13:53:16.550751 5074 raft_consensus.cc:2468] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 0.
I20260807 13:53:16.550750 5246 raft_consensus.cc:2468] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 0.
I20260807 13:53:16.551260 4804 leader_election.cc:304] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, c9d2944272bc447dafce7620ac2dbd4b, edf940ebcc1140cfa0c23214e0c0f179; no voters:
I20260807 13:53:16.551621 6295 raft_consensus.cc:2804] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:16.551757 6295 raft_consensus.cc:493] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:16.551872 6295 raft_consensus.cc:3060] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:16.553974 6295 raft_consensus.cc:515] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:16.554620 6295 leader_election.cc:290] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 election: Requested vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:16.555199 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312c7ed04e334b08b506c8908224a7da" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915"
I20260807 13:53:16.555219 5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312c7ed04e334b08b506c8908224a7da" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179"
I20260807 13:53:16.555423 5246 raft_consensus.cc:3060] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:16.555441 5074 raft_consensus.cc:3060] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:16.558547 5074 raft_consensus.cc:2468] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 1.
I20260807 13:53:16.558561 5246 raft_consensus.cc:2468] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 1.
I20260807 13:53:16.559043 4806 leader_election.cc:304] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, c9d2944272bc447dafce7620ac2dbd4b, edf940ebcc1140cfa0c23214e0c0f179; no voters:
I20260807 13:53:16.559388 6295 raft_consensus.cc:2804] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:16.559540 6295 raft_consensus.cc:697] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Becoming Leader. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Running, Role: LEADER
I20260807 13:53:16.559882 6295 consensus_queue.cc:237] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:16.562952 4519 catalog_manager.cc:5697] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: term changed from 0 to 1, leader changed from <none> to c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130). New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:53:16.591765 6295 raft_consensus.cc:493] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:16.592021 6295 raft_consensus.cc:515] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:16.592836 6295 leader_election.cc:290] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:16.593205 4716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a5f0089b24a609b27d4a07a3c4353" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" is_pre_election: true
I20260807 13:53:16.593457 4716 raft_consensus.cc:2468] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 0.
I20260807 13:53:16.593501 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a5f0089b24a609b27d4a07a3c4353" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915" is_pre_election: true
I20260807 13:53:16.593770 5074 raft_consensus.cc:2468] T 069a5f0089b24a609b27d4a07a3c4353 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 0.
I20260807 13:53:16.593984 4806 leader_election.cc:304] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:16.594311 6295 raft_consensus.cc:2804] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:16.594424 6295 raft_consensus.cc:493] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:16.594537 6295 raft_consensus.cc:3060] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:16.596638 6295 raft_consensus.cc:515] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:16.597242 6295 leader_election.cc:290] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 election: Requested vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:16.597803 4716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a5f0089b24a609b27d4a07a3c4353" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
I20260807 13:53:16.597808 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a5f0089b24a609b27d4a07a3c4353" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915"
I20260807 13:53:16.598009 5074 raft_consensus.cc:3060] T 069a5f0089b24a609b27d4a07a3c4353 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:16.598009 4716 raft_consensus.cc:3060] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:16.601121 5074 raft_consensus.cc:2468] T 069a5f0089b24a609b27d4a07a3c4353 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 1.
I20260807 13:53:16.601130 4716 raft_consensus.cc:2468] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 1.
I20260807 13:53:16.601655 4804 leader_election.cc:304] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:16.601928 6295 raft_consensus.cc:2804] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:16.602094 6295 raft_consensus.cc:697] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Becoming Leader. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Running, Role: LEADER
I20260807 13:53:16.602413 6295 consensus_queue.cc:237] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:16.605932 4519 catalog_manager.cc:5697] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: term changed from 0 to 1, leader changed from <none> to c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130). New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:53:17.002516 6295 consensus_queue.cc:1048] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:17.009944 6295 consensus_queue.cc:1048] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:17.028654 6496 consensus_queue.cc:1048] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:17.034704 6496 consensus_queue.cc:1048] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:53:17.044001 6598 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:17.044448 6598 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_5'
I20260807 13:53:17.095261 6496 consensus_queue.cc:1048] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:17.100595 6496 consensus_queue.cc:1048] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 268.86 ms
time per row: 0.13443 ms
I20260807 13:53:17.504763 4519 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39098:
name: "rebalance_test_table_6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:53:17.515712 4687 tablet_service.cc:1511] Processing CreateTablet for tablet 242a68df09cb4c7d9522a33d259ebf78 (DEFAULT_TABLE table=rebalance_test_table_6 [id=6008038c907645199b055dacb5772621]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:17.516252 4687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242a68df09cb4c7d9522a33d259ebf78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:17.516522 4865 tablet_service.cc:1511] Processing CreateTablet for tablet 242a68df09cb4c7d9522a33d259ebf78 (DEFAULT_TABLE table=rebalance_test_table_6 [id=6008038c907645199b055dacb5772621]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:17.517009 4865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242a68df09cb4c7d9522a33d259ebf78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:17.518910 5220 tablet_service.cc:1511] Processing CreateTablet for tablet 242a68df09cb4c7d9522a33d259ebf78 (DEFAULT_TABLE table=rebalance_test_table_6 [id=6008038c907645199b055dacb5772621]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:17.519459 5220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242a68df09cb4c7d9522a33d259ebf78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:17.521404 5214 tablet_service.cc:1511] Processing CreateTablet for tablet 966ebd287fc14e498e5bd3e6542194ca (DEFAULT_TABLE table=rebalance_test_table_6 [id=6008038c907645199b055dacb5772621]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:17.521680 5038 tablet_service.cc:1511] Processing CreateTablet for tablet ffa98a163d7540e3a911a39334657138 (DEFAULT_TABLE table=rebalance_test_table_6 [id=6008038c907645199b055dacb5772621]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:17.521893 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 966ebd287fc14e498e5bd3e6542194ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:17.522158 5038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa98a163d7540e3a911a39334657138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:17.523067 4688 tablet_service.cc:1511] Processing CreateTablet for tablet ffa98a163d7540e3a911a39334657138 (DEFAULT_TABLE table=rebalance_test_table_6 [id=6008038c907645199b055dacb5772621]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:17.523442 4688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa98a163d7540e3a911a39334657138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:17.523571 5216 tablet_service.cc:1511] Processing CreateTablet for tablet ffa98a163d7540e3a911a39334657138 (DEFAULT_TABLE table=rebalance_test_table_6 [id=6008038c907645199b055dacb5772621]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:17.523977 5216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa98a163d7540e3a911a39334657138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:17.525715 4686 tablet_service.cc:1511] Processing CreateTablet for tablet 966ebd287fc14e498e5bd3e6542194ca (DEFAULT_TABLE table=rebalance_test_table_6 [id=6008038c907645199b055dacb5772621]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:17.526139 4686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 966ebd287fc14e498e5bd3e6542194ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:17.531867 4863 tablet_service.cc:1511] Processing CreateTablet for tablet 966ebd287fc14e498e5bd3e6542194ca (DEFAULT_TABLE table=rebalance_test_table_6 [id=6008038c907645199b055dacb5772621]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:17.532423 4863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 966ebd287fc14e498e5bd3e6542194ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:17.538530 6670 tablet_bootstrap.cc:492] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:53:17.540961 6670 tablet_bootstrap.cc:654] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:17.545292 6671 tablet_bootstrap.cc:492] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:53:17.548897 6671 tablet_bootstrap.cc:654] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:17.554368 6674 tablet_bootstrap.cc:492] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:53:17.557605 6674 tablet_bootstrap.cc:654] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:17.558013 6669 tablet_bootstrap.cc:492] T 242a68df09cb4c7d9522a33d259ebf78 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:53:17.559981 6669 tablet_bootstrap.cc:654] T 242a68df09cb4c7d9522a33d259ebf78 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:17.562022 6671 tablet_bootstrap.cc:492] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179: No bootstrap required, opened a new log
I20260807 13:53:17.562219 6671 ts_tablet_manager.cc:1403] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.005s
I20260807 13:53:17.562436 6669 tablet_bootstrap.cc:492] T 242a68df09cb4c7d9522a33d259ebf78 P fa83b7af134b4e3b949ac3b4e4bcb5e7: No bootstrap required, opened a new log
I20260807 13:53:17.562605 6669 ts_tablet_manager.cc:1403] T 242a68df09cb4c7d9522a33d259ebf78 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 13:53:17.563205 6671 raft_consensus.cc:359] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:17.563437 6671 raft_consensus.cc:385] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:17.563313 6669 raft_consensus.cc:359] T 242a68df09cb4c7d9522a33d259ebf78 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:17.563544 6669 raft_consensus.cc:385] T 242a68df09cb4c7d9522a33d259ebf78 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:17.563551 6671 raft_consensus.cc:740] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:53:17.563632 6669 raft_consensus.cc:740] T 242a68df09cb4c7d9522a33d259ebf78 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:53:17.563817 6671 consensus_queue.cc:260] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:17.563910 6669 consensus_queue.cc:260] T 242a68df09cb4c7d9522a33d259ebf78 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:17.564396 6671 ts_tablet_manager.cc:1434] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260807 13:53:17.565303 6669 ts_tablet_manager.cc:1434] T 242a68df09cb4c7d9522a33d259ebf78 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:53:17.565634 6669 tablet_bootstrap.cc:492] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:53:17.567245 6669 tablet_bootstrap.cc:654] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:17.569065 6674 tablet_bootstrap.cc:492] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: No bootstrap required, opened a new log
I20260807 13:53:17.569227 6674 ts_tablet_manager.cc:1403] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.007s
I20260807 13:53:17.569579 6669 tablet_bootstrap.cc:492] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7: No bootstrap required, opened a new log
I20260807 13:53:17.569728 6669 ts_tablet_manager.cc:1403] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260807 13:53:17.569969 6670 tablet_bootstrap.cc:492] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915: No bootstrap required, opened a new log
I20260807 13:53:17.570127 6670 ts_tablet_manager.cc:1403] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.005s
I20260807 13:53:17.570559 6669 raft_consensus.cc:359] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:17.570747 6669 raft_consensus.cc:385] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:17.570819 6669 raft_consensus.cc:740] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:53:17.570964 6670 raft_consensus.cc:359] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:17.571159 6670 raft_consensus.cc:385] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:17.571128 6669 consensus_queue.cc:260] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:17.571247 6670 raft_consensus.cc:740] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:53:17.571475 6670 consensus_queue.cc:260] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:17.571795 6669 ts_tablet_manager.cc:1434] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:53:17.572029 6670 ts_tablet_manager.cc:1434] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 13:53:17.572120 6669 tablet_bootstrap.cc:492] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:53:17.573112 6674 raft_consensus.cc:359] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:17.573302 6674 raft_consensus.cc:385] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:17.573442 6674 raft_consensus.cc:740] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:53:17.573693 6674 consensus_queue.cc:260] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:17.574951 6669 tablet_bootstrap.cc:654] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:17.575183 6674 ts_tablet_manager.cc:1434] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260807 13:53:17.575495 6674 tablet_bootstrap.cc:492] T 242a68df09cb4c7d9522a33d259ebf78 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:53:17.577816 6674 tablet_bootstrap.cc:654] T 242a68df09cb4c7d9522a33d259ebf78 P c9d2944272bc447dafce7620ac2dbd4b: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:17.580215 6671 tablet_bootstrap.cc:492] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:53:17.582348 6671 tablet_bootstrap.cc:654] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:17.588551 6674 tablet_bootstrap.cc:492] T 242a68df09cb4c7d9522a33d259ebf78 P c9d2944272bc447dafce7620ac2dbd4b: No bootstrap required, opened a new log
I20260807 13:53:17.588869 6674 ts_tablet_manager.cc:1403] T 242a68df09cb4c7d9522a33d259ebf78 P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.000s
I20260807 13:53:17.590126 6674 raft_consensus.cc:359] T 242a68df09cb4c7d9522a33d259ebf78 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:17.590549 6674 raft_consensus.cc:385] T 242a68df09cb4c7d9522a33d259ebf78 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:17.590714 6674 raft_consensus.cc:740] T 242a68df09cb4c7d9522a33d259ebf78 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:53:17.591174 6674 consensus_queue.cc:260] T 242a68df09cb4c7d9522a33d259ebf78 P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:17.592120 6674 ts_tablet_manager.cc:1434] T 242a68df09cb4c7d9522a33d259ebf78 P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:53:17.598253 6671 tablet_bootstrap.cc:492] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179: No bootstrap required, opened a new log
I20260807 13:53:17.598501 6671 ts_tablet_manager.cc:1403] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.011s
I20260807 13:53:17.599665 6671 raft_consensus.cc:359] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:17.599958 6671 raft_consensus.cc:385] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:17.600063 6671 raft_consensus.cc:740] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:53:17.600358 6671 consensus_queue.cc:260] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:17.601960 6671 ts_tablet_manager.cc:1434] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260807 13:53:17.602365 6671 tablet_bootstrap.cc:492] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:53:17.604785 6671 tablet_bootstrap.cc:654] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:17.610083 6669 tablet_bootstrap.cc:492] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: No bootstrap required, opened a new log
I20260807 13:53:17.610266 6669 ts_tablet_manager.cc:1403] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.038s user 0.009s sys 0.000s
I20260807 13:53:17.611029 6669 raft_consensus.cc:359] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:17.611126 6671 tablet_bootstrap.cc:492] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179: No bootstrap required, opened a new log
I20260807 13:53:17.611236 6669 raft_consensus.cc:385] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:17.611323 6671 ts_tablet_manager.cc:1403] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260807 13:53:17.611338 6669 raft_consensus.cc:740] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:53:17.611665 6669 consensus_queue.cc:260] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:17.612138 6669 ts_tablet_manager.cc:1434] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:53:17.612159 6671 raft_consensus.cc:359] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:17.612452 6671 raft_consensus.cc:385] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:17.612560 6671 raft_consensus.cc:740] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:53:17.612819 6671 consensus_queue.cc:260] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:17.613451 6671 ts_tablet_manager.cc:1434] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260807 13:53:17.626271 6137 raft_consensus.cc:493] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:17.626441 6137 raft_consensus.cc:515] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:17.627115 6137 leader_election.cc:290] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:53:17.627627 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "966ebd287fc14e498e5bd3e6542194ca" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179" is_pre_election: true
I20260807 13:53:17.627746 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "966ebd287fc14e498e5bd3e6542194ca" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b" is_pre_election: true
I20260807 13:53:17.627902 5248 raft_consensus.cc:2468] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 0.
I20260807 13:53:17.627972 4897 raft_consensus.cc:2468] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 0.
I20260807 13:53:17.628499 4632 leader_election.cc:304] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: c9d2944272bc447dafce7620ac2dbd4b, edf940ebcc1140cfa0c23214e0c0f179, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:17.628827 6137 raft_consensus.cc:2804] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:17.628964 6137 raft_consensus.cc:493] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:17.629079 6137 raft_consensus.cc:3060] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:17.631273 6137 raft_consensus.cc:515] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:17.632459 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "966ebd287fc14e498e5bd3e6542194ca" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179"
I20260807 13:53:17.632555 6137 leader_election.cc:290] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 election: Requested vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:53:17.632529 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "966ebd287fc14e498e5bd3e6542194ca" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
I20260807 13:53:17.632704 5248 raft_consensus.cc:3060] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:17.632762 4897 raft_consensus.cc:3060] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:17.635275 4897 raft_consensus.cc:2468] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 1.
I20260807 13:53:17.635360 5248 raft_consensus.cc:2468] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 1.
I20260807 13:53:17.635821 4631 leader_election.cc:304] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:17.636162 6137 raft_consensus.cc:2804] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:17.636579 6137 raft_consensus.cc:697] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Becoming Leader. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Running, Role: LEADER
I20260807 13:53:17.636904 6137 consensus_queue.cc:237] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:17.639858 4519 catalog_manager.cc:5697] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129). New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:53:17.655135 6567 raft_consensus.cc:493] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:17.655370 6567 raft_consensus.cc:515] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:17.656152 6567 leader_election.cc:290] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:17.656811 4716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa98a163d7540e3a911a39334657138" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" is_pre_election: true
I20260807 13:53:17.656900 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa98a163d7540e3a911a39334657138" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179" is_pre_election: true
I20260807 13:53:17.657109 5248 raft_consensus.cc:2468] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 0.
I20260807 13:53:17.657109 4716 raft_consensus.cc:2468] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 0.
I20260807 13:53:17.657641 4982 leader_election.cc:304] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, edf940ebcc1140cfa0c23214e0c0f179; no voters:
I20260807 13:53:17.657959 6567 raft_consensus.cc:2804] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:17.658095 6567 raft_consensus.cc:493] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:17.658212 6567 raft_consensus.cc:3060] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:17.660298 6567 raft_consensus.cc:515] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:17.660974 6567 leader_election.cc:290] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 election: Requested vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:17.661538 4716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa98a163d7540e3a911a39334657138" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
I20260807 13:53:17.661748 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa98a163d7540e3a911a39334657138" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179"
I20260807 13:53:17.661792 4716 raft_consensus.cc:3060] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:17.661971 5248 raft_consensus.cc:3060] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:17.663908 4716 raft_consensus.cc:2468] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 1.
I20260807 13:53:17.664048 5248 raft_consensus.cc:2468] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 1.
I20260807 13:53:17.664413 4982 leader_election.cc:304] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:17.664723 6567 raft_consensus.cc:2804] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:17.665277 6567 raft_consensus.cc:697] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Becoming Leader. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Running, Role: LEADER
I20260807 13:53:17.665830 6567 consensus_queue.cc:237] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:17.669205 4519 catalog_manager.cc:5697] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01adf83af3e04875b5fac9470d4da915 (127.23.107.131). New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:53:17.786547 6683 raft_consensus.cc:493] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:17.786774 6683 raft_consensus.cc:515] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:17.787730 6683 leader_election.cc:290] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:53:17.788137 4716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a68df09cb4c7d9522a33d259ebf78" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" is_pre_election: true
I20260807 13:53:17.788270 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a68df09cb4c7d9522a33d259ebf78" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b" is_pre_election: true
I20260807 13:53:17.788383 4716 raft_consensus.cc:2468] T 242a68df09cb4c7d9522a33d259ebf78 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 0.
I20260807 13:53:17.788563 4897 raft_consensus.cc:2468] T 242a68df09cb4c7d9522a33d259ebf78 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 0.
I20260807 13:53:17.788899 5154 leader_election.cc:304] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edf940ebcc1140cfa0c23214e0c0f179, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:17.789206 6683 raft_consensus.cc:2804] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:17.789333 6683 raft_consensus.cc:493] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:17.789469 6683 raft_consensus.cc:3060] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:17.791678 6683 raft_consensus.cc:515] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:17.792248 6683 leader_election.cc:290] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 election: Requested vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:53:17.792742 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a68df09cb4c7d9522a33d259ebf78" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
I20260807 13:53:17.792759 4716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a68df09cb4c7d9522a33d259ebf78" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
I20260807 13:53:17.792951 4716 raft_consensus.cc:3060] T 242a68df09cb4c7d9522a33d259ebf78 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:17.792971 4897 raft_consensus.cc:3060] T 242a68df09cb4c7d9522a33d259ebf78 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:17.794955 4897 raft_consensus.cc:2468] T 242a68df09cb4c7d9522a33d259ebf78 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 1.
I20260807 13:53:17.795046 4716 raft_consensus.cc:2468] T 242a68df09cb4c7d9522a33d259ebf78 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 1.
I20260807 13:53:17.795435 5153 leader_election.cc:304] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9d2944272bc447dafce7620ac2dbd4b, edf940ebcc1140cfa0c23214e0c0f179; no voters:
I20260807 13:53:17.795782 6683 raft_consensus.cc:2804] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:17.795936 6683 raft_consensus.cc:697] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Becoming Leader. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Running, Role: LEADER
I20260807 13:53:17.796250 6683 consensus_queue.cc:237] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:17.799192 4519 catalog_manager.cc:5697] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: term changed from 0 to 1, leader changed from <none> to edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132). New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:53:18.072690 6567 consensus_queue.cc:1048] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:18.089150 6699 consensus_queue.cc:1048] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:18.174630 6570 consensus_queue.cc:1048] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:18.180495 6706 consensus_queue.cc:1048] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:18.198999 6137 consensus_queue.cc:1048] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:18.205147 6712 consensus_queue.cc:1048] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:53:18.248117 6693 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:18.248478 6693 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_6'
INSERT report
rows total: 2000
time total: 259.219 ms
time per row: 0.129609 ms
I20260807 13:53:18.728014 4517 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39098:
name: "rebalance_test_table_7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:53:18.738020 4687 tablet_service.cc:1511] Processing CreateTablet for tablet d02aa7a26c024b4083421b5d742f7bcb (DEFAULT_TABLE table=rebalance_test_table_7 [id=2ff801ea568346e096cc895a279c109c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:18.738020 5038 tablet_service.cc:1511] Processing CreateTablet for tablet d02aa7a26c024b4083421b5d742f7bcb (DEFAULT_TABLE table=rebalance_test_table_7 [id=2ff801ea568346e096cc895a279c109c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:18.738541 5038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d02aa7a26c024b4083421b5d742f7bcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:18.738534 4687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d02aa7a26c024b4083421b5d742f7bcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:18.738749 5037 tablet_service.cc:1511] Processing CreateTablet for tablet 522c3523f2af4eb29e30fa55da2acd3e (DEFAULT_TABLE table=rebalance_test_table_7 [id=2ff801ea568346e096cc895a279c109c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:18.739219 5037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522c3523f2af4eb29e30fa55da2acd3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:18.740782 5039 tablet_service.cc:1511] Processing CreateTablet for tablet eab259b597a64c04869543ccb1d9038c (DEFAULT_TABLE table=rebalance_test_table_7 [id=2ff801ea568346e096cc895a279c109c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:18.741183 5039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eab259b597a64c04869543ccb1d9038c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:18.745645 5214 tablet_service.cc:1511] Processing CreateTablet for tablet 522c3523f2af4eb29e30fa55da2acd3e (DEFAULT_TABLE table=rebalance_test_table_7 [id=2ff801ea568346e096cc895a279c109c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:18.745667 5216 tablet_service.cc:1511] Processing CreateTablet for tablet eab259b597a64c04869543ccb1d9038c (DEFAULT_TABLE table=rebalance_test_table_7 [id=2ff801ea568346e096cc895a279c109c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:18.746110 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522c3523f2af4eb29e30fa55da2acd3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:18.746345 5216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eab259b597a64c04869543ccb1d9038c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:18.749522 4688 tablet_service.cc:1511] Processing CreateTablet for tablet 522c3523f2af4eb29e30fa55da2acd3e (DEFAULT_TABLE table=rebalance_test_table_7 [id=2ff801ea568346e096cc895a279c109c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:18.749979 4688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522c3523f2af4eb29e30fa55da2acd3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:18.754277 6777 tablet_bootstrap.cc:492] T eab259b597a64c04869543ccb1d9038c P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:53:18.754482 4865 tablet_service.cc:1511] Processing CreateTablet for tablet eab259b597a64c04869543ccb1d9038c (DEFAULT_TABLE table=rebalance_test_table_7 [id=2ff801ea568346e096cc895a279c109c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:18.754570 4863 tablet_service.cc:1511] Processing CreateTablet for tablet d02aa7a26c024b4083421b5d742f7bcb (DEFAULT_TABLE table=rebalance_test_table_7 [id=2ff801ea568346e096cc895a279c109c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:18.754932 4865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eab259b597a64c04869543ccb1d9038c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:18.755198 4863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d02aa7a26c024b4083421b5d742f7bcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:18.756440 6777 tablet_bootstrap.cc:654] T eab259b597a64c04869543ccb1d9038c P edf940ebcc1140cfa0c23214e0c0f179: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:18.764489 6780 tablet_bootstrap.cc:492] T eab259b597a64c04869543ccb1d9038c P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:53:18.765534 6779 tablet_bootstrap.cc:492] T 522c3523f2af4eb29e30fa55da2acd3e P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:53:18.767133 6777 tablet_bootstrap.cc:492] T eab259b597a64c04869543ccb1d9038c P edf940ebcc1140cfa0c23214e0c0f179: No bootstrap required, opened a new log
I20260807 13:53:18.767357 6777 ts_tablet_manager.cc:1403] T eab259b597a64c04869543ccb1d9038c P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.006s
I20260807 13:53:18.768054 6779 tablet_bootstrap.cc:654] T 522c3523f2af4eb29e30fa55da2acd3e P fa83b7af134b4e3b949ac3b4e4bcb5e7: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:18.768296 6777 raft_consensus.cc:359] T eab259b597a64c04869543ccb1d9038c P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:18.768487 6777 raft_consensus.cc:385] T eab259b597a64c04869543ccb1d9038c P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:18.768607 6777 raft_consensus.cc:740] T eab259b597a64c04869543ccb1d9038c P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:53:18.768859 6777 consensus_queue.cc:260] T eab259b597a64c04869543ccb1d9038c P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:18.770330 6777 ts_tablet_manager.cc:1434] T eab259b597a64c04869543ccb1d9038c P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260807 13:53:18.770654 6777 tablet_bootstrap.cc:492] T 522c3523f2af4eb29e30fa55da2acd3e P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:53:18.772454 6777 tablet_bootstrap.cc:654] T 522c3523f2af4eb29e30fa55da2acd3e P edf940ebcc1140cfa0c23214e0c0f179: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:18.774658 6780 tablet_bootstrap.cc:654] T eab259b597a64c04869543ccb1d9038c P c9d2944272bc447dafce7620ac2dbd4b: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:18.776728 6779 tablet_bootstrap.cc:492] T 522c3523f2af4eb29e30fa55da2acd3e P fa83b7af134b4e3b949ac3b4e4bcb5e7: No bootstrap required, opened a new log
I20260807 13:53:18.776932 6779 ts_tablet_manager.cc:1403] T 522c3523f2af4eb29e30fa55da2acd3e P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20260807 13:53:18.777855 6779 raft_consensus.cc:359] T 522c3523f2af4eb29e30fa55da2acd3e P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:18.778059 6779 raft_consensus.cc:385] T 522c3523f2af4eb29e30fa55da2acd3e P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:18.778204 6779 raft_consensus.cc:740] T 522c3523f2af4eb29e30fa55da2acd3e P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:53:18.778496 6779 consensus_queue.cc:260] T 522c3523f2af4eb29e30fa55da2acd3e P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:18.779064 6779 ts_tablet_manager.cc:1434] T 522c3523f2af4eb29e30fa55da2acd3e P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:53:18.779482 6779 tablet_bootstrap.cc:492] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:53:18.780860 6776 tablet_bootstrap.cc:492] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:53:18.781850 6779 tablet_bootstrap.cc:654] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:18.789897 6780 tablet_bootstrap.cc:492] T eab259b597a64c04869543ccb1d9038c P c9d2944272bc447dafce7620ac2dbd4b: No bootstrap required, opened a new log
I20260807 13:53:18.789937 6777 tablet_bootstrap.cc:492] T 522c3523f2af4eb29e30fa55da2acd3e P edf940ebcc1140cfa0c23214e0c0f179: No bootstrap required, opened a new log
I20260807 13:53:18.789942 6779 tablet_bootstrap.cc:492] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7: No bootstrap required, opened a new log
I20260807 13:53:18.790108 6779 ts_tablet_manager.cc:1403] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260807 13:53:18.790156 6777 ts_tablet_manager.cc:1403] T 522c3523f2af4eb29e30fa55da2acd3e P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.004s
I20260807 13:53:18.790228 6780 ts_tablet_manager.cc:1403] T eab259b597a64c04869543ccb1d9038c P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.026s user 0.008s sys 0.001s
I20260807 13:53:18.791007 6777 raft_consensus.cc:359] T 522c3523f2af4eb29e30fa55da2acd3e P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:18.791009 6779 raft_consensus.cc:359] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:18.791263 6779 raft_consensus.cc:385] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:18.791330 6777 raft_consensus.cc:385] T 522c3523f2af4eb29e30fa55da2acd3e P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:18.791393 6779 raft_consensus.cc:740] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:53:18.791692 6777 raft_consensus.cc:740] T 522c3523f2af4eb29e30fa55da2acd3e P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:53:18.791692 6779 consensus_queue.cc:260] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:18.792094 6777 consensus_queue.cc:260] T 522c3523f2af4eb29e30fa55da2acd3e P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:18.791081 6780 raft_consensus.cc:359] T eab259b597a64c04869543ccb1d9038c P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:18.792718 6780 raft_consensus.cc:385] T eab259b597a64c04869543ccb1d9038c P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:18.792879 6780 raft_consensus.cc:740] T eab259b597a64c04869543ccb1d9038c P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:53:18.793322 6776 tablet_bootstrap.cc:654] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:18.793217 6780 consensus_queue.cc:260] T eab259b597a64c04869543ccb1d9038c P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:18.793497 6777 ts_tablet_manager.cc:1434] T 522c3523f2af4eb29e30fa55da2acd3e P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260807 13:53:18.793938 6780 ts_tablet_manager.cc:1434] T eab259b597a64c04869543ccb1d9038c P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260807 13:53:18.794220 6780 tablet_bootstrap.cc:492] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:53:18.796272 6780 tablet_bootstrap.cc:654] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:18.796535 6779 ts_tablet_manager.cc:1434] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260807 13:53:18.802452 6780 tablet_bootstrap.cc:492] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b: No bootstrap required, opened a new log
I20260807 13:53:18.802650 6780 ts_tablet_manager.cc:1403] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.002s
I20260807 13:53:18.803473 6780 raft_consensus.cc:359] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:18.803759 6780 raft_consensus.cc:385] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:18.803875 6780 raft_consensus.cc:740] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:53:18.804167 6780 consensus_queue.cc:260] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:18.804755 6780 ts_tablet_manager.cc:1434] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260807 13:53:18.805579 6776 tablet_bootstrap.cc:492] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915: No bootstrap required, opened a new log
I20260807 13:53:18.805734 6776 ts_tablet_manager.cc:1403] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.007s
I20260807 13:53:18.806555 6776 raft_consensus.cc:359] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:18.806777 6776 raft_consensus.cc:385] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:18.806869 6776 raft_consensus.cc:740] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:53:18.807096 6776 consensus_queue.cc:260] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:18.807780 6776 ts_tablet_manager.cc:1434] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:53:18.808075 6776 tablet_bootstrap.cc:492] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:53:18.810161 6776 tablet_bootstrap.cc:654] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:18.812498 6776 tablet_bootstrap.cc:492] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915: No bootstrap required, opened a new log
I20260807 13:53:18.812671 6776 ts_tablet_manager.cc:1403] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 13:53:18.813257 6776 raft_consensus.cc:359] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:18.813519 6776 raft_consensus.cc:385] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:18.813621 6776 raft_consensus.cc:740] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:53:18.813848 6776 consensus_queue.cc:260] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:18.814325 6776 ts_tablet_manager.cc:1434] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260807 13:53:18.814707 6776 tablet_bootstrap.cc:492] T d02aa7a26c024b4083421b5d742f7bcb P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:53:18.816169 6776 tablet_bootstrap.cc:654] T d02aa7a26c024b4083421b5d742f7bcb P 01adf83af3e04875b5fac9470d4da915: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:18.818789 6776 tablet_bootstrap.cc:492] T d02aa7a26c024b4083421b5d742f7bcb P 01adf83af3e04875b5fac9470d4da915: No bootstrap required, opened a new log
I20260807 13:53:18.818943 6776 ts_tablet_manager.cc:1403] T d02aa7a26c024b4083421b5d742f7bcb P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20260807 13:53:18.819545 6776 raft_consensus.cc:359] T d02aa7a26c024b4083421b5d742f7bcb P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:18.819681 6776 raft_consensus.cc:385] T d02aa7a26c024b4083421b5d742f7bcb P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:18.819798 6776 raft_consensus.cc:740] T d02aa7a26c024b4083421b5d742f7bcb P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:53:18.820026 6776 consensus_queue.cc:260] T d02aa7a26c024b4083421b5d742f7bcb P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:18.820592 6776 ts_tablet_manager.cc:1434] T d02aa7a26c024b4083421b5d742f7bcb P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 13:53:18.908735 6699 raft_consensus.cc:493] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:18.908963 6699 raft_consensus.cc:515] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:18.909749 6699 leader_election.cc:290] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:18.910225 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab259b597a64c04869543ccb1d9038c" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b" is_pre_election: true
I20260807 13:53:18.910400 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab259b597a64c04869543ccb1d9038c" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179" is_pre_election: true
I20260807 13:53:18.910475 4897 raft_consensus.cc:2468] T eab259b597a64c04869543ccb1d9038c P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 0.
I20260807 13:53:18.910672 5248 raft_consensus.cc:2468] T eab259b597a64c04869543ccb1d9038c P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 0.
I20260807 13:53:18.910967 4981 leader_election.cc:304] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, c9d2944272bc447dafce7620ac2dbd4b; no voters:
I20260807 13:53:18.911336 6699 raft_consensus.cc:2804] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:18.911470 6699 raft_consensus.cc:493] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:18.911607 6699 raft_consensus.cc:3060] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:18.913019 6496 raft_consensus.cc:493] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:18.913146 6496 raft_consensus.cc:515] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:18.913942 6496 leader_election.cc:290] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:53:18.913975 6699 raft_consensus.cc:515] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:18.914546 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02aa7a26c024b4083421b5d742f7bcb" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915" is_pre_election: true
I20260807 13:53:18.914601 4718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02aa7a26c024b4083421b5d742f7bcb" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" is_pre_election: true
I20260807 13:53:18.914656 6699 leader_election.cc:290] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 election: Requested vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:18.914812 5074 raft_consensus.cc:2468] T d02aa7a26c024b4083421b5d742f7bcb P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 0.
I20260807 13:53:18.914832 4718 raft_consensus.cc:2468] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 0.
I20260807 13:53:18.915313 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab259b597a64c04869543ccb1d9038c" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179"
I20260807 13:53:18.915402 4806 leader_election.cc:304] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:18.915540 5248 raft_consensus.cc:3060] T eab259b597a64c04869543ccb1d9038c P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:18.915377 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab259b597a64c04869543ccb1d9038c" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
I20260807 13:53:18.915746 4897 raft_consensus.cc:3060] T eab259b597a64c04869543ccb1d9038c P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:18.917563 6496 raft_consensus.cc:2804] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:18.917709 6496 raft_consensus.cc:493] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:18.917824 6496 raft_consensus.cc:3060] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:18.918854 5248 raft_consensus.cc:2468] T eab259b597a64c04869543ccb1d9038c P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 1.
I20260807 13:53:18.918890 4897 raft_consensus.cc:2468] T eab259b597a64c04869543ccb1d9038c P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 1.
I20260807 13:53:18.919294 4981 leader_election.cc:304] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, c9d2944272bc447dafce7620ac2dbd4b; no voters:
I20260807 13:53:18.919626 6699 raft_consensus.cc:2804] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:18.919826 6699 raft_consensus.cc:697] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Becoming Leader. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Running, Role: LEADER
I20260807 13:53:18.920095 6699 consensus_queue.cc:237] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:18.920405 6496 raft_consensus.cc:515] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:18.921096 6496 leader_election.cc:290] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 election: Requested vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:53:18.921543 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02aa7a26c024b4083421b5d742f7bcb" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915"
I20260807 13:53:18.921749 5074 raft_consensus.cc:3060] T d02aa7a26c024b4083421b5d742f7bcb P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:18.923779 4718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02aa7a26c024b4083421b5d742f7bcb" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
I20260807 13:53:18.924014 4718 raft_consensus.cc:3060] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:18.926429 4718 raft_consensus.cc:2468] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 1.
I20260807 13:53:18.926940 4806 leader_election.cc:304] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:18.927407 6496 raft_consensus.cc:2804] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:18.927924 5074 raft_consensus.cc:2468] T d02aa7a26c024b4083421b5d742f7bcb P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9d2944272bc447dafce7620ac2dbd4b in term 1.
I20260807 13:53:18.927949 6496 raft_consensus.cc:697] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Becoming Leader. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Running, Role: LEADER
I20260807 13:53:18.928383 6496 consensus_queue.cc:237] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:53:18.931864 4519 catalog_manager.cc:5697] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: term changed from 0 to 1, leader changed from <none> to c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130). New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:53:18.931906 4517 catalog_manager.cc:5697] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01adf83af3e04875b5fac9470d4da915 (127.23.107.131). New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:53:18.948544 6699 raft_consensus.cc:493] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:18.948761 6699 raft_consensus.cc:515] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:18.949563 6699 leader_election.cc:290] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:18.950196 4718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c3523f2af4eb29e30fa55da2acd3e" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" is_pre_election: true
I20260807 13:53:18.950196 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c3523f2af4eb29e30fa55da2acd3e" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179" is_pre_election: true
I20260807 13:53:18.950434 5248 raft_consensus.cc:2468] T 522c3523f2af4eb29e30fa55da2acd3e P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 0.
I20260807 13:53:18.950433 4718 raft_consensus.cc:2468] T 522c3523f2af4eb29e30fa55da2acd3e P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 0.
I20260807 13:53:18.950871 4982 leader_election.cc:304] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, edf940ebcc1140cfa0c23214e0c0f179; no voters:
I20260807 13:53:18.951141 6699 raft_consensus.cc:2804] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:18.951284 6699 raft_consensus.cc:493] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:18.951400 6699 raft_consensus.cc:3060] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:18.953493 6699 raft_consensus.cc:515] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:18.954023 6699 leader_election.cc:290] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 election: Requested vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:18.954591 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c3523f2af4eb29e30fa55da2acd3e" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179"
I20260807 13:53:18.954591 4718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c3523f2af4eb29e30fa55da2acd3e" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
I20260807 13:53:18.954797 5248 raft_consensus.cc:3060] T 522c3523f2af4eb29e30fa55da2acd3e P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:18.954815 4718 raft_consensus.cc:3060] T 522c3523f2af4eb29e30fa55da2acd3e P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:18.957892 5248 raft_consensus.cc:2468] T 522c3523f2af4eb29e30fa55da2acd3e P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 1.
I20260807 13:53:18.957893 4718 raft_consensus.cc:2468] T 522c3523f2af4eb29e30fa55da2acd3e P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 1.
I20260807 13:53:18.958348 4982 leader_election.cc:304] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, edf940ebcc1140cfa0c23214e0c0f179; no voters:
I20260807 13:53:18.958655 6699 raft_consensus.cc:2804] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:18.958809 6699 raft_consensus.cc:697] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Becoming Leader. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Running, Role: LEADER
I20260807 13:53:18.959081 6699 consensus_queue.cc:237] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:18.962378 4517 catalog_manager.cc:5697] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01adf83af3e04875b5fac9470d4da915 (127.23.107.131). New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:53:19.306660 6496 consensus_queue.cc:1048] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:19.323109 6699 consensus_queue.cc:1048] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:19.325580 6792 consensus_queue.cc:1048] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:19.333431 6689 consensus_queue.cc:1048] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:19.363355 6689 consensus_queue.cc:1048] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:19.378544 6699 consensus_queue.cc:1048] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:53:19.463944 6796 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:19.464494 6796 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_7'
INSERT report
rows total: 2000
time total: 228.191 ms
time per row: 0.114096 ms
I20260807 13:53:19.872488 4518 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39098:
name: "rebalance_test_table_8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:53:19.882875 4688 tablet_service.cc:1511] Processing CreateTablet for tablet faef317e47a244c6965864f82f21edfa (DEFAULT_TABLE table=rebalance_test_table_8 [id=91303cf8b9064e06b8c4165942b287f2]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:19.883428 4688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faef317e47a244c6965864f82f21edfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:19.883375 4863 tablet_service.cc:1511] Processing CreateTablet for tablet faef317e47a244c6965864f82f21edfa (DEFAULT_TABLE table=rebalance_test_table_8 [id=91303cf8b9064e06b8c4165942b287f2]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:19.883874 4863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faef317e47a244c6965864f82f21edfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:19.885298 5216 tablet_service.cc:1511] Processing CreateTablet for tablet 50a090faa58e4f91961c9251030efacf (DEFAULT_TABLE table=rebalance_test_table_8 [id=91303cf8b9064e06b8c4165942b287f2]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:19.885887 5216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a090faa58e4f91961c9251030efacf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:19.886551 5214 tablet_service.cc:1511] Processing CreateTablet for tablet 04dac80fea124c25b34af8cc290c0d7f (DEFAULT_TABLE table=rebalance_test_table_8 [id=91303cf8b9064e06b8c4165942b287f2]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:19.886942 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04dac80fea124c25b34af8cc290c0d7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:19.889808 5037 tablet_service.cc:1511] Processing CreateTablet for tablet faef317e47a244c6965864f82f21edfa (DEFAULT_TABLE table=rebalance_test_table_8 [id=91303cf8b9064e06b8c4165942b287f2]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:19.890264 5037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faef317e47a244c6965864f82f21edfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:19.893783 4865 tablet_service.cc:1511] Processing CreateTablet for tablet 50a090faa58e4f91961c9251030efacf (DEFAULT_TABLE table=rebalance_test_table_8 [id=91303cf8b9064e06b8c4165942b287f2]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:19.894204 4865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a090faa58e4f91961c9251030efacf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:19.894913 5038 tablet_service.cc:1511] Processing CreateTablet for tablet 04dac80fea124c25b34af8cc290c0d7f (DEFAULT_TABLE table=rebalance_test_table_8 [id=91303cf8b9064e06b8c4165942b287f2]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:19.895423 5038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04dac80fea124c25b34af8cc290c0d7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:19.898522 4687 tablet_service.cc:1511] Processing CreateTablet for tablet 50a090faa58e4f91961c9251030efacf (DEFAULT_TABLE table=rebalance_test_table_8 [id=91303cf8b9064e06b8c4165942b287f2]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:19.898753 4686 tablet_service.cc:1511] Processing CreateTablet for tablet 04dac80fea124c25b34af8cc290c0d7f (DEFAULT_TABLE table=rebalance_test_table_8 [id=91303cf8b9064e06b8c4165942b287f2]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:19.899060 4687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a090faa58e4f91961c9251030efacf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:19.899276 4686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04dac80fea124c25b34af8cc290c0d7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:19.917104 6875 tablet_bootstrap.cc:492] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:53:19.919723 6878 tablet_bootstrap.cc:492] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:53:19.921265 6875 tablet_bootstrap.cc:654] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:19.921380 6877 tablet_bootstrap.cc:492] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:53:19.922091 6878 tablet_bootstrap.cc:654] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:19.923094 6876 tablet_bootstrap.cc:492] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:53:19.923444 6877 tablet_bootstrap.cc:654] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:19.924813 6875 tablet_bootstrap.cc:492] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7: No bootstrap required, opened a new log
I20260807 13:53:19.925060 6875 ts_tablet_manager.cc:1403] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260807 13:53:19.925215 6876 tablet_bootstrap.cc:654] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:19.927714 6875 raft_consensus.cc:359] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:19.928038 6875 raft_consensus.cc:385] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:19.928194 6875 raft_consensus.cc:740] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:53:19.928889 6875 consensus_queue.cc:260] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:19.930670 6875 ts_tablet_manager.cc:1434] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260807 13:53:19.931016 6875 tablet_bootstrap.cc:492] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:53:19.931321 6878 tablet_bootstrap.cc:492] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b: No bootstrap required, opened a new log
I20260807 13:53:19.931445 6877 tablet_bootstrap.cc:492] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915: No bootstrap required, opened a new log
I20260807 13:53:19.931643 6877 ts_tablet_manager.cc:1403] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.005s
I20260807 13:53:19.932590 6877 raft_consensus.cc:359] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:19.932834 6877 raft_consensus.cc:385] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:19.932972 6877 raft_consensus.cc:740] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:53:19.933097 6875 tablet_bootstrap.cc:654] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:19.933413 6878 ts_tablet_manager.cc:1403] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.009s
I20260807 13:53:19.933254 6877 consensus_queue.cc:260] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:19.933982 6877 ts_tablet_manager.cc:1434] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:53:19.934337 6877 tablet_bootstrap.cc:492] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:53:19.935412 6878 raft_consensus.cc:359] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:19.935734 6878 raft_consensus.cc:385] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:19.935891 6878 raft_consensus.cc:740] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:53:19.936120 6877 tablet_bootstrap.cc:654] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:19.936908 6876 tablet_bootstrap.cc:492] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179: No bootstrap required, opened a new log
I20260807 13:53:19.937091 6876 ts_tablet_manager.cc:1403] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.003s
I20260807 13:53:19.938280 6876 raft_consensus.cc:359] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:19.938550 6876 raft_consensus.cc:385] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:19.938679 6876 raft_consensus.cc:740] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:53:19.939281 6876 consensus_queue.cc:260] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:19.940056 6878 consensus_queue.cc:260] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:19.940215 6876 ts_tablet_manager.cc:1434] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260807 13:53:19.943219 6878 ts_tablet_manager.cc:1434] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260807 13:53:19.943591 6878 tablet_bootstrap.cc:492] T faef317e47a244c6965864f82f21edfa P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:53:19.947973 6878 tablet_bootstrap.cc:654] T faef317e47a244c6965864f82f21edfa P c9d2944272bc447dafce7620ac2dbd4b: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:19.948050 6876 tablet_bootstrap.cc:492] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:53:19.950383 6800 raft_consensus.cc:493] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:19.950541 6876 tablet_bootstrap.cc:654] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:19.950573 6800 raft_consensus.cc:515] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:19.951496 6800 leader_election.cc:290] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:19.952634 5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a090faa58e4f91961c9251030efacf" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179" is_pre_election: true
W20260807 13:53:19.953832 4806 leader_election.cc:343] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:53:19.954696 4718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a090faa58e4f91961c9251030efacf" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" is_pre_election: true
W20260807 13:53:19.955637 4806 leader_election.cc:343] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:53:19.955819 4806 leader_election.cc:304] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9d2944272bc447dafce7620ac2dbd4b; no voters: edf940ebcc1140cfa0c23214e0c0f179, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:53:19.956302 6876 tablet_bootstrap.cc:492] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179: No bootstrap required, opened a new log
I20260807 13:53:19.956445 6800 raft_consensus.cc:2749] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:53:19.956543 6876 ts_tablet_manager.cc:1403] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260807 13:53:19.957755 6876 raft_consensus.cc:359] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:19.958020 6876 raft_consensus.cc:385] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:19.958120 6876 raft_consensus.cc:740] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:53:19.958528 6876 consensus_queue.cc:260] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:19.959362 6876 ts_tablet_manager.cc:1434] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 13:53:19.961473 6875 tablet_bootstrap.cc:492] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: No bootstrap required, opened a new log
I20260807 13:53:19.962373 6877 tablet_bootstrap.cc:492] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915: No bootstrap required, opened a new log
I20260807 13:53:19.962524 6875 ts_tablet_manager.cc:1403] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.031s user 0.009s sys 0.012s
I20260807 13:53:19.962559 6877 ts_tablet_manager.cc:1403] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.020s
I20260807 13:53:19.963416 6875 raft_consensus.cc:359] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:19.963459 6877 raft_consensus.cc:359] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:19.963636 6875 raft_consensus.cc:385] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:19.963722 6875 raft_consensus.cc:740] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:53:19.963732 6877 raft_consensus.cc:385] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:19.963815 6877 raft_consensus.cc:740] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:53:19.964015 6875 consensus_queue.cc:260] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:19.964102 6877 consensus_queue.cc:260] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:19.964638 6877 ts_tablet_manager.cc:1434] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260807 13:53:19.964864 6875 ts_tablet_manager.cc:1434] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:53:19.965185 6875 tablet_bootstrap.cc:492] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:53:19.965478 6802 raft_consensus.cc:493] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:19.965629 6802 raft_consensus.cc:515] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:19.966430 6802 leader_election.cc:290] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:19.966856 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faef317e47a244c6965864f82f21edfa" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b" is_pre_election: true
I20260807 13:53:19.967905 6875 tablet_bootstrap.cc:654] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: Neither blocks nor log segments found. Creating new log.
W20260807 13:53:19.968044 4631 leader_election.cc:343] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:53:19.968273 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faef317e47a244c6965864f82f21edfa" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915" is_pre_election: true
I20260807 13:53:19.968415 5074 raft_consensus.cc:2468] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 0.
I20260807 13:53:19.968914 4630 leader_election.cc:304] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters: c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:53:19.971206 6802 raft_consensus.cc:2804] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:19.971336 6802 raft_consensus.cc:493] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:19.971441 6802 raft_consensus.cc:3060] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:19.971555 6875 tablet_bootstrap.cc:492] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: No bootstrap required, opened a new log
I20260807 13:53:19.971710 6875 ts_tablet_manager.cc:1403] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260807 13:53:19.972518 6875 raft_consensus.cc:359] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:19.972707 6875 raft_consensus.cc:385] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:19.972810 6875 raft_consensus.cc:740] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:53:19.973150 6875 consensus_queue.cc:260] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:19.974526 6878 tablet_bootstrap.cc:492] T faef317e47a244c6965864f82f21edfa P c9d2944272bc447dafce7620ac2dbd4b: No bootstrap required, opened a new log
I20260807 13:53:19.974898 6878 ts_tablet_manager.cc:1403] T faef317e47a244c6965864f82f21edfa P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.031s user 0.007s sys 0.001s
I20260807 13:53:19.975075 6802 raft_consensus.cc:515] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:19.975692 6878 raft_consensus.cc:359] T faef317e47a244c6965864f82f21edfa P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:19.975919 6878 raft_consensus.cc:385] T faef317e47a244c6965864f82f21edfa P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:19.976018 6878 raft_consensus.cc:740] T faef317e47a244c6965864f82f21edfa P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:53:19.976298 6878 consensus_queue.cc:260] T faef317e47a244c6965864f82f21edfa P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:19.976437 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faef317e47a244c6965864f82f21edfa" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
I20260807 13:53:19.976521 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faef317e47a244c6965864f82f21edfa" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915"
I20260807 13:53:19.976773 5074 raft_consensus.cc:3060] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:19.976827 4897 raft_consensus.cc:3060] T faef317e47a244c6965864f82f21edfa P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:19.978458 6878 ts_tablet_manager.cc:1434] T faef317e47a244c6965864f82f21edfa P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:53:19.979866 4897 raft_consensus.cc:2468] T faef317e47a244c6965864f82f21edfa P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 1.
I20260807 13:53:19.980460 4631 leader_election.cc:304] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:19.981149 5074 raft_consensus.cc:2468] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 1.
I20260807 13:53:19.981491 6892 raft_consensus.cc:2804] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:19.981657 6892 raft_consensus.cc:697] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Becoming Leader. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Running, Role: LEADER
I20260807 13:53:19.981796 6802 leader_election.cc:290] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 election: Requested vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:19.982028 6892 consensus_queue.cc:237] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:19.982782 6875 ts_tablet_manager.cc:1434] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.011s user 0.003s sys 0.008s
I20260807 13:53:19.986490 4517 catalog_manager.cc:5697] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129). New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:53:20.014061 6892 raft_consensus.cc:493] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:20.014328 6892 raft_consensus.cc:515] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:20.015010 6892 leader_election.cc:290] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:20.015586 5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04dac80fea124c25b34af8cc290c0d7f" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179" is_pre_election: true
I20260807 13:53:20.015656 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04dac80fea124c25b34af8cc290c0d7f" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915" is_pre_election: true
I20260807 13:53:20.015810 5246 raft_consensus.cc:2468] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 0.
I20260807 13:53:20.015964 5074 raft_consensus.cc:2468] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 0.
I20260807 13:53:20.016327 4632 leader_election.cc:304] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edf940ebcc1140cfa0c23214e0c0f179, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:20.016657 6892 raft_consensus.cc:2804] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:20.016744 6892 raft_consensus.cc:493] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:20.016868 6892 raft_consensus.cc:3060] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:20.019002 6892 raft_consensus.cc:515] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:20.019634 6892 leader_election.cc:290] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 election: Requested vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:20.020074 5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04dac80fea124c25b34af8cc290c0d7f" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179"
I20260807 13:53:20.020105 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04dac80fea124c25b34af8cc290c0d7f" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915"
I20260807 13:53:20.020272 5246 raft_consensus.cc:3060] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:20.020311 5074 raft_consensus.cc:3060] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:20.022498 5074 raft_consensus.cc:2468] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 1.
I20260807 13:53:20.022507 5246 raft_consensus.cc:2468] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 1.
I20260807 13:53:20.022984 4630 leader_election.cc:304] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:20.023316 6892 raft_consensus.cc:2804] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:20.023487 6892 raft_consensus.cc:697] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Becoming Leader. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Running, Role: LEADER
I20260807 13:53:20.023775 6892 consensus_queue.cc:237] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:20.026876 4517 catalog_manager.cc:5697] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129). New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:53:20.288650 6814 raft_consensus.cc:493] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:20.288851 6814 raft_consensus.cc:515] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:20.289528 6814 leader_election.cc:290] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:53:20.290102 4718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a090faa58e4f91961c9251030efacf" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" is_pre_election: true
I20260807 13:53:20.290115 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a090faa58e4f91961c9251030efacf" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b" is_pre_election: true
I20260807 13:53:20.290333 4718 raft_consensus.cc:2468] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 0.
I20260807 13:53:20.290350 4897 raft_consensus.cc:2468] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 0.
I20260807 13:53:20.290871 5154 leader_election.cc:304] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edf940ebcc1140cfa0c23214e0c0f179, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:20.291167 6814 raft_consensus.cc:2804] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:20.291270 6814 raft_consensus.cc:493] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:20.291337 6814 raft_consensus.cc:3060] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:20.293234 6814 raft_consensus.cc:515] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:20.293948 6814 leader_election.cc:290] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 election: Requested vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:53:20.294503 4716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a090faa58e4f91961c9251030efacf" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
I20260807 13:53:20.294504 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a090faa58e4f91961c9251030efacf" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
I20260807 13:53:20.294741 4897 raft_consensus.cc:3060] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:20.294752 4716 raft_consensus.cc:3060] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:20.297807 4897 raft_consensus.cc:2468] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 1.
I20260807 13:53:20.297807 4716 raft_consensus.cc:2468] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 1.
I20260807 13:53:20.298295 5153 leader_election.cc:304] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: c9d2944272bc447dafce7620ac2dbd4b, edf940ebcc1140cfa0c23214e0c0f179, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:20.298588 6814 raft_consensus.cc:2804] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:20.298753 6814 raft_consensus.cc:697] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Becoming Leader. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Running, Role: LEADER
I20260807 13:53:20.299046 6814 consensus_queue.cc:237] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:53:20.303532 4517 catalog_manager.cc:5697] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: term changed from 0 to 1, leader changed from <none> to edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132). New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:53:20.409451 6892 consensus_queue.cc:1048] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:20.417016 6892 consensus_queue.cc:1048] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:20.563378 6892 consensus_queue.cc:1048] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:20.571189 6892 consensus_queue.cc:1048] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:20.765771 6814 consensus_queue.cc:1048] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:20.771185 6683 consensus_queue.cc:1048] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:53:20.796296 6896 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:20.796634 6896 flags.cc:432] Enabled unsafe flag: --never_fsync=true
Using table 'rebalance_test_table_8'
W20260807 13:53:21.028930 4631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.130:37489, user_credentials={real_user=slave}} blocked reactor thread for 47201.7us
INSERT report
rows total: 2000
time total: 309.364 ms
time per row: 0.154682 ms
I20260807 13:53:21.280133 4516 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39098:
name: "rebalance_test_table_9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20260807 13:53:21.290499 4865 tablet_service.cc:1511] Processing CreateTablet for tablet d27ce55f2acc4513a9fd90a338098eeb (DEFAULT_TABLE table=rebalance_test_table_9 [id=96e83925faa542ffa4808b01a5adbbb3]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:21.290793 5214 tablet_service.cc:1511] Processing CreateTablet for tablet d27ce55f2acc4513a9fd90a338098eeb (DEFAULT_TABLE table=rebalance_test_table_9 [id=96e83925faa542ffa4808b01a5adbbb3]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:21.291045 4865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27ce55f2acc4513a9fd90a338098eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:21.291292 5214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27ce55f2acc4513a9fd90a338098eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:21.291831 5216 tablet_service.cc:1511] Processing CreateTablet for tablet e93615e4fb61416d8740ce61970610af (DEFAULT_TABLE table=rebalance_test_table_9 [id=96e83925faa542ffa4808b01a5adbbb3]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:21.292306 5216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93615e4fb61416d8740ce61970610af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:21.294154 4688 tablet_service.cc:1511] Processing CreateTablet for tablet 81cbb42cd4954383976169ec16ef2416 (DEFAULT_TABLE table=rebalance_test_table_9 [id=96e83925faa542ffa4808b01a5adbbb3]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:21.294684 4688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81cbb42cd4954383976169ec16ef2416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:21.298254 5037 tablet_service.cc:1511] Processing CreateTablet for tablet d27ce55f2acc4513a9fd90a338098eeb (DEFAULT_TABLE table=rebalance_test_table_9 [id=96e83925faa542ffa4808b01a5adbbb3]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:21.298424 5038 tablet_service.cc:1511] Processing CreateTablet for tablet e93615e4fb61416d8740ce61970610af (DEFAULT_TABLE table=rebalance_test_table_9 [id=96e83925faa542ffa4808b01a5adbbb3]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:21.298731 5037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27ce55f2acc4513a9fd90a338098eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:21.300340 5038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93615e4fb61416d8740ce61970610af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:21.304756 4863 tablet_service.cc:1511] Processing CreateTablet for tablet e93615e4fb61416d8740ce61970610af (DEFAULT_TABLE table=rebalance_test_table_9 [id=96e83925faa542ffa4808b01a5adbbb3]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:21.305248 4863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93615e4fb61416d8740ce61970610af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:21.303447 5039 tablet_service.cc:1511] Processing CreateTablet for tablet 81cbb42cd4954383976169ec16ef2416 (DEFAULT_TABLE table=rebalance_test_table_9 [id=96e83925faa542ffa4808b01a5adbbb3]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:21.308398 5039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81cbb42cd4954383976169ec16ef2416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:21.311415 4866 tablet_service.cc:1511] Processing CreateTablet for tablet 81cbb42cd4954383976169ec16ef2416 (DEFAULT_TABLE table=rebalance_test_table_9 [id=96e83925faa542ffa4808b01a5adbbb3]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260807 13:53:21.313896 4866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81cbb42cd4954383976169ec16ef2416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:21.321197 6984 tablet_bootstrap.cc:492] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:53:21.323694 6984 tablet_bootstrap.cc:654] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:21.326645 6983 tablet_bootstrap.cc:492] T e93615e4fb61416d8740ce61970610af P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:53:21.333108 6983 tablet_bootstrap.cc:654] T e93615e4fb61416d8740ce61970610af P 01adf83af3e04875b5fac9470d4da915: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:21.333410 6984 tablet_bootstrap.cc:492] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179: No bootstrap required, opened a new log
I20260807 13:53:21.333702 6984 ts_tablet_manager.cc:1403] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.000s
I20260807 13:53:21.334973 6984 raft_consensus.cc:359] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:21.336560 6984 raft_consensus.cc:385] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:21.336898 6984 raft_consensus.cc:740] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:53:21.337556 6984 consensus_queue.cc:260] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:21.338838 6984 ts_tablet_manager.cc:1434] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260807 13:53:21.338650 6982 tablet_bootstrap.cc:492] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:53:21.340066 6984 tablet_bootstrap.cc:492] T d27ce55f2acc4513a9fd90a338098eeb P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:53:21.342531 6984 tablet_bootstrap.cc:654] T d27ce55f2acc4513a9fd90a338098eeb P edf940ebcc1140cfa0c23214e0c0f179: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:21.344921 6982 tablet_bootstrap.cc:654] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:21.345077 6983 tablet_bootstrap.cc:492] T e93615e4fb61416d8740ce61970610af P 01adf83af3e04875b5fac9470d4da915: No bootstrap required, opened a new log
I20260807 13:53:21.345258 6983 ts_tablet_manager.cc:1403] T e93615e4fb61416d8740ce61970610af P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.002s
I20260807 13:53:21.346247 6983 raft_consensus.cc:359] T e93615e4fb61416d8740ce61970610af P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:21.346511 6983 raft_consensus.cc:385] T e93615e4fb61416d8740ce61970610af P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:21.346616 6983 raft_consensus.cc:740] T e93615e4fb61416d8740ce61970610af P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:53:21.346921 6983 consensus_queue.cc:260] T e93615e4fb61416d8740ce61970610af P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:21.347678 6983 ts_tablet_manager.cc:1434] T e93615e4fb61416d8740ce61970610af P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 13:53:21.348037 6983 tablet_bootstrap.cc:492] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:53:21.350592 6984 tablet_bootstrap.cc:492] T d27ce55f2acc4513a9fd90a338098eeb P edf940ebcc1140cfa0c23214e0c0f179: No bootstrap required, opened a new log
I20260807 13:53:21.350723 6983 tablet_bootstrap.cc:654] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:21.350888 6984 ts_tablet_manager.cc:1403] T d27ce55f2acc4513a9fd90a338098eeb P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.000s
I20260807 13:53:21.351842 6984 raft_consensus.cc:359] T d27ce55f2acc4513a9fd90a338098eeb P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:21.352737 6984 raft_consensus.cc:385] T d27ce55f2acc4513a9fd90a338098eeb P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:21.352986 6984 raft_consensus.cc:740] T d27ce55f2acc4513a9fd90a338098eeb P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:53:21.353536 6984 consensus_queue.cc:260] T d27ce55f2acc4513a9fd90a338098eeb P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:21.354550 6984 ts_tablet_manager.cc:1434] T d27ce55f2acc4513a9fd90a338098eeb P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260807 13:53:21.358206 6969 raft_consensus.cc:493] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:21.358368 6969 raft_consensus.cc:515] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:21.359169 6969 leader_election.cc:290] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:21.360270 4892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93615e4fb61416d8740ce61970610af" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b" is_pre_election: true
I20260807 13:53:21.360370 6981 tablet_bootstrap.cc:492] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
W20260807 13:53:21.361076 5153 leader_election.cc:343] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:53:21.362401 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93615e4fb61416d8740ce61970610af" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915" is_pre_election: true
I20260807 13:53:21.362645 5074 raft_consensus.cc:2468] T e93615e4fb61416d8740ce61970610af P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 0.
I20260807 13:53:21.363107 6981 tablet_bootstrap.cc:654] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:21.363268 5152 leader_election.cc:304] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, edf940ebcc1140cfa0c23214e0c0f179; no voters: c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:53:21.363615 6969 raft_consensus.cc:2804] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:21.363793 6969 raft_consensus.cc:493] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:21.363962 6969 raft_consensus.cc:3060] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:21.368140 6969 raft_consensus.cc:515] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:21.368765 6969 leader_election.cc:290] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 election: Requested vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:21.369612 4892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93615e4fb61416d8740ce61970610af" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
I20260807 13:53:21.369719 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93615e4fb61416d8740ce61970610af" candidate_uuid: "edf940ebcc1140cfa0c23214e0c0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915"
I20260807 13:53:21.369951 5074 raft_consensus.cc:3060] T e93615e4fb61416d8740ce61970610af P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:53:21.371745 5153 leader_election.cc:343] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:53:21.373268 5074 raft_consensus.cc:2468] T e93615e4fb61416d8740ce61970610af P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edf940ebcc1140cfa0c23214e0c0f179 in term 1.
I20260807 13:53:21.373886 5152 leader_election.cc:304] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, edf940ebcc1140cfa0c23214e0c0f179; no voters: c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:53:21.374176 6981 tablet_bootstrap.cc:492] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b: No bootstrap required, opened a new log
I20260807 13:53:21.374382 6981 ts_tablet_manager.cc:1403] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.000s
I20260807 13:53:21.374454 6969 raft_consensus.cc:2804] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:21.374914 6969 raft_consensus.cc:697] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Becoming Leader. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Running, Role: LEADER
I20260807 13:53:21.375216 6969 consensus_queue.cc:237] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:21.375373 6981 raft_consensus.cc:359] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:21.376082 6981 raft_consensus.cc:385] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:21.376221 6981 raft_consensus.cc:740] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:53:21.376534 6981 consensus_queue.cc:260] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:21.377403 6981 ts_tablet_manager.cc:1434] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:53:21.377772 6981 tablet_bootstrap.cc:492] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:53:21.377959 6982 tablet_bootstrap.cc:492] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7: No bootstrap required, opened a new log
I20260807 13:53:21.378163 6982 ts_tablet_manager.cc:1403] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.040s user 0.005s sys 0.000s
I20260807 13:53:21.378504 6983 tablet_bootstrap.cc:492] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915: No bootstrap required, opened a new log
I20260807 13:53:21.378700 6983 ts_tablet_manager.cc:1403] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.000s
I20260807 13:53:21.379271 6982 raft_consensus.cc:359] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:21.379539 6983 raft_consensus.cc:359] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:21.379570 6982 raft_consensus.cc:385] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:21.379782 6983 raft_consensus.cc:385] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:21.379885 6983 raft_consensus.cc:740] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:53:21.379842 6982 raft_consensus.cc:740] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:53:21.380370 6982 consensus_queue.cc:260] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:21.381358 6982 ts_tablet_manager.cc:1434] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260807 13:53:21.385842 6981 tablet_bootstrap.cc:654] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:21.387212 6983 consensus_queue.cc:260] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:21.387971 6983 ts_tablet_manager.cc:1434] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.009s user 0.002s sys 0.001s
I20260807 13:53:21.388535 6983 tablet_bootstrap.cc:492] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:53:21.391687 4514 catalog_manager.cc:5697] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: term changed from 0 to 1, leader changed from <none> to edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132). New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:53:21.397117 6983 tablet_bootstrap.cc:654] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:21.399871 6981 tablet_bootstrap.cc:492] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b: No bootstrap required, opened a new log
I20260807 13:53:21.400053 6981 ts_tablet_manager.cc:1403] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.006s
I20260807 13:53:21.400892 6981 raft_consensus.cc:359] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:21.401216 6981 raft_consensus.cc:385] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:21.401324 6981 raft_consensus.cc:740] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:53:21.401667 6981 consensus_queue.cc:260] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:21.402329 6981 ts_tablet_manager.cc:1434] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260807 13:53:21.402684 6981 tablet_bootstrap.cc:492] T 81cbb42cd4954383976169ec16ef2416 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:53:21.404316 6983 tablet_bootstrap.cc:492] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915: No bootstrap required, opened a new log
I20260807 13:53:21.404534 6983 ts_tablet_manager.cc:1403] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.003s
I20260807 13:53:21.406392 6983 raft_consensus.cc:359] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:21.406649 6983 raft_consensus.cc:385] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:21.406816 6983 raft_consensus.cc:740] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:53:21.406987 6981 tablet_bootstrap.cc:654] T 81cbb42cd4954383976169ec16ef2416 P c9d2944272bc447dafce7620ac2dbd4b: Neither blocks nor log segments found. Creating new log.
I20260807 13:53:21.407400 6983 consensus_queue.cc:260] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:21.408046 6983 ts_tablet_manager.cc:1434] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260807 13:53:21.416222 6981 tablet_bootstrap.cc:492] T 81cbb42cd4954383976169ec16ef2416 P c9d2944272bc447dafce7620ac2dbd4b: No bootstrap required, opened a new log
I20260807 13:53:21.416365 6981 ts_tablet_manager.cc:1403] T 81cbb42cd4954383976169ec16ef2416 P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.003s
I20260807 13:53:21.417085 6981 raft_consensus.cc:359] T 81cbb42cd4954383976169ec16ef2416 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:21.417320 6981 raft_consensus.cc:385] T 81cbb42cd4954383976169ec16ef2416 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:53:21.417522 6981 raft_consensus.cc:740] T 81cbb42cd4954383976169ec16ef2416 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:53:21.417860 6981 consensus_queue.cc:260] T 81cbb42cd4954383976169ec16ef2416 P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:21.418505 6981 ts_tablet_manager.cc:1434] T 81cbb42cd4954383976169ec16ef2416 P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 13:53:21.525717 6865 raft_consensus.cc:493] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:21.525985 6865 raft_consensus.cc:515] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:21.526855 6865 leader_election.cc:290] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:21.527436 5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27ce55f2acc4513a9fd90a338098eeb" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179" is_pre_election: true
I20260807 13:53:21.527452 4892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27ce55f2acc4513a9fd90a338098eeb" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b" is_pre_election: true
I20260807 13:53:21.527704 5246 raft_consensus.cc:2468] T d27ce55f2acc4513a9fd90a338098eeb P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 0.
I20260807 13:53:21.527709 4892 raft_consensus.cc:2468] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 0.
I20260807 13:53:21.528185 4981 leader_election.cc:304] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, c9d2944272bc447dafce7620ac2dbd4b; no voters:
I20260807 13:53:21.528471 6865 raft_consensus.cc:2804] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:21.528590 6865 raft_consensus.cc:493] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:21.528685 6865 raft_consensus.cc:3060] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:21.530835 6865 raft_consensus.cc:515] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:21.531457 6865 leader_election.cc:290] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 election: Requested vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:21.531961 4892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27ce55f2acc4513a9fd90a338098eeb" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
I20260807 13:53:21.532035 5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27ce55f2acc4513a9fd90a338098eeb" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179"
I20260807 13:53:21.532179 4892 raft_consensus.cc:3060] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:21.532358 5246 raft_consensus.cc:3060] T d27ce55f2acc4513a9fd90a338098eeb P edf940ebcc1140cfa0c23214e0c0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:21.535306 5246 raft_consensus.cc:2468] T d27ce55f2acc4513a9fd90a338098eeb P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 1.
I20260807 13:53:21.535326 4892 raft_consensus.cc:2468] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 1.
I20260807 13:53:21.535805 4981 leader_election.cc:304] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, c9d2944272bc447dafce7620ac2dbd4b, edf940ebcc1140cfa0c23214e0c0f179; no voters:
I20260807 13:53:21.536171 6865 raft_consensus.cc:2804] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:21.536325 6865 raft_consensus.cc:697] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Becoming Leader. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Running, Role: LEADER
I20260807 13:53:21.536625 6865 consensus_queue.cc:237] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:21.538407 6865 raft_consensus.cc:493] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:21.538630 6865 raft_consensus.cc:515] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:21.539323 6865 leader_election.cc:290] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:53:21.539700 4892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81cbb42cd4954383976169ec16ef2416" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b" is_pre_election: true
I20260807 13:53:21.539940 4892 raft_consensus.cc:2468] T 81cbb42cd4954383976169ec16ef2416 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 0.
I20260807 13:53:21.539958 4718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81cbb42cd4954383976169ec16ef2416" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" is_pre_election: true
I20260807 13:53:21.540210 4718 raft_consensus.cc:2468] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 0.
I20260807 13:53:21.540325 4516 catalog_manager.cc:5697] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01adf83af3e04875b5fac9470d4da915 (127.23.107.131). New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:53:21.540752 4981 leader_election.cc:304] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, c9d2944272bc447dafce7620ac2dbd4b; no voters:
I20260807 13:53:21.541025 6865 raft_consensus.cc:2804] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:53:21.541131 6865 raft_consensus.cc:493] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:53:21.541256 6865 raft_consensus.cc:3060] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:21.543915 6865 raft_consensus.cc:515] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:21.544510 6865 leader_election.cc:290] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 election: Requested vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:53:21.544868 4892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81cbb42cd4954383976169ec16ef2416" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
I20260807 13:53:21.545085 4892 raft_consensus.cc:3060] T 81cbb42cd4954383976169ec16ef2416 P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:21.545013 4718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81cbb42cd4954383976169ec16ef2416" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
I20260807 13:53:21.545229 4718 raft_consensus.cc:3060] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:21.548225 4892 raft_consensus.cc:2468] T 81cbb42cd4954383976169ec16ef2416 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 1.
I20260807 13:53:21.548274 4718 raft_consensus.cc:2468] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 1.
I20260807 13:53:21.548699 4982 leader_election.cc:304] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:21.548941 6865 raft_consensus.cc:2804] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:53:21.549075 6865 raft_consensus.cc:697] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Becoming Leader. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Running, Role: LEADER
I20260807 13:53:21.549394 6865 consensus_queue.cc:237] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:21.552778 4516 catalog_manager.cc:5697] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01adf83af3e04875b5fac9470d4da915 (127.23.107.131). New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:53:21.635739 6800 raft_consensus.cc:493] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:53:21.635950 6800 raft_consensus.cc:515] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:53:21.636752 6800 leader_election.cc:290] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:21.637580 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93615e4fb61416d8740ce61970610af" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179" is_pre_election: true
I20260807 13:53:21.638026 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93615e4fb61416d8740ce61970610af" candidate_uuid: "c9d2944272bc447dafce7620ac2dbd4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915" is_pre_election: true
I20260807 13:53:21.638303 5074 raft_consensus.cc:2393] T e93615e4fb61416d8740ce61970610af P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9d2944272bc447dafce7620ac2dbd4b in current term 1: Already voted for candidate edf940ebcc1140cfa0c23214e0c0f179 in this term.
I20260807 13:53:21.638803 4804 leader_election.cc:304] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9d2944272bc447dafce7620ac2dbd4b; no voters: 01adf83af3e04875b5fac9470d4da915, edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:53:21.639199 6800 raft_consensus.cc:3060] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:53:21.642093 6800 raft_consensus.cc:2749] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:53:21.934720 6865 consensus_queue.cc:1048] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:21.940025 6865 consensus_queue.cc:1048] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:21.945627 6683 consensus_queue.cc:1048] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:21.960000 6969 consensus_queue.cc:1048] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:53:21.992950 7001 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:21.993297 7001 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260807 13:53:22.001062 6865 consensus_queue.cc:1048] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:53:22.006528 6977 consensus_queue.cc:1048] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Using table 'rebalance_test_table_9'
INSERT report
rows total: 2000
time total: 234.898 ms
time per row: 0.117449 ms
I20260807 13:53:22.431200 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.133:38075
--local_ip_for_outbound_sockets=127.23.107.133
--tserver_master_addrs=127.23.107.190:41317
--webserver_port=34063
--webserver_interface=127.23.107.133
--builtin_ntp_servers=127.23.107.148:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
W20260807 13:53:22.854483 7078 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:22.854923 7078 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:53:22.855079 7078 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:53:22.864401 7078 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:53:22.864539 7078 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:53:22.864809 7078 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.133
I20260807 13:53:22.876214 7078 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.133:38075
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.23.107.133
--webserver_port=34063
--tserver_master_addrs=127.23.107.190:41317
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.133
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:53:22.877935 7078 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:53:22.880096 7078 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:53:22.890470 7087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:53:22.890506 7088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:53:22.891144 7090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:53:22.891585 7078 server_base.cc:1061] running on GCE node
I20260807 13:53:22.892272 7078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:53:22.893273 7078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:53:22.894595 7078 hybrid_clock.cc:648] HybridClock initialized: now 1786110802894529 us; error 38 us; skew 500 ppm
I20260807 13:53:22.894994 7078 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:53:22.897183 7078 webserver.cc:533] Webserver started at http://127.23.107.133:34063/ using document root <none> and password file <none>
I20260807 13:53:22.897969 7078 fs_manager.cc:362] Metadata directory not provided
I20260807 13:53:22.898142 7078 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:53:22.904361 7078 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.003s sys 0.003s
I20260807 13:53:22.907474 7097 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:22.908843 7078 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 13:53:22.908991 7078 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "b77f2b2eade540c6bfd4f75e5229a3cd"
format_stamp: "Formatted at 2026-08-07 13:53:04 on dist-test-slave-bw88"
I20260807 13:53:22.909947 7078 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:53:22.925865 7078 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:53:22.926728 7078 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:53:22.926962 7078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:53:22.927892 7078 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:53:22.930075 7078 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:53:22.930205 7078 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:22.930321 7078 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:53:22.930410 7078 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:22.969933 7078 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.133:38075
I20260807 13:53:22.970024 7249 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.133:38075 every 8 connection(s)
I20260807 13:53:22.971575 7078 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20260807 13:53:22.976967 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 7078
I20260807 13:53:22.977854 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.134:35975
--local_ip_for_outbound_sockets=127.23.107.134
--tserver_master_addrs=127.23.107.190:41317
--webserver_port=41459
--webserver_interface=127.23.107.134
--builtin_ntp_servers=127.23.107.148:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260807 13:53:22.991401 7250 heartbeater.cc:344] Connected to a master server at 127.23.107.190:41317
I20260807 13:53:22.991842 7250 heartbeater.cc:461] Registering TS with master...
I20260807 13:53:22.992767 7250 heartbeater.cc:507] Master 127.23.107.190:41317 requested a full tablet report, sending...
I20260807 13:53:22.994899 4514 ts_manager.cc:194] Re-registered known tserver with Master: b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075)
I20260807 13:53:22.995852 4514 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.133:37797
W20260807 13:53:23.392534 7255 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:23.392874 7255 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:53:23.392987 7255 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:53:23.402226 7255 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:53:23.402365 7255 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:53:23.402638 7255 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.134
I20260807 13:53:23.413240 7255 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.134:35975
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--webserver_interface=127.23.107.134
--webserver_port=41459
--tserver_master_addrs=127.23.107.190:41317
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.134
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:53:23.415066 7255 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:53:23.417074 7255 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:53:23.428092 7261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:53:23.428136 7262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:53:23.429307 7255 server_base.cc:1061] running on GCE node
W20260807 13:53:23.429517 7264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:53:23.430227 7255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:53:23.431264 7255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:53:23.432515 7255 hybrid_clock.cc:648] HybridClock initialized: now 1786110803432421 us; error 66 us; skew 500 ppm
I20260807 13:53:23.432842 7255 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:53:23.435256 7255 webserver.cc:533] Webserver started at http://127.23.107.134:41459/ using document root <none> and password file <none>
I20260807 13:53:23.436051 7255 fs_manager.cc:362] Metadata directory not provided
I20260807 13:53:23.436216 7255 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:53:23.442379 7255 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 13:53:23.445438 7270 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:23.446965 7255 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 13:53:23.447178 7255 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal
uuid: "12ab71778f2f4b378765aaed1a0676a5"
format_stamp: "Formatted at 2026-08-07 13:53:04 on dist-test-slave-bw88"
I20260807 13:53:23.448177 7255 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:53:23.462458 7255 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:53:23.463408 7255 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:53:23.463694 7255 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:53:23.464824 7255 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:53:23.466602 7255 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:53:23.466727 7255 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:23.466852 7255 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:53:23.466953 7255 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:23.506222 7255 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.134:35975
I20260807 13:53:23.506268 7414 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.134:35975 every 8 connection(s)
I20260807 13:53:23.507871 7255 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/info.pb
I20260807 13:53:23.511803 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 7255
I20260807 13:53:23.512444 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.135:40385
--local_ip_for_outbound_sockets=127.23.107.135
--tserver_master_addrs=127.23.107.190:41317
--webserver_port=43629
--webserver_interface=127.23.107.135
--builtin_ntp_servers=127.23.107.148:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260807 13:53:23.522423 7415 heartbeater.cc:344] Connected to a master server at 127.23.107.190:41317
I20260807 13:53:23.522734 7415 heartbeater.cc:461] Registering TS with master...
I20260807 13:53:23.523625 7415 heartbeater.cc:507] Master 127.23.107.190:41317 requested a full tablet report, sending...
I20260807 13:53:23.525256 4514 ts_manager.cc:194] Re-registered known tserver with Master: 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975)
I20260807 13:53:23.526309 4514 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.134:41295
W20260807 13:53:23.930907 7420 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:23.931249 7420 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:53:23.931411 7420 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:53:23.940112 7420 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:53:23.940256 7420 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:53:23.940464 7420 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.135
I20260807 13:53:23.952163 7420 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.135:40385
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--webserver_interface=127.23.107.135
--webserver_port=43629
--tserver_master_addrs=127.23.107.190:41317
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.135
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:53:23.954092 7420 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:53:23.956396 7420 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:53:23.967880 7428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:53:23.968163 7427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:53:23.970045 7431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:53:23.970052 7420 server_base.cc:1061] running on GCE node
I20260807 13:53:23.971087 7420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:53:23.977618 7420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:53:23.978881 7420 hybrid_clock.cc:648] HybridClock initialized: now 1786110803978800 us; error 58 us; skew 500 ppm
I20260807 13:53:23.979214 7420 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:53:23.981657 7420 webserver.cc:533] Webserver started at http://127.23.107.135:43629/ using document root <none> and password file <none>
I20260807 13:53:23.982424 7420 fs_manager.cc:362] Metadata directory not provided
I20260807 13:53:23.982592 7420 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:53:23.988730 7420 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.005s sys 0.001s
I20260807 13:53:23.991487 7440 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:23.992797 7420 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 13:53:23.992983 7420 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal
uuid: "8a9903f009ff46b4a6875490823076c4"
format_stamp: "Formatted at 2026-08-07 13:53:05 on dist-test-slave-bw88"
I20260807 13:53:23.993837 7420 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:53:23.998828 7250 heartbeater.cc:499] Master 127.23.107.190:41317 was elected leader, sending a full tablet report...
I20260807 13:53:24.019032 7420 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:53:24.020272 7420 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:53:24.020596 7420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:53:24.021793 7420 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:53:24.023540 7420 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:53:24.023665 7420 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:24.023806 7420 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:53:24.023890 7420 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:24.067610 7420 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.135:40385
I20260807 13:53:24.067705 7588 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.135:40385 every 8 connection(s)
I20260807 13:53:24.069272 7420 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data/info.pb
I20260807 13:53:24.076709 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 7420
I20260807 13:53:24.077328 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.107.136:43729
--local_ip_for_outbound_sockets=127.23.107.136
--tserver_master_addrs=127.23.107.190:41317
--webserver_port=36743
--webserver_interface=127.23.107.136
--builtin_ntp_servers=127.23.107.148:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false with env {}
I20260807 13:53:24.084570 7589 heartbeater.cc:344] Connected to a master server at 127.23.107.190:41317
I20260807 13:53:24.085080 7589 heartbeater.cc:461] Registering TS with master...
I20260807 13:53:24.086118 7589 heartbeater.cc:507] Master 127.23.107.190:41317 requested a full tablet report, sending...
I20260807 13:53:24.087738 4516 ts_manager.cc:194] Re-registered known tserver with Master: 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385)
I20260807 13:53:24.088668 4516 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.135:53479
W20260807 13:53:24.500066 7593 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:24.500394 7593 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:53:24.500541 7593 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:53:24.511615 7593 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:53:24.511765 7593 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:53:24.511965 7593 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.107.136
I20260807 13:53:24.522979 7593 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.107.136:43729
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--webserver_interface=127.23.107.136
--webserver_port=36743
--tserver_master_addrs=127.23.107.190:41317
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.107.136
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:53:24.524601 7593 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:53:24.526489 7593 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260807 13:53:24.529838 7415 heartbeater.cc:499] Master 127.23.107.190:41317 was elected leader, sending a full tablet report...
W20260807 13:53:24.536886 7599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:53:24.536932 7600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:53:24.537874 7602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:53:24.538648 7593 server_base.cc:1061] running on GCE node
I20260807 13:53:24.539294 7593 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:53:24.540365 7593 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:53:24.541606 7593 hybrid_clock.cc:648] HybridClock initialized: now 1786110804541543 us; error 47 us; skew 500 ppm
I20260807 13:53:24.541911 7593 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:53:24.544476 7593 webserver.cc:533] Webserver started at http://127.23.107.136:36743/ using document root <none> and password file <none>
I20260807 13:53:24.545305 7593 fs_manager.cc:362] Metadata directory not provided
I20260807 13:53:24.545517 7593 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:53:24.551913 7593 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 13:53:24.555117 7608 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:24.556596 7593 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 13:53:24.556803 7593 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/wal
uuid: "31d7630573c8475a9f84978d4ebfb879"
format_stamp: "Formatted at 2026-08-07 13:53:05 on dist-test-slave-bw88"
I20260807 13:53:24.557741 7593 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:53:24.571471 7593 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:53:24.572322 7593 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:53:24.572600 7593 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:53:24.573638 7593 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 13:53:24.575275 7593 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:53:24.575389 7593 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:24.575517 7593 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 13:53:24.575626 7593 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:53:24.612298 7593 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.136:43729
I20260807 13:53:24.612390 7738 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.136:43729 every 8 connection(s)
I20260807 13:53:24.614055 7593 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/data/info.pb
I20260807 13:53:24.621668 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 7593
I20260807 13:53:24.629244 7740 heartbeater.cc:344] Connected to a master server at 127.23.107.190:41317
I20260807 13:53:24.629712 7740 heartbeater.cc:461] Registering TS with master...
I20260807 13:53:24.630786 7740 heartbeater.cc:507] Master 127.23.107.190:41317 requested a full tablet report, sending...
I20260807 13:53:24.632453 4516 ts_manager.cc:194] Re-registered known tserver with Master: 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729)
I20260807 13:53:24.633464 4516 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.107.136:52281
I20260807 13:53:25.092581 7589 heartbeater.cc:499] Master 127.23.107.190:41317 was elected leader, sending a full tablet report...
I20260807 13:53:25.636199 7740 heartbeater.cc:499] Master 127.23.107.190:41317 was elected leader, sending a full tablet report...
I20260807 13:53:25.805223 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:25.811157 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:25.871145 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:25.871374 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:25.880328 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:25.893800 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:25.926108 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:25.966502 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:26.314411 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:26.351892 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:26.379175 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:26.467734 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:26.473517 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:26.479067 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:26.499866 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:26.531773 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:26.548771 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:26.596355 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260807 13:53:26.613519 4630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.131:40441, user_credentials={real_user=slave}} blocked reactor thread for 76114.7us
W20260807 13:53:26.651196 4632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:41217, user_credentials={real_user=slave}} blocked reactor thread for 52771.3us
I20260807 13:53:26.678580 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:26.698408 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:26.734509 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260807 13:53:26.740963 4982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.129:32841, user_credentials={real_user=slave}} blocked reactor thread for 74498.9us
I20260807 13:53:26.759311 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:26.802387 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:26.805667 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:26.927240 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:26.933647 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:26.968935 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:26.979514 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:26.984670 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:26.999282 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:27.003906 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:27.004753 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:27.424973 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:27.444721 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:27.500129 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:27.510216 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:27.576045 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:27.594185 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:27.630812 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:27.678895 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:27.820945 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:27.825392 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:27.862890 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:27.871727 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:27.900678 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:27.915329 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:27.944252 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:27.971228 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:28.315477 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:28.333704 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:28.339051 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:28.367244 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:28.367698 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:28.393962 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:28.422098 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:28.441238 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:28.453553 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:28.458688 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:28.470211 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:28.501885 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:28.532074 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:28.545717 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:28.611240 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:28.633878 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:29.079087 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:29.098474 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
W20260807 13:53:29.114174 5153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.130:37489, user_credentials={real_user=slave}} blocked reactor thread for 70735.4us
W20260807 13:53:29.132351 4632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:41217, user_credentials={real_user=slave}} blocked reactor thread for 133980us
I20260807 13:53:29.171475 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:29.241765 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:29.268014 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:29.279892 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:29.297129 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:29.326885 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:29.627410 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:29.688256 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:29.712422 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:29.755579 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:29.768733 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:29.788293 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:29.795787 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:29.823487 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:29.824105 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:29.834895 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:29.842552 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:29.856189 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:29.862140 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:29.917088 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:29.921653 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:29.998768 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:30.347414 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:30.405035 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:30.491909 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:30.545312 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:30.559755 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:30.560930 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:30.612813 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:30.656014 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:30.756590 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:30.757539 5248 consensus_queue.cc:237] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:30.763124 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:30.784349 5072 raft_consensus.cc:1275] T e22d4edb78d24783bae07928b6c95fc2 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:30.785279 8264 consensus_queue.cc:1048] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:30.790530 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:30.792577 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:30.799319 4716 raft_consensus.cc:1275] T e22d4edb78d24783bae07928b6c95fc2 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:30.800182 8264 consensus_queue.cc:1048] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:30.814546 8517 raft_consensus.cc:2955] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:30.823843 4716 raft_consensus.cc:2955] T e22d4edb78d24783bae07928b6c95fc2 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:30.835515 5072 raft_consensus.cc:2955] T e22d4edb78d24783bae07928b6c95fc2 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
W20260807 13:53:30.840220 5151 consensus_peers.cc:597] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 -> Peer 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729): Couldn't send request to peer 31d7630573c8475a9f84978d4ebfb879. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e22d4edb78d24783bae07928b6c95fc2. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:30.843230 4514 catalog_manager.cc:5697] T e22d4edb78d24783bae07928b6c95fc2 P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:30.881537 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:30.926354 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:30.944293 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:30.946381 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:31.043728 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:31.079844 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:31.115211 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:31.122786 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:31.145010 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:31.176991 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:31.182138 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:31.204584 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:31.275884 4716 consensus_queue.cc:237] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:31.284960 4897 raft_consensus.cc:1275] T 0c1327c8461e44f2ac5d77f10c390eeb P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:31.286573 8536 consensus_queue.cc:1048] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:31.300952 5072 raft_consensus.cc:1275] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:31.301765 8536 consensus_queue.cc:1048] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:31.342460 8536 raft_consensus.cc:2955] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
W20260807 13:53:31.343984 4632 consensus_peers.cc:597] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): Couldn't send request to peer 8a9903f009ff46b4a6875490823076c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0c1327c8461e44f2ac5d77f10c390eeb. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:31.386826 4514 catalog_manager.cc:5697] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index -1 to 4, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:31.390285 5072 raft_consensus.cc:2955] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:31.399145 8745 ts_tablet_manager.cc:933] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:31.404636 4897 raft_consensus.cc:2955] T 0c1327c8461e44f2ac5d77f10c390eeb P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:31.441241 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:31.442662 8745 tablet_copy_client.cc:323] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:53:31.480453 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:31.508152 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:31.585538 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:31.593654 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet e22d4edb78d24783bae07928b6c95fc2 from peer 31d7630573c8475a9f84978d4ebfb879 ({username='slave'} at 127.23.107.136:35045)
I20260807 13:53:31.594347 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet e22d4edb78d24783bae07928b6c95fc2 from peer 31d7630573c8475a9f84978d4ebfb879 at {username='slave'} at 127.23.107.136:35045: session id = 31d7630573c8475a9f84978d4ebfb879-e22d4edb78d24783bae07928b6c95fc2
I20260807 13:53:31.614387 5272 tablet_copy_source_session.cc:215] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:31.623577 8745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e22d4edb78d24783bae07928b6c95fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:31.652096 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:31.652854 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:31.696712 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:31.741770 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:31.756531 8813 ts_tablet_manager.cc:933] T 0c1327c8461e44f2ac5d77f10c390eeb P 8a9903f009ff46b4a6875490823076c4: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:53:31.764289 8813 tablet_copy_client.cc:323] T 0c1327c8461e44f2ac5d77f10c390eeb P 8a9903f009ff46b4a6875490823076c4: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:53:31.797577 4748 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet 0c1327c8461e44f2ac5d77f10c390eeb from peer 8a9903f009ff46b4a6875490823076c4 ({username='slave'} at 127.23.107.135:56247)
I20260807 13:53:31.797883 4748 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet 0c1327c8461e44f2ac5d77f10c390eeb from peer 8a9903f009ff46b4a6875490823076c4 at {username='slave'} at 127.23.107.135:56247: session id = 8a9903f009ff46b4a6875490823076c4-0c1327c8461e44f2ac5d77f10c390eeb
I20260807 13:53:31.808218 4748 tablet_copy_source_session.cc:215] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:31.817842 8813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c1327c8461e44f2ac5d77f10c390eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:31.854138 8745 tablet_copy_client.cc:806] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:31.854681 8745 tablet_copy_client.cc:670] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:31.859457 8813 tablet_copy_client.cc:806] T 0c1327c8461e44f2ac5d77f10c390eeb P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:31.859859 8813 tablet_copy_client.cc:670] T 0c1327c8461e44f2ac5d77f10c390eeb P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:31.860002 8745 tablet_copy_client.cc:538] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:31.865042 8813 tablet_copy_client.cc:538] T 0c1327c8461e44f2ac5d77f10c390eeb P 8a9903f009ff46b4a6875490823076c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:31.872704 4897 consensus_queue.cc:237] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:31.876713 8813 tablet_bootstrap.cc:492] T 0c1327c8461e44f2ac5d77f10c390eeb P 8a9903f009ff46b4a6875490823076c4: Bootstrap starting.
I20260807 13:53:31.903832 8813 log.cc:826] T 0c1327c8461e44f2ac5d77f10c390eeb P 8a9903f009ff46b4a6875490823076c4: Log is configured to *not* fsync() on all Append() calls
I20260807 13:53:31.916185 5072 raft_consensus.cc:1275] T d02aa7a26c024b4083421b5d742f7bcb P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:31.919363 4716 raft_consensus.cc:1275] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:31.920104 8837 consensus_queue.cc:1048] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:31.920570 8595 consensus_queue.cc:1048] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:31.933080 4716 consensus_queue.cc:237] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:31.944751 5246 raft_consensus.cc:1275] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:31.946137 8749 consensus_queue.cc:1048] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:31.965258 4897 raft_consensus.cc:1275] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:31.966193 8749 consensus_queue.cc:1048] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260807 13:53:31.984293 4631 consensus_peers.cc:597] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): Couldn't send request to peer b77f2b2eade540c6bfd4f75e5229a3cd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 966ebd287fc14e498e5bd3e6542194ca. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:31.989681 8745 tablet_bootstrap.cc:492] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap starting.
I20260807 13:53:31.996534 8813 tablet_bootstrap.cc:492] T 0c1327c8461e44f2ac5d77f10c390eeb P 8a9903f009ff46b4a6875490823076c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:31.997721 8813 tablet_bootstrap.cc:492] T 0c1327c8461e44f2ac5d77f10c390eeb P 8a9903f009ff46b4a6875490823076c4: Bootstrap complete.
W20260807 13:53:31.998291 4805 consensus_peers.cc:597] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b -> Peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): Couldn't send request to peer b77f2b2eade540c6bfd4f75e5229a3cd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d02aa7a26c024b4083421b5d742f7bcb. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:31.998543 8813 ts_tablet_manager.cc:1403] T 0c1327c8461e44f2ac5d77f10c390eeb P 8a9903f009ff46b4a6875490823076c4: Time spent bootstrapping tablet: real 0.125s user 0.083s sys 0.008s
I20260807 13:53:32.000085 8837 raft_consensus.cc:2955] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:32.003712 8857 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:32.009289 4716 raft_consensus.cc:2955] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:32.011678 5072 raft_consensus.cc:2955] T d02aa7a26c024b4083421b5d742f7bcb P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:32.012823 5068 consensus_queue.cc:237] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:32.017678 4514 catalog_manager.cc:5697] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index -1 to 4, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:32.025625 8813 raft_consensus.cc:359] T 0c1327c8461e44f2ac5d77f10c390eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:32.026131 8813 raft_consensus.cc:740] T 0c1327c8461e44f2ac5d77f10c390eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a9903f009ff46b4a6875490823076c4, State: Initialized, Role: FOLLOWER
I20260807 13:53:32.026894 8813 consensus_queue.cc:260] T 0c1327c8461e44f2ac5d77f10c390eeb P 8a9903f009ff46b4a6875490823076c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:32.053452 4897 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:32.062520 8745 log.cc:826] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879: Log is configured to *not* fsync() on all Append() calls
I20260807 13:53:32.081907 8813 ts_tablet_manager.cc:1434] T 0c1327c8461e44f2ac5d77f10c390eeb P 8a9903f009ff46b4a6875490823076c4: Time spent starting tablet: real 0.083s user 0.017s sys 0.010s
I20260807 13:53:32.083611 4748 tablet_copy_service.cc:342] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Request end of tablet copy session 8a9903f009ff46b4a6875490823076c4-0c1327c8461e44f2ac5d77f10c390eeb received from {username='slave'} at 127.23.107.135:56247
I20260807 13:53:32.083853 4748 tablet_copy_service.cc:434] P fa83b7af134b4e3b949ac3b4e4bcb5e7: ending tablet copy session 8a9903f009ff46b4a6875490823076c4-0c1327c8461e44f2ac5d77f10c390eeb on tablet 0c1327c8461e44f2ac5d77f10c390eeb with peer 8a9903f009ff46b4a6875490823076c4
I20260807 13:53:32.106657 5246 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:32.107721 4716 raft_consensus.cc:1275] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:32.115036 4515 catalog_manager.cc:5697] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index -1 to 4, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:32.127977 4897 consensus_queue.cc:237] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:32.158078 5246 raft_consensus.cc:1275] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260807 13:53:32.158771 4805 consensus_peers.cc:597] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b -> Peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): Couldn't send request to peer b77f2b2eade540c6bfd4f75e5229a3cd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 541201ddfdf041ed87b3d0e731763a37. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:32.158850 8837 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:32.161864 4716 raft_consensus.cc:1275] T 541201ddfdf041ed87b3d0e731763a37 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:32.162745 8837 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:32.167009 8595 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:32.167799 4716 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:32.173733 5246 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:32.179893 4515 catalog_manager.cc:5697] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index -1 to 4, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:32.237381 5246 raft_consensus.cc:1275] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:32.248553 8743 consensus_queue.cc:1048] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:32.250041 8743 consensus_queue.cc:1048] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260807 13:53:32.291857 4982 consensus_peers.cc:597] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 -> Peer 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): Couldn't send request to peer 8a9903f009ff46b4a6875490823076c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ffa98a163d7540e3a911a39334657138. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:32.300416 8883 raft_consensus.cc:2955] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:32.315431 4716 raft_consensus.cc:2955] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:32.325476 4514 catalog_manager.cc:5697] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index -1 to 4, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:32.332664 7524 raft_consensus.cc:1217] T 0c1327c8461e44f2ac5d77f10c390eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:32.339744 8939 ts_tablet_manager.cc:933] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd: Initiating tablet copy from peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:53:32.349781 8939 tablet_copy_client.cc:323] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.130:37489
I20260807 13:53:32.351239 5246 consensus_queue.cc:237] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:32.375522 4716 raft_consensus.cc:1275] T 1715828a5d96455abecae985d1dca004 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:32.380095 4897 raft_consensus.cc:1275] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:32.381009 8517 consensus_queue.cc:1048] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:32.389523 8799 consensus_queue.cc:1048] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
W20260807 13:53:32.403060 5154 consensus_peers.cc:597] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 -> Peer 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): Couldn't send request to peer 8a9903f009ff46b4a6875490823076c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1715828a5d96455abecae985d1dca004. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:32.406098 8745 tablet_bootstrap.cc:492] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:32.406759 8745 tablet_bootstrap.cc:492] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap complete.
W20260807 13:53:32.410463 4982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:41217, user_credentials={real_user=slave}} blocked reactor thread for 70646.9us
I20260807 13:53:32.411422 5246 raft_consensus.cc:2955] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:32.412633 8745 ts_tablet_manager.cc:1403] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879: Time spent bootstrapping tablet: real 0.423s user 0.079s sys 0.010s
I20260807 13:53:32.423941 8745 raft_consensus.cc:359] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:32.424469 8745 raft_consensus.cc:740] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d7630573c8475a9f84978d4ebfb879, State: Initialized, Role: FOLLOWER
I20260807 13:53:32.425778 8517 raft_consensus.cc:2955] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:32.425325 8745 consensus_queue.cc:260] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:32.451489 4515 catalog_manager.cc:5697] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index -1 to 4, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:32.454851 4716 raft_consensus.cc:2955] T 1715828a5d96455abecae985d1dca004 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:32.457839 4897 raft_consensus.cc:2955] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:32.461843 8962 ts_tablet_manager.cc:933] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:53:32.500800 5246 consensus_queue.cc:237] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:32.507202 8813 ts_tablet_manager.cc:933] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:32.508040 8813 tablet_copy_client.cc:323] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:53:32.509038 4715 raft_consensus.cc:1275] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260807 13:53:32.514042 5151 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 -> Peer 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729): Couldn't send request to peer 31d7630573c8475a9f84978d4ebfb879. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 96bc42d66fa04fb69afa630969dbb579. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:32.514755 8799 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:32.518625 8962 tablet_copy_client.cc:323] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:53:32.521652 5072 raft_consensus.cc:1275] T 96bc42d66fa04fb69afa630969dbb579 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:32.522796 8799 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:32.531994 8745 ts_tablet_manager.cc:1434] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879: Time spent starting tablet: real 0.119s user 0.055s sys 0.031s
I20260807 13:53:32.533211 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session 31d7630573c8475a9f84978d4ebfb879-e22d4edb78d24783bae07928b6c95fc2 received from {username='slave'} at 127.23.107.136:35045
I20260807 13:53:32.533474 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session 31d7630573c8475a9f84978d4ebfb879-e22d4edb78d24783bae07928b6c95fc2 on tablet e22d4edb78d24783bae07928b6c95fc2 with peer 31d7630573c8475a9f84978d4ebfb879
I20260807 13:53:32.549216 4748 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet 966ebd287fc14e498e5bd3e6542194ca from peer b77f2b2eade540c6bfd4f75e5229a3cd ({username='slave'} at 127.23.107.133:40143)
I20260807 13:53:32.549472 4748 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet 966ebd287fc14e498e5bd3e6542194ca from peer b77f2b2eade540c6bfd4f75e5229a3cd at {username='slave'} at 127.23.107.133:40143: session id = b77f2b2eade540c6bfd4f75e5229a3cd-966ebd287fc14e498e5bd3e6542194ca
I20260807 13:53:32.554071 4748 tablet_copy_source_session.cc:215] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:32.557000 4715 consensus_queue.cc:237] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:32.563630 8962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 966ebd287fc14e498e5bd3e6542194ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:32.568150 4922 tablet_copy_service.cc:140] P c9d2944272bc447dafce7620ac2dbd4b: Received BeginTabletCopySession request for tablet d02aa7a26c024b4083421b5d742f7bcb from peer b77f2b2eade540c6bfd4f75e5229a3cd ({username='slave'} at 127.23.107.133:44845)
I20260807 13:53:32.568435 4922 tablet_copy_service.cc:161] P c9d2944272bc447dafce7620ac2dbd4b: Beginning new tablet copy session on tablet d02aa7a26c024b4083421b5d742f7bcb from peer b77f2b2eade540c6bfd4f75e5229a3cd at {username='slave'} at 127.23.107.133:44845: session id = b77f2b2eade540c6bfd4f75e5229a3cd-d02aa7a26c024b4083421b5d742f7bcb
I20260807 13:53:32.572909 4922 tablet_copy_source_session.cc:215] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:32.575343 8939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d02aa7a26c024b4083421b5d742f7bcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:32.594365 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet ffa98a163d7540e3a911a39334657138 from peer 8a9903f009ff46b4a6875490823076c4 ({username='slave'} at 127.23.107.135:53271)
I20260807 13:53:32.594621 4897 raft_consensus.cc:1275] T d06f352d0ff34b45b753a2c20f65574f P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:32.594667 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet ffa98a163d7540e3a911a39334657138 from peer 8a9903f009ff46b4a6875490823076c4 at {username='slave'} at 127.23.107.135:53271: session id = 8a9903f009ff46b4a6875490823076c4-ffa98a163d7540e3a911a39334657138
I20260807 13:53:32.595355 8859 consensus_queue.cc:1048] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:32.596706 8939 tablet_copy_client.cc:806] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:32.597455 8939 tablet_copy_client.cc:670] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:32.599234 5101 tablet_copy_source_session.cc:215] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:32.602825 8962 tablet_copy_client.cc:806] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:32.603120 8962 tablet_copy_client.cc:670] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:32.605881 8813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa98a163d7540e3a911a39334657138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:32.607153 8799 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:32.610389 4715 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:32.613353 5248 raft_consensus.cc:1275] T d06f352d0ff34b45b753a2c20f65574f P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:32.624663 4515 catalog_manager.cc:5697] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:32.628746 8962 tablet_copy_client.cc:538] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:32.630299 5068 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:32.634101 8813 tablet_copy_client.cc:806] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:32.634457 8813 tablet_copy_client.cc:670] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:32.634925 8939 tablet_copy_client.cc:538] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:32.637111 8857 consensus_queue.cc:1048] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:32.637914 8813 tablet_copy_client.cc:538] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:32.643563 8939 tablet_bootstrap.cc:492] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap starting.
I20260807 13:53:32.646888 8962 tablet_bootstrap.cc:492] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap starting.
I20260807 13:53:32.654600 8813 tablet_bootstrap.cc:492] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4: Bootstrap starting.
W20260807 13:53:32.667202 4632 consensus_peers.cc:597] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d06f352d0ff34b45b753a2c20f65574f. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:32.667977 8857 raft_consensus.cc:2955] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:32.689157 8962 log.cc:826] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd: Log is configured to *not* fsync() on all Append() calls
I20260807 13:53:32.689116 5248 consensus_queue.cc:237] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:32.710120 4897 raft_consensus.cc:2955] T d06f352d0ff34b45b753a2c20f65574f P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:32.727490 4515 catalog_manager.cc:5697] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
W20260807 13:53:32.737936 4632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:41217, user_credentials={real_user=slave}} blocked reactor thread for 70399.9us
I20260807 13:53:32.743237 5245 raft_consensus.cc:2955] T d06f352d0ff34b45b753a2c20f65574f P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:32.766248 9029 ts_tablet_manager.cc:933] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:32.769001 7691 raft_consensus.cc:1217] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:32.776160 9029 tablet_copy_client.cc:323] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:53:32.800534 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet 1715828a5d96455abecae985d1dca004 from peer 8a9903f009ff46b4a6875490823076c4 ({username='slave'} at 127.23.107.135:38881)
I20260807 13:53:32.800786 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet 1715828a5d96455abecae985d1dca004 from peer 8a9903f009ff46b4a6875490823076c4 at {username='slave'} at 127.23.107.135:38881: session id = 8a9903f009ff46b4a6875490823076c4-1715828a5d96455abecae985d1dca004
I20260807 13:53:32.807086 5272 tablet_copy_source_session.cc:215] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:32.809520 9029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1715828a5d96455abecae985d1dca004. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 13:53:32.816331 4632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:41217, user_credentials={real_user=slave}} blocked reactor thread for 54470.7us
I20260807 13:53:32.817478 9029 tablet_copy_client.cc:806] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:32.817816 9029 tablet_copy_client.cc:670] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:32.819864 9029 tablet_copy_client.cc:538] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:32.826105 9029 tablet_bootstrap.cc:492] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4: Bootstrap starting.
I20260807 13:53:32.840572 9028 ts_tablet_manager.cc:933] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd: Initiating tablet copy from peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:53:32.852927 5068 raft_consensus.cc:1275] T c10b910e9f354933b60ae70f1baa9b6f P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:32.853937 8975 consensus_queue.cc:1048] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:32.862785 4897 raft_consensus.cc:1275] T c10b910e9f354933b60ae70f1baa9b6f P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:32.863715 8975 consensus_queue.cc:1048] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:32.868925 8813 tablet_bootstrap.cc:492] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:32.880604 8813 tablet_bootstrap.cc:492] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4: Bootstrap complete.
I20260807 13:53:32.880973 8813 ts_tablet_manager.cc:1403] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4: Time spent bootstrapping tablet: real 0.227s user 0.064s sys 0.011s
I20260807 13:53:32.882332 8813 raft_consensus.cc:359] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:32.882660 8813 raft_consensus.cc:740] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a9903f009ff46b4a6875490823076c4, State: Initialized, Role: FOLLOWER
I20260807 13:53:32.884403 9028 tablet_copy_client.cc:323] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.130:37489
I20260807 13:53:32.885601 8813 consensus_queue.cc:260] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:32.885857 4922 tablet_copy_service.cc:140] P c9d2944272bc447dafce7620ac2dbd4b: Received BeginTabletCopySession request for tablet 541201ddfdf041ed87b3d0e731763a37 from peer b77f2b2eade540c6bfd4f75e5229a3cd ({username='slave'} at 127.23.107.133:44845)
I20260807 13:53:32.886137 4922 tablet_copy_service.cc:161] P c9d2944272bc447dafce7620ac2dbd4b: Beginning new tablet copy session on tablet 541201ddfdf041ed87b3d0e731763a37 from peer b77f2b2eade540c6bfd4f75e5229a3cd at {username='slave'} at 127.23.107.133:44845: session id = b77f2b2eade540c6bfd4f75e5229a3cd-541201ddfdf041ed87b3d0e731763a37
I20260807 13:53:32.892236 8813 ts_tablet_manager.cc:1434] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4: Time spent starting tablet: real 0.011s user 0.004s sys 0.000s
I20260807 13:53:32.893252 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session 8a9903f009ff46b4a6875490823076c4-ffa98a163d7540e3a911a39334657138 received from {username='slave'} at 127.23.107.135:53271
I20260807 13:53:32.893546 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session 8a9903f009ff46b4a6875490823076c4-ffa98a163d7540e3a911a39334657138 on tablet ffa98a163d7540e3a911a39334657138 with peer 8a9903f009ff46b4a6875490823076c4
I20260807 13:53:32.893569 4922 tablet_copy_source_session.cc:215] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:32.904577 8962 tablet_bootstrap.cc:492] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:32.905566 8962 tablet_bootstrap.cc:492] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap complete.
I20260807 13:53:32.906356 8962 ts_tablet_manager.cc:1403] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent bootstrapping tablet: real 0.260s user 0.079s sys 0.006s
I20260807 13:53:32.913961 8962 raft_consensus.cc:359] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:32.914451 8962 raft_consensus.cc:740] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77f2b2eade540c6bfd4f75e5229a3cd, State: Initialized, Role: FOLLOWER
I20260807 13:53:32.915468 8962 consensus_queue.cc:260] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:32.920343 9028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541201ddfdf041ed87b3d0e731763a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:32.925352 8962 ts_tablet_manager.cc:1434] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent starting tablet: real 0.019s user 0.014s sys 0.004s
I20260807 13:53:32.934319 4748 tablet_copy_service.cc:342] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Request end of tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-966ebd287fc14e498e5bd3e6542194ca received from {username='slave'} at 127.23.107.133:40143
I20260807 13:53:32.934538 4748 tablet_copy_service.cc:434] P fa83b7af134b4e3b949ac3b4e4bcb5e7: ending tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-966ebd287fc14e498e5bd3e6542194ca on tablet 966ebd287fc14e498e5bd3e6542194ca with peer b77f2b2eade540c6bfd4f75e5229a3cd
I20260807 13:53:32.941690 8975 raft_consensus.cc:2955] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:32.946898 5068 raft_consensus.cc:2955] T c10b910e9f354933b60ae70f1baa9b6f P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:32.954236 4897 raft_consensus.cc:2955] T c10b910e9f354933b60ae70f1baa9b6f P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
W20260807 13:53:32.960227 5153 consensus_peers.cc:597] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 -> Peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): Couldn't send request to peer b77f2b2eade540c6bfd4f75e5229a3cd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c10b910e9f354933b60ae70f1baa9b6f. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:32.963507 4515 catalog_manager.cc:5697] T c10b910e9f354933b60ae70f1baa9b6f P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index -1 to 4, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:32.977381 9028 tablet_copy_client.cc:806] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:32.977890 9028 tablet_copy_client.cc:670] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:32.982952 4715 consensus_queue.cc:237] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:32.983366 9028 tablet_copy_client.cc:538] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:32.988996 9028 tablet_bootstrap.cc:492] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap starting.
I20260807 13:53:32.992893 9029 tablet_bootstrap.cc:492] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:32.997501 9029 tablet_bootstrap.cc:492] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4: Bootstrap complete.
I20260807 13:53:32.997902 9029 ts_tablet_manager.cc:1403] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4: Time spent bootstrapping tablet: real 0.172s user 0.052s sys 0.009s
I20260807 13:53:32.998932 9029 raft_consensus.cc:359] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:32.999187 9029 raft_consensus.cc:740] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a9903f009ff46b4a6875490823076c4, State: Initialized, Role: FOLLOWER
I20260807 13:53:33.005542 9029 consensus_queue.cc:260] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:33.006523 9029 ts_tablet_manager.cc:1434] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4: Time spent starting tablet: real 0.008s user 0.000s sys 0.003s
I20260807 13:53:33.007452 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session 8a9903f009ff46b4a6875490823076c4-1715828a5d96455abecae985d1dca004 received from {username='slave'} at 127.23.107.135:38881
I20260807 13:53:33.007615 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session 8a9903f009ff46b4a6875490823076c4-1715828a5d96455abecae985d1dca004 on tablet 1715828a5d96455abecae985d1dca004 with peer 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:33.010432 4632 consensus_peers.cc:597] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 68717842b14e4f06b528c08a65acd3b7. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:33.013234 4897 raft_consensus.cc:1275] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:33.014153 8859 consensus_queue.cc:1048] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:33.018597 5068 raft_consensus.cc:1275] T 68717842b14e4f06b528c08a65acd3b7 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:33.020818 8859 consensus_queue.cc:1048] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:33.032222 7180 raft_consensus.cc:1217] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:33.037972 8859 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:33.042450 5072 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:33.052901 4518 catalog_manager.cc:5697] T 68717842b14e4f06b528c08a65acd3b7 P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:33.066773 4892 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:33.068194 9066 ts_tablet_manager.cc:933] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:53:33.090298 9066 tablet_copy_client.cc:323] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:53:33.133560 4748 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet d06f352d0ff34b45b753a2c20f65574f from peer 12ab71778f2f4b378765aaed1a0676a5 ({username='slave'} at 127.23.107.134:34891)
I20260807 13:53:33.133797 4748 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet d06f352d0ff34b45b753a2c20f65574f from peer 12ab71778f2f4b378765aaed1a0676a5 at {username='slave'} at 127.23.107.134:34891: session id = 12ab71778f2f4b378765aaed1a0676a5-d06f352d0ff34b45b753a2c20f65574f
I20260807 13:53:33.137049 4748 tablet_copy_source_session.cc:215] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:33.156101 9066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06f352d0ff34b45b753a2c20f65574f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:33.169021 9095 ts_tablet_manager.cc:933] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:33.171482 8939 tablet_bootstrap.cc:492] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:33.172060 8939 tablet_bootstrap.cc:492] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap complete.
I20260807 13:53:33.175194 4892 consensus_queue.cc:237] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:33.182312 8939 ts_tablet_manager.cc:1403] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent bootstrapping tablet: real 0.539s user 0.106s sys 0.039s
I20260807 13:53:33.183553 8939 raft_consensus.cc:359] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:33.183789 8939 raft_consensus.cc:740] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77f2b2eade540c6bfd4f75e5229a3cd, State: Initialized, Role: FOLLOWER
I20260807 13:53:33.184260 8939 consensus_queue.cc:260] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:33.185014 8939 ts_tablet_manager.cc:1434] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:53:33.186470 4922 tablet_copy_service.cc:342] P c9d2944272bc447dafce7620ac2dbd4b: Request end of tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-d02aa7a26c024b4083421b5d742f7bcb received from {username='slave'} at 127.23.107.133:44845
I20260807 13:53:33.186698 4922 tablet_copy_service.cc:434] P c9d2944272bc447dafce7620ac2dbd4b: ending tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-d02aa7a26c024b4083421b5d742f7bcb on tablet d02aa7a26c024b4083421b5d742f7bcb with peer b77f2b2eade540c6bfd4f75e5229a3cd
I20260807 13:53:33.228363 9028 tablet_bootstrap.cc:492] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:33.230960 9028 tablet_bootstrap.cc:492] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap complete.
I20260807 13:53:33.232369 9028 ts_tablet_manager.cc:1403] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent bootstrapping tablet: real 0.244s user 0.067s sys 0.005s
I20260807 13:53:33.234724 9028 raft_consensus.cc:359] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:33.235997 9095 tablet_copy_client.cc:323] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:53:33.236052 9028 raft_consensus.cc:740] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77f2b2eade540c6bfd4f75e5229a3cd, State: Initialized, Role: FOLLOWER
I20260807 13:53:33.236708 9028 consensus_queue.cc:260] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:33.240506 7524 raft_consensus.cc:1217] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:33.240971 9066 tablet_copy_client.cc:806] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:33.241147 9028 ts_tablet_manager.cc:1434] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260807 13:53:33.241499 9066 tablet_copy_client.cc:670] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:33.244984 4922 tablet_copy_service.cc:342] P c9d2944272bc447dafce7620ac2dbd4b: Request end of tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-541201ddfdf041ed87b3d0e731763a37 received from {username='slave'} at 127.23.107.133:44845
I20260807 13:53:33.245152 4922 tablet_copy_service.cc:434] P c9d2944272bc447dafce7620ac2dbd4b: ending tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-541201ddfdf041ed87b3d0e731763a37 on tablet 541201ddfdf041ed87b3d0e731763a37 with peer b77f2b2eade540c6bfd4f75e5229a3cd
I20260807 13:53:33.250933 9066 tablet_copy_client.cc:538] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:33.252893 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet 96bc42d66fa04fb69afa630969dbb579 from peer 31d7630573c8475a9f84978d4ebfb879 ({username='slave'} at 127.23.107.136:35045)
I20260807 13:53:33.253115 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet 96bc42d66fa04fb69afa630969dbb579 from peer 31d7630573c8475a9f84978d4ebfb879 at {username='slave'} at 127.23.107.136:35045: session id = 31d7630573c8475a9f84978d4ebfb879-96bc42d66fa04fb69afa630969dbb579
I20260807 13:53:33.257503 9066 tablet_bootstrap.cc:492] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap starting.
I20260807 13:53:33.260885 5272 tablet_copy_source_session.cc:215] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:33.272436 9095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96bc42d66fa04fb69afa630969dbb579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:33.284737 5248 raft_consensus.cc:1275] T 782ac4fa94fb4183940fca514cc068b0 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:33.288682 4715 raft_consensus.cc:1275] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:33.291509 9066 log.cc:826] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5: Log is configured to *not* fsync() on all Append() calls
I20260807 13:53:33.298390 9070 consensus_queue.cc:1048] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:33.300532 9070 consensus_queue.cc:1048] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:33.311208 8595 raft_consensus.cc:2955] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:33.322290 5248 raft_consensus.cc:2955] T 782ac4fa94fb4183940fca514cc068b0 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:33.336988 4518 catalog_manager.cc:5697] T 782ac4fa94fb4183940fca514cc068b0 P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:33.341550 7180 raft_consensus.cc:1217] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:33.355818 7524 raft_consensus.cc:1217] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:33.377321 4716 raft_consensus.cc:2955] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:33.380699 9095 tablet_copy_client.cc:806] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:33.381239 9095 tablet_copy_client.cc:670] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:33.396109 5072 consensus_queue.cc:237] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:33.407972 9095 tablet_copy_client.cc:538] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:33.411002 9066 tablet_bootstrap.cc:492] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:33.413870 4716 raft_consensus.cc:1275] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:33.414574 4892 raft_consensus.cc:1275] T 43f5461808a646c885d593f782538930 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:33.414575 9141 consensus_queue.cc:1048] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:33.415671 9141 consensus_queue.cc:1048] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:33.417619 9066 tablet_bootstrap.cc:492] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap complete.
I20260807 13:53:33.418395 9066 ts_tablet_manager.cc:1403] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5: Time spent bootstrapping tablet: real 0.161s user 0.089s sys 0.000s
I20260807 13:53:33.423897 9141 raft_consensus.cc:2955] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:33.424821 4716 raft_consensus.cc:2955] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:33.427134 9066 raft_consensus.cc:359] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:33.427635 9066 raft_consensus.cc:740] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Initialized, Role: FOLLOWER
I20260807 13:53:33.436758 4892 raft_consensus.cc:2955] T 43f5461808a646c885d593f782538930 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:33.440192 9066 consensus_queue.cc:260] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:33.432875 4518 catalog_manager.cc:5697] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
W20260807 13:53:33.445998 4979 consensus_peers.cc:597] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 -> Peer 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729): Couldn't send request to peer 31d7630573c8475a9f84978d4ebfb879. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 43f5461808a646c885d593f782538930. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:33.454983 9028 ts_tablet_manager.cc:933] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:33.459507 9066 ts_tablet_manager.cc:1434] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5: Time spent starting tablet: real 0.041s user 0.011s sys 0.012s
I20260807 13:53:33.462152 5248 consensus_queue.cc:237] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
W20260807 13:53:33.463675 4806 consensus_peers.cc:597] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 782ac4fa94fb4183940fca514cc068b0. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:33.463210 9095 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap starting.
I20260807 13:53:33.467350 4748 tablet_copy_service.cc:342] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Request end of tablet copy session 12ab71778f2f4b378765aaed1a0676a5-d06f352d0ff34b45b753a2c20f65574f received from {username='slave'} at 127.23.107.134:34891
I20260807 13:53:33.467545 4748 tablet_copy_service.cc:434] P fa83b7af134b4e3b949ac3b4e4bcb5e7: ending tablet copy session 12ab71778f2f4b378765aaed1a0676a5-d06f352d0ff34b45b753a2c20f65574f on tablet d06f352d0ff34b45b753a2c20f65574f with peer 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:53:33.483839 4892 raft_consensus.cc:1275] T 80898a5a2cf046f1b7344dfceb175bbd P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:33.484401 5072 raft_consensus.cc:1275] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:33.485037 8975 consensus_queue.cc:1048] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:33.485412 9028 tablet_copy_client.cc:323] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:53:33.485386 8799 consensus_queue.cc:1048] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:33.496217 7180 raft_consensus.cc:1217] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
W20260807 13:53:33.497684 5154 consensus_peers.cc:597] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 80898a5a2cf046f1b7344dfceb175bbd. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:33.506645 8975 raft_consensus.cc:2955] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:33.509517 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet c10b910e9f354933b60ae70f1baa9b6f from peer b77f2b2eade540c6bfd4f75e5229a3cd ({username='slave'} at 127.23.107.133:38087)
I20260807 13:53:33.509734 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet c10b910e9f354933b60ae70f1baa9b6f from peer b77f2b2eade540c6bfd4f75e5229a3cd at {username='slave'} at 127.23.107.133:38087: session id = b77f2b2eade540c6bfd4f75e5229a3cd-c10b910e9f354933b60ae70f1baa9b6f
I20260807 13:53:33.519601 4892 raft_consensus.cc:2955] T 80898a5a2cf046f1b7344dfceb175bbd P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:33.522164 5272 tablet_copy_source_session.cc:215] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:33.524037 9028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c10b910e9f354933b60ae70f1baa9b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:33.526124 4518 catalog_manager.cc:5697] T 80898a5a2cf046f1b7344dfceb175bbd P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:33.535470 9028 tablet_copy_client.cc:806] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:33.535888 9028 tablet_copy_client.cc:670] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:33.536484 5072 raft_consensus.cc:2955] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:33.538384 9028 tablet_copy_client.cc:538] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:33.543289 9028 tablet_bootstrap.cc:492] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap starting.
I20260807 13:53:33.570214 7354 raft_consensus.cc:1217] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:33.591150 9066 ts_tablet_manager.cc:933] T 782ac4fa94fb4183940fca514cc068b0 P 12ab71778f2f4b378765aaed1a0676a5: Initiating tablet copy from peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:53:33.628899 9066 tablet_copy_client.cc:323] T 782ac4fa94fb4183940fca514cc068b0 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.130:37489
I20260807 13:53:33.630244 9197 ts_tablet_manager.cc:933] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:53:33.641970 9028 tablet_bootstrap.cc:492] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:33.643011 9028 tablet_bootstrap.cc:492] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap complete.
I20260807 13:53:33.643445 9028 ts_tablet_manager.cc:1403] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent bootstrapping tablet: real 0.100s user 0.062s sys 0.020s
I20260807 13:53:33.644666 9028 raft_consensus.cc:359] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:33.645041 9028 raft_consensus.cc:740] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77f2b2eade540c6bfd4f75e5229a3cd, State: Initialized, Role: FOLLOWER
I20260807 13:53:33.645399 4922 tablet_copy_service.cc:140] P c9d2944272bc447dafce7620ac2dbd4b: Received BeginTabletCopySession request for tablet 782ac4fa94fb4183940fca514cc068b0 from peer 12ab71778f2f4b378765aaed1a0676a5 ({username='slave'} at 127.23.107.134:40561)
I20260807 13:53:33.645594 4922 tablet_copy_service.cc:161] P c9d2944272bc447dafce7620ac2dbd4b: Beginning new tablet copy session on tablet 782ac4fa94fb4183940fca514cc068b0 from peer 12ab71778f2f4b378765aaed1a0676a5 at {username='slave'} at 127.23.107.134:40561: session id = 12ab71778f2f4b378765aaed1a0676a5-782ac4fa94fb4183940fca514cc068b0
I20260807 13:53:33.645579 9028 consensus_queue.cc:260] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:33.646433 9028 ts_tablet_manager.cc:1434] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:53:33.647063 9197 tablet_copy_client.cc:323] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:53:33.647256 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-c10b910e9f354933b60ae70f1baa9b6f received from {username='slave'} at 127.23.107.133:38087
I20260807 13:53:33.647410 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-c10b910e9f354933b60ae70f1baa9b6f on tablet c10b910e9f354933b60ae70f1baa9b6f with peer b77f2b2eade540c6bfd4f75e5229a3cd
I20260807 13:53:33.648802 4748 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet 68717842b14e4f06b528c08a65acd3b7 from peer 12ab71778f2f4b378765aaed1a0676a5 ({username='slave'} at 127.23.107.134:34891)
I20260807 13:53:33.648866 4922 tablet_copy_source_session.cc:215] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:33.649080 4748 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet 68717842b14e4f06b528c08a65acd3b7 from peer 12ab71778f2f4b378765aaed1a0676a5 at {username='slave'} at 127.23.107.134:34891: session id = 12ab71778f2f4b378765aaed1a0676a5-68717842b14e4f06b528c08a65acd3b7
I20260807 13:53:33.653249 4748 tablet_copy_source_session.cc:215] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:33.653806 9066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 782ac4fa94fb4183940fca514cc068b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:33.661742 9066 tablet_copy_client.cc:806] T 782ac4fa94fb4183940fca514cc068b0 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:33.662086 9066 tablet_copy_client.cc:670] T 782ac4fa94fb4183940fca514cc068b0 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:33.663954 9066 tablet_copy_client.cc:538] T 782ac4fa94fb4183940fca514cc068b0 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:33.668150 9066 tablet_bootstrap.cc:492] T 782ac4fa94fb4183940fca514cc068b0 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap starting.
I20260807 13:53:33.677841 9197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68717842b14e4f06b528c08a65acd3b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:33.700865 9197 tablet_copy_client.cc:806] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:33.701237 9197 tablet_copy_client.cc:670] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:33.704422 9197 tablet_copy_client.cc:538] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:33.716344 9197 tablet_bootstrap.cc:492] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap starting.
I20260807 13:53:33.729470 9095 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:33.730064 9095 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap complete.
I20260807 13:53:33.730422 9095 ts_tablet_manager.cc:1403] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: Time spent bootstrapping tablet: real 0.275s user 0.058s sys 0.008s
I20260807 13:53:33.746331 9095 raft_consensus.cc:359] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:33.746681 9095 raft_consensus.cc:740] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d7630573c8475a9f84978d4ebfb879, State: Initialized, Role: FOLLOWER
I20260807 13:53:33.748557 9095 consensus_queue.cc:260] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:33.757915 9095 ts_tablet_manager.cc:1434] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: Time spent starting tablet: real 0.014s user 0.004s sys 0.000s
I20260807 13:53:33.759341 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session 31d7630573c8475a9f84978d4ebfb879-96bc42d66fa04fb69afa630969dbb579 received from {username='slave'} at 127.23.107.136:35045
I20260807 13:53:33.759519 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session 31d7630573c8475a9f84978d4ebfb879-96bc42d66fa04fb69afa630969dbb579 on tablet 96bc42d66fa04fb69afa630969dbb579 with peer 31d7630573c8475a9f84978d4ebfb879
I20260807 13:53:33.812614 9197 tablet_bootstrap.cc:492] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:33.815034 9197 tablet_bootstrap.cc:492] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap complete.
I20260807 13:53:33.816005 9197 ts_tablet_manager.cc:1403] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: Time spent bootstrapping tablet: real 0.100s user 0.048s sys 0.016s
I20260807 13:53:33.820768 9197 raft_consensus.cc:359] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:33.826016 9197 raft_consensus.cc:740] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Initialized, Role: FOLLOWER
I20260807 13:53:33.827613 9197 consensus_queue.cc:260] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:33.827886 4892 consensus_queue.cc:237] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:33.829541 9197 ts_tablet_manager.cc:1434] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260807 13:53:33.831777 4897 consensus_queue.cc:237] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:33.839182 4748 tablet_copy_service.cc:342] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Request end of tablet copy session 12ab71778f2f4b378765aaed1a0676a5-68717842b14e4f06b528c08a65acd3b7 received from {username='slave'} at 127.23.107.134:34891
I20260807 13:53:33.839334 4748 tablet_copy_service.cc:434] P fa83b7af134b4e3b949ac3b4e4bcb5e7: ending tablet copy session 12ab71778f2f4b378765aaed1a0676a5-68717842b14e4f06b528c08a65acd3b7 on tablet 68717842b14e4f06b528c08a65acd3b7 with peer 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:53:33.843160 9066 tablet_bootstrap.cc:492] T 782ac4fa94fb4183940fca514cc068b0 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:33.843699 9066 tablet_bootstrap.cc:492] T 782ac4fa94fb4183940fca514cc068b0 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap complete.
I20260807 13:53:33.843869 7180 raft_consensus.cc:1217] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:33.844000 9066 ts_tablet_manager.cc:1403] T 782ac4fa94fb4183940fca514cc068b0 P 12ab71778f2f4b378765aaed1a0676a5: Time spent bootstrapping tablet: real 0.176s user 0.053s sys 0.007s
I20260807 13:53:33.846913 5072 raft_consensus.cc:1275] T bdac11c33b2b486eb34bc93def74489c P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:33.847596 9070 consensus_queue.cc:1048] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260807 13:53:33.849252 4805 consensus_peers.cc:597] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b -> Peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): Couldn't send request to peer b77f2b2eade540c6bfd4f75e5229a3cd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 312c7ed04e334b08b506c8908224a7da. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:33.844806 9066 raft_consensus.cc:359] T 782ac4fa94fb4183940fca514cc068b0 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:33.851040 9066 raft_consensus.cc:740] T 782ac4fa94fb4183940fca514cc068b0 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Initialized, Role: FOLLOWER
I20260807 13:53:33.851305 5248 raft_consensus.cc:1275] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:33.851332 9066 consensus_queue.cc:260] T 782ac4fa94fb4183940fca514cc068b0 P 12ab71778f2f4b378765aaed1a0676a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:33.851681 5068 raft_consensus.cc:1275] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:33.852141 9070 consensus_queue.cc:1048] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:33.852423 9134 consensus_queue.cc:1048] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:33.853062 9066 ts_tablet_manager.cc:1434] T 782ac4fa94fb4183940fca514cc068b0 P 12ab71778f2f4b378765aaed1a0676a5: Time spent starting tablet: real 0.009s user 0.004s sys 0.000s
I20260807 13:53:33.856122 4922 tablet_copy_service.cc:342] P c9d2944272bc447dafce7620ac2dbd4b: Request end of tablet copy session 12ab71778f2f4b378765aaed1a0676a5-782ac4fa94fb4183940fca514cc068b0 received from {username='slave'} at 127.23.107.134:40561
I20260807 13:53:33.856271 4922 tablet_copy_service.cc:434] P c9d2944272bc447dafce7620ac2dbd4b: ending tablet copy session 12ab71778f2f4b378765aaed1a0676a5-782ac4fa94fb4183940fca514cc068b0 on tablet 782ac4fa94fb4183940fca514cc068b0 with peer 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:53:33.857833 5245 raft_consensus.cc:1275] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:33.861094 9070 consensus_queue.cc:1048] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:33.871862 9134 raft_consensus.cc:2955] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:33.878567 5248 raft_consensus.cc:2955] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:33.889958 4518 catalog_manager.cc:5697] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index -1 to 4, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:33.901430 9095 ts_tablet_manager.cc:933] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:33.909063 5068 raft_consensus.cc:2955] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:33.908174 9268 raft_consensus.cc:2955] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:33.916119 9066 ts_tablet_manager.cc:933] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:33.917861 4518 catalog_manager.cc:5697] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index -1 to 4, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:33.919633 9066 tablet_copy_client.cc:323] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:53:33.927857 5248 raft_consensus.cc:2955] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:33.939334 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet 80898a5a2cf046f1b7344dfceb175bbd from peer 12ab71778f2f4b378765aaed1a0676a5 ({username='slave'} at 127.23.107.134:42065)
I20260807 13:53:33.939580 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet 80898a5a2cf046f1b7344dfceb175bbd from peer 12ab71778f2f4b378765aaed1a0676a5 at {username='slave'} at 127.23.107.134:42065: session id = 12ab71778f2f4b378765aaed1a0676a5-80898a5a2cf046f1b7344dfceb175bbd
I20260807 13:53:33.945291 5272 tablet_copy_source_session.cc:215] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
W20260807 13:53:33.945309 4806 consensus_peers.cc:597] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b -> Peer 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): Couldn't send request to peer 8a9903f009ff46b4a6875490823076c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bdac11c33b2b486eb34bc93def74489c. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:33.947598 9066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80898a5a2cf046f1b7344dfceb175bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:33.954823 5068 raft_consensus.cc:2955] T bdac11c33b2b486eb34bc93def74489c P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:33.960762 9066 tablet_copy_client.cc:806] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:33.961123 9066 tablet_copy_client.cc:670] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:33.966904 9066 tablet_copy_client.cc:538] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:33.956142 9095 tablet_copy_client.cc:323] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:53:34.006111 9066 tablet_bootstrap.cc:492] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap starting.
I20260807 13:53:34.058813 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet 43f5461808a646c885d593f782538930 from peer 31d7630573c8475a9f84978d4ebfb879 ({username='slave'} at 127.23.107.136:39013)
I20260807 13:53:34.059077 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet 43f5461808a646c885d593f782538930 from peer 31d7630573c8475a9f84978d4ebfb879 at {username='slave'} at 127.23.107.136:39013: session id = 31d7630573c8475a9f84978d4ebfb879-43f5461808a646c885d593f782538930
I20260807 13:53:34.064059 5101 tablet_copy_source_session.cc:215] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:34.066547 9095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f5461808a646c885d593f782538930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:34.071132 4897 consensus_queue.cc:237] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:34.074239 9095 tablet_copy_client.cc:806] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:34.074505 9095 tablet_copy_client.cc:670] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:34.077872 9095 tablet_copy_client.cc:538] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:34.083019 9095 tablet_bootstrap.cc:492] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap starting.
I20260807 13:53:34.086655 5248 raft_consensus.cc:1275] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:34.087957 4716 raft_consensus.cc:1275] T 541201ddfdf041ed87b3d0e731763a37 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
W20260807 13:53:34.089747 4806 consensus_peers.cc:597] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b -> Peer 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): Couldn't send request to peer 8a9903f009ff46b4a6875490823076c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 541201ddfdf041ed87b3d0e731763a37. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:34.089977 9270 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:34.091843 7180 raft_consensus.cc:1275] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:34.092046 7691 raft_consensus.cc:1217] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:34.092862 9270 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:34.097839 9134 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:34.139602 9270 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:34.142108 4715 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:34.162088 5248 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:34.173811 4518 catalog_manager.cc:5697] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index 4 to 5, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:34.177304 7354 raft_consensus.cc:1217] T 782ac4fa94fb4183940fca514cc068b0 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:34.184147 7354 raft_consensus.cc:1217] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:34.212539 7179 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:34.215461 9066 tablet_bootstrap.cc:492] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:34.216017 9066 tablet_bootstrap.cc:492] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap complete.
I20260807 13:53:34.216305 9066 ts_tablet_manager.cc:1403] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5: Time spent bootstrapping tablet: real 0.210s user 0.051s sys 0.005s
I20260807 13:53:34.220928 9066 raft_consensus.cc:359] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:34.221436 9066 raft_consensus.cc:740] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Initialized, Role: FOLLOWER
I20260807 13:53:34.221760 9066 consensus_queue.cc:260] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:34.222354 9066 ts_tablet_manager.cc:1434] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260807 13:53:34.224485 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session 12ab71778f2f4b378765aaed1a0676a5-80898a5a2cf046f1b7344dfceb175bbd received from {username='slave'} at 127.23.107.134:42065
I20260807 13:53:34.224649 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session 12ab71778f2f4b378765aaed1a0676a5-80898a5a2cf046f1b7344dfceb175bbd on tablet 80898a5a2cf046f1b7344dfceb175bbd with peer 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:53:34.266891 9095 tablet_bootstrap.cc:492] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:34.267489 9095 tablet_bootstrap.cc:492] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap complete.
I20260807 13:53:34.267818 9095 ts_tablet_manager.cc:1403] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879: Time spent bootstrapping tablet: real 0.185s user 0.078s sys 0.017s
I20260807 13:53:34.268821 9095 raft_consensus.cc:359] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:34.269083 9095 raft_consensus.cc:740] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d7630573c8475a9f84978d4ebfb879, State: Initialized, Role: FOLLOWER
I20260807 13:53:34.269459 9095 consensus_queue.cc:260] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:34.270200 9095 ts_tablet_manager.cc:1434] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 13:53:34.270968 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session 31d7630573c8475a9f84978d4ebfb879-43f5461808a646c885d593f782538930 received from {username='slave'} at 127.23.107.136:39013
I20260807 13:53:34.271173 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session 31d7630573c8475a9f84978d4ebfb879-43f5461808a646c885d593f782538930 on tablet 43f5461808a646c885d593f782538930 with peer 31d7630573c8475a9f84978d4ebfb879
I20260807 13:53:34.328583 7354 raft_consensus.cc:1217] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:34.383235 9369 ts_tablet_manager.cc:933] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd: Initiating tablet copy from peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:53:34.389603 4715 consensus_queue.cc:237] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:34.404983 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:34.405557 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:34.423533 9359 ts_tablet_manager.cc:933] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4: Initiating tablet copy from peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:53:34.433928 7691 raft_consensus.cc:1217] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:34.443066 9369 tablet_copy_client.cc:323] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.130:37489
I20260807 13:53:34.444569 5248 raft_consensus.cc:1275] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260807 13:53:34.445005 4631 consensus_peers.cc:597] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): Couldn't send request to peer b77f2b2eade540c6bfd4f75e5229a3cd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 04dac80fea124c25b34af8cc290c0d7f. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:34.445430 9321 consensus_queue.cc:1048] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:34.471277 9359 tablet_copy_client.cc:323] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.130:37489
I20260807 13:53:34.474304 5068 raft_consensus.cc:1275] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:34.475096 8859 consensus_queue.cc:1048] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:34.481014 4922 tablet_copy_service.cc:140] P c9d2944272bc447dafce7620ac2dbd4b: Received BeginTabletCopySession request for tablet bdac11c33b2b486eb34bc93def74489c from peer 8a9903f009ff46b4a6875490823076c4 ({username='slave'} at 127.23.107.135:57651)
I20260807 13:53:34.481236 4922 tablet_copy_service.cc:161] P c9d2944272bc447dafce7620ac2dbd4b: Beginning new tablet copy session on tablet bdac11c33b2b486eb34bc93def74489c from peer 8a9903f009ff46b4a6875490823076c4 at {username='slave'} at 127.23.107.135:57651: session id = 8a9903f009ff46b4a6875490823076c4-bdac11c33b2b486eb34bc93def74489c
I20260807 13:53:34.481312 4921 tablet_copy_service.cc:140] P c9d2944272bc447dafce7620ac2dbd4b: Received BeginTabletCopySession request for tablet 312c7ed04e334b08b506c8908224a7da from peer b77f2b2eade540c6bfd4f75e5229a3cd ({username='slave'} at 127.23.107.133:44845)
I20260807 13:53:34.481700 4921 tablet_copy_service.cc:161] P c9d2944272bc447dafce7620ac2dbd4b: Beginning new tablet copy session on tablet 312c7ed04e334b08b506c8908224a7da from peer b77f2b2eade540c6bfd4f75e5229a3cd at {username='slave'} at 127.23.107.133:44845: session id = b77f2b2eade540c6bfd4f75e5229a3cd-312c7ed04e334b08b506c8908224a7da
I20260807 13:53:34.484890 4922 tablet_copy_source_session.cc:215] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:34.486588 9359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdac11c33b2b486eb34bc93def74489c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:34.486930 4921 tablet_copy_source_session.cc:215] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:34.490765 9369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 312c7ed04e334b08b506c8908224a7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:34.493134 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:34.508275 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:34.511708 9359 tablet_copy_client.cc:806] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:34.512138 9359 tablet_copy_client.cc:670] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:34.534204 8859 raft_consensus.cc:2955] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:34.540524 5072 raft_consensus.cc:2955] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:34.551214 5248 raft_consensus.cc:2955] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:34.551970 4516 catalog_manager.cc:5697] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index -1 to 4, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:34.565441 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:34.585465 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:34.596017 4892 consensus_queue.cc:237] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:34.632746 9359 tablet_copy_client.cc:538] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:34.640646 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:34.668814 9398 ts_tablet_manager.cc:933] T 541201ddfdf041ed87b3d0e731763a37 P 8a9903f009ff46b4a6875490823076c4: Initiating tablet copy from peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:53:34.669441 9369 tablet_copy_client.cc:806] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:34.669833 9369 tablet_copy_client.cc:670] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:34.678023 9369 tablet_copy_client.cc:538] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:34.679268 5248 raft_consensus.cc:1275] T a29bfc37eabb411f845203c281444086 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:34.682507 9270 consensus_queue.cc:1048] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:34.683329 9359 tablet_bootstrap.cc:492] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4: Bootstrap starting.
I20260807 13:53:34.694442 5068 raft_consensus.cc:1275] T a29bfc37eabb411f845203c281444086 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:34.695431 9270 consensus_queue.cc:1048] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:34.726984 9369 tablet_bootstrap.cc:492] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap starting.
W20260807 13:53:34.736119 4803 consensus_peers.cc:597] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b -> Peer 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729): Couldn't send request to peer 31d7630573c8475a9f84978d4ebfb879. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a29bfc37eabb411f845203c281444086. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:34.740268 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:34.744149 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:34.750200 9398 tablet_copy_client.cc:323] T 541201ddfdf041ed87b3d0e731763a37 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.130:37489
I20260807 13:53:34.751111 4921 tablet_copy_service.cc:140] P c9d2944272bc447dafce7620ac2dbd4b: Received BeginTabletCopySession request for tablet 541201ddfdf041ed87b3d0e731763a37 from peer 8a9903f009ff46b4a6875490823076c4 ({username='slave'} at 127.23.107.135:57651)
I20260807 13:53:34.760720 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:34.761794 4921 tablet_copy_service.cc:161] P c9d2944272bc447dafce7620ac2dbd4b: Beginning new tablet copy session on tablet 541201ddfdf041ed87b3d0e731763a37 from peer 8a9903f009ff46b4a6875490823076c4 at {username='slave'} at 127.23.107.135:57651: session id = 8a9903f009ff46b4a6875490823076c4-541201ddfdf041ed87b3d0e731763a37
I20260807 13:53:34.762248 9423 raft_consensus.cc:2955] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:34.765686 4921 tablet_copy_source_session.cc:215] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:34.810489 9398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541201ddfdf041ed87b3d0e731763a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:34.816392 5248 raft_consensus.cc:2955] T a29bfc37eabb411f845203c281444086 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:34.819211 4518 catalog_manager.cc:5697] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:34.845049 5068 raft_consensus.cc:2955] T a29bfc37eabb411f845203c281444086 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:34.887944 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:34.939728 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:34.941622 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:34.958787 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:34.993546 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:35.007078 9398 tablet_copy_client.cc:806] T 541201ddfdf041ed87b3d0e731763a37 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:35.007452 9398 tablet_copy_client.cc:670] T 541201ddfdf041ed87b3d0e731763a37 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:35.009306 9398 tablet_copy_client.cc:538] T 541201ddfdf041ed87b3d0e731763a37 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:35.023147 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:35.036152 9359 tablet_bootstrap.cc:492] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:35.036804 9458 ts_tablet_manager.cc:933] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:53:35.046247 9458 tablet_copy_client.cc:323] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:53:35.047230 4748 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet 04dac80fea124c25b34af8cc290c0d7f from peer b77f2b2eade540c6bfd4f75e5229a3cd ({username='slave'} at 127.23.107.133:40143)
I20260807 13:53:35.047395 4748 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet 04dac80fea124c25b34af8cc290c0d7f from peer b77f2b2eade540c6bfd4f75e5229a3cd at {username='slave'} at 127.23.107.133:40143: session id = b77f2b2eade540c6bfd4f75e5229a3cd-04dac80fea124c25b34af8cc290c0d7f
I20260807 13:53:35.050611 4748 tablet_copy_source_session.cc:215] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:35.052747 9458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04dac80fea124c25b34af8cc290c0d7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:35.052232 9398 tablet_bootstrap.cc:492] T 541201ddfdf041ed87b3d0e731763a37 P 8a9903f009ff46b4a6875490823076c4: Bootstrap starting.
I20260807 13:53:35.080681 9359 tablet_bootstrap.cc:492] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4: Bootstrap complete.
I20260807 13:53:35.081143 9359 ts_tablet_manager.cc:1403] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4: Time spent bootstrapping tablet: real 0.398s user 0.058s sys 0.004s
I20260807 13:53:35.082154 9359 raft_consensus.cc:359] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:35.084232 9369 tablet_bootstrap.cc:492] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:35.084434 9359 raft_consensus.cc:740] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a9903f009ff46b4a6875490823076c4, State: Initialized, Role: FOLLOWER
I20260807 13:53:35.094542 9359 consensus_queue.cc:260] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:35.096100 9369 tablet_bootstrap.cc:492] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap complete.
I20260807 13:53:35.099202 9369 ts_tablet_manager.cc:1403] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent bootstrapping tablet: real 0.372s user 0.065s sys 0.043s
I20260807 13:53:35.095407 9458 tablet_copy_client.cc:806] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:35.099818 9458 tablet_copy_client.cc:670] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:35.102048 9458 tablet_copy_client.cc:538] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:35.104307 9369 raft_consensus.cc:359] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:35.107721 9369 raft_consensus.cc:740] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77f2b2eade540c6bfd4f75e5229a3cd, State: Initialized, Role: FOLLOWER
I20260807 13:53:35.108105 9369 consensus_queue.cc:260] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:35.108781 9359 ts_tablet_manager.cc:1434] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4: Time spent starting tablet: real 0.027s user 0.002s sys 0.000s
I20260807 13:53:35.107601 9458 tablet_bootstrap.cc:492] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap starting.
I20260807 13:53:35.137786 4921 tablet_copy_service.cc:342] P c9d2944272bc447dafce7620ac2dbd4b: Request end of tablet copy session 8a9903f009ff46b4a6875490823076c4-bdac11c33b2b486eb34bc93def74489c received from {username='slave'} at 127.23.107.135:57651
I20260807 13:53:35.137970 4921 tablet_copy_service.cc:434] P c9d2944272bc447dafce7620ac2dbd4b: ending tablet copy session 8a9903f009ff46b4a6875490823076c4-bdac11c33b2b486eb34bc93def74489c on tablet bdac11c33b2b486eb34bc93def74489c with peer 8a9903f009ff46b4a6875490823076c4
I20260807 13:53:35.138500 9369 ts_tablet_manager.cc:1434] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent starting tablet: real 0.039s user 0.004s sys 0.002s
I20260807 13:53:35.141662 4921 tablet_copy_service.cc:342] P c9d2944272bc447dafce7620ac2dbd4b: Request end of tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-312c7ed04e334b08b506c8908224a7da received from {username='slave'} at 127.23.107.133:44845
I20260807 13:53:35.141831 4921 tablet_copy_service.cc:434] P c9d2944272bc447dafce7620ac2dbd4b: ending tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-312c7ed04e334b08b506c8908224a7da on tablet 312c7ed04e334b08b506c8908224a7da with peer b77f2b2eade540c6bfd4f75e5229a3cd
I20260807 13:53:35.194581 9480 ts_tablet_manager.cc:933] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879: Initiating tablet copy from peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:53:35.220625 9398 tablet_bootstrap.cc:492] T 541201ddfdf041ed87b3d0e731763a37 P 8a9903f009ff46b4a6875490823076c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:35.221400 9398 tablet_bootstrap.cc:492] T 541201ddfdf041ed87b3d0e731763a37 P 8a9903f009ff46b4a6875490823076c4: Bootstrap complete.
I20260807 13:53:35.221789 9398 ts_tablet_manager.cc:1403] T 541201ddfdf041ed87b3d0e731763a37 P 8a9903f009ff46b4a6875490823076c4: Time spent bootstrapping tablet: real 0.170s user 0.038s sys 0.018s
I20260807 13:53:35.222837 9398 raft_consensus.cc:359] T 541201ddfdf041ed87b3d0e731763a37 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:35.223145 9398 raft_consensus.cc:740] T 541201ddfdf041ed87b3d0e731763a37 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a9903f009ff46b4a6875490823076c4, State: Initialized, Role: FOLLOWER
I20260807 13:53:35.223443 9398 consensus_queue.cc:260] T 541201ddfdf041ed87b3d0e731763a37 P 8a9903f009ff46b4a6875490823076c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:35.224105 9398 ts_tablet_manager.cc:1434] T 541201ddfdf041ed87b3d0e731763a37 P 8a9903f009ff46b4a6875490823076c4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 13:53:35.224915 4921 tablet_copy_service.cc:342] P c9d2944272bc447dafce7620ac2dbd4b: Request end of tablet copy session 8a9903f009ff46b4a6875490823076c4-541201ddfdf041ed87b3d0e731763a37 received from {username='slave'} at 127.23.107.135:57651
I20260807 13:53:35.225066 4921 tablet_copy_service.cc:434] P c9d2944272bc447dafce7620ac2dbd4b: ending tablet copy session 8a9903f009ff46b4a6875490823076c4-541201ddfdf041ed87b3d0e731763a37 on tablet 541201ddfdf041ed87b3d0e731763a37 with peer 8a9903f009ff46b4a6875490823076c4
I20260807 13:53:35.238775 9480 tablet_copy_client.cc:323] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.130:37489
I20260807 13:53:35.247375 9458 tablet_bootstrap.cc:492] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:35.248075 9458 tablet_bootstrap.cc:492] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap complete.
I20260807 13:53:35.248466 9458 ts_tablet_manager.cc:1403] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent bootstrapping tablet: real 0.141s user 0.052s sys 0.007s
I20260807 13:53:35.249651 9458 raft_consensus.cc:359] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:35.249964 9458 raft_consensus.cc:740] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77f2b2eade540c6bfd4f75e5229a3cd, State: Initialized, Role: FOLLOWER
I20260807 13:53:35.250353 9458 consensus_queue.cc:260] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:35.251384 9458 ts_tablet_manager.cc:1434] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent starting tablet: real 0.003s user 0.005s sys 0.000s
I20260807 13:53:35.252749 4748 tablet_copy_service.cc:342] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Request end of tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-04dac80fea124c25b34af8cc290c0d7f received from {username='slave'} at 127.23.107.133:40143
I20260807 13:53:35.252929 4748 tablet_copy_service.cc:434] P fa83b7af134b4e3b949ac3b4e4bcb5e7: ending tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-04dac80fea124c25b34af8cc290c0d7f on tablet 04dac80fea124c25b34af8cc290c0d7f with peer b77f2b2eade540c6bfd4f75e5229a3cd
I20260807 13:53:35.311005 7524 raft_consensus.cc:1217] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:35.312323 4921 tablet_copy_service.cc:140] P c9d2944272bc447dafce7620ac2dbd4b: Received BeginTabletCopySession request for tablet a29bfc37eabb411f845203c281444086 from peer 31d7630573c8475a9f84978d4ebfb879 ({username='slave'} at 127.23.107.136:38543)
I20260807 13:53:35.312505 4921 tablet_copy_service.cc:161] P c9d2944272bc447dafce7620ac2dbd4b: Beginning new tablet copy session on tablet a29bfc37eabb411f845203c281444086 from peer 31d7630573c8475a9f84978d4ebfb879 at {username='slave'} at 127.23.107.136:38543: session id = 31d7630573c8475a9f84978d4ebfb879-a29bfc37eabb411f845203c281444086
I20260807 13:53:35.316257 4921 tablet_copy_source_session.cc:215] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:35.319509 4715 consensus_queue.cc:237] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:35.324043 7354 raft_consensus.cc:1275] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:35.325349 9321 consensus_queue.cc:1048] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:35.330504 4897 raft_consensus.cc:1275] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
W20260807 13:53:35.331764 4631 consensus_peers.cc:597] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): Couldn't send request to peer b77f2b2eade540c6bfd4f75e5229a3cd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 68717842b14e4f06b528c08a65acd3b7. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:35.332267 8859 consensus_queue.cc:1048] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:35.338392 5068 raft_consensus.cc:1275] T 68717842b14e4f06b528c08a65acd3b7 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:35.339042 9321 consensus_queue.cc:1048] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:35.348557 5072 consensus_queue.cc:237] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:35.348909 9480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a29bfc37eabb411f845203c281444086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:35.378028 9321 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:35.386642 5068 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:35.396966 4892 raft_consensus.cc:1275] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:35.400287 9450 consensus_queue.cc:1048] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:35.408357 4518 catalog_manager.cc:5697] T 68717842b14e4f06b528c08a65acd3b7 P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 4 to 5, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:35.409706 9480 tablet_copy_client.cc:806] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:35.410010 9480 tablet_copy_client.cc:670] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:35.419915 4896 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:35.426208 5248 raft_consensus.cc:1275] T d27ce55f2acc4513a9fd90a338098eeb P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:35.426573 7180 raft_consensus.cc:1217] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:35.429845 9450 consensus_queue.cc:1048] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:35.434026 9480 tablet_copy_client.cc:538] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:35.439517 9480 tablet_bootstrap.cc:492] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap starting.
W20260807 13:53:35.445319 4982 consensus_peers.cc:597] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d27ce55f2acc4513a9fd90a338098eeb. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:35.454608 7524 raft_consensus.cc:1217] T 541201ddfdf041ed87b3d0e731763a37 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20260807 13:53:35.456545 7354 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:35.489567 9450 raft_consensus.cc:2955] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:35.498345 4892 raft_consensus.cc:2955] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:35.506242 5248 raft_consensus.cc:2955] T d27ce55f2acc4513a9fd90a338098eeb P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:35.508876 4517 catalog_manager.cc:5697] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:35.522259 7180 raft_consensus.cc:1217] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:35.581707 9480 tablet_bootstrap.cc:492] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:35.582324 9480 tablet_bootstrap.cc:492] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap complete.
I20260807 13:53:35.582665 9480 ts_tablet_manager.cc:1403] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879: Time spent bootstrapping tablet: real 0.143s user 0.065s sys 0.008s
I20260807 13:53:35.583701 9480 raft_consensus.cc:359] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:35.583977 9480 raft_consensus.cc:740] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d7630573c8475a9f84978d4ebfb879, State: Initialized, Role: FOLLOWER
I20260807 13:53:35.584297 9480 consensus_queue.cc:260] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:35.585836 9480 ts_tablet_manager.cc:1434] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 13:53:35.586598 4921 tablet_copy_service.cc:342] P c9d2944272bc447dafce7620ac2dbd4b: Request end of tablet copy session 31d7630573c8475a9f84978d4ebfb879-a29bfc37eabb411f845203c281444086 received from {username='slave'} at 127.23.107.136:38543
I20260807 13:53:35.586763 4921 tablet_copy_service.cc:434] P c9d2944272bc447dafce7620ac2dbd4b: ending tablet copy session 31d7630573c8475a9f84978d4ebfb879-a29bfc37eabb411f845203c281444086 on tablet a29bfc37eabb411f845203c281444086 with peer 31d7630573c8475a9f84978d4ebfb879
I20260807 13:53:35.616469 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:35.631896 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:35.648218 7691 raft_consensus.cc:1217] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:35.696491 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:35.793246 9593 ts_tablet_manager.cc:933] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:53:35.803449 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:35.827826 9593 tablet_copy_client.cc:323] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:53:35.828823 4748 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet 68717842b14e4f06b528c08a65acd3b7 from peer b77f2b2eade540c6bfd4f75e5229a3cd ({username='slave'} at 127.23.107.133:40143)
I20260807 13:53:35.829077 4748 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet 68717842b14e4f06b528c08a65acd3b7 from peer b77f2b2eade540c6bfd4f75e5229a3cd at {username='slave'} at 127.23.107.133:40143: session id = b77f2b2eade540c6bfd4f75e5229a3cd-68717842b14e4f06b528c08a65acd3b7
I20260807 13:53:35.836843 4748 tablet_copy_source_session.cc:215] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:35.847221 9593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68717842b14e4f06b528c08a65acd3b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:35.874615 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:35.878125 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:35.903254 5068 consensus_queue.cc:237] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:35.947861 5072 consensus_queue.cc:237] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:35.953460 5248 raft_consensus.cc:1275] T 522c3523f2af4eb29e30fa55da2acd3e P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:35.953462 4715 raft_consensus.cc:1275] T 522c3523f2af4eb29e30fa55da2acd3e P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260807 13:53:35.954196 4979 consensus_peers.cc:597] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 -> Peer 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729): Couldn't send request to peer 31d7630573c8475a9f84978d4ebfb879. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 522c3523f2af4eb29e30fa55da2acd3e. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:35.954237 9450 consensus_queue.cc:1048] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:35.954924 9450 consensus_queue.cc:1048] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:35.975550 9440 raft_consensus.cc:2955] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
W20260807 13:53:35.983372 4982 consensus_peers.cc:597] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eab259b597a64c04869543ccb1d9038c. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:35.984014 5248 raft_consensus.cc:2955] T 522c3523f2af4eb29e30fa55da2acd3e P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:35.992143 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:35.995592 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:35.999336 4715 raft_consensus.cc:2955] T 522c3523f2af4eb29e30fa55da2acd3e P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:36.005224 4518 catalog_manager.cc:5697] T 522c3523f2af4eb29e30fa55da2acd3e P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:36.017143 9636 ts_tablet_manager.cc:933] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:36.029621 4897 raft_consensus.cc:1275] T eab259b597a64c04869543ccb1d9038c P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:36.031080 9631 consensus_queue.cc:1048] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:36.035782 5248 raft_consensus.cc:1275] T eab259b597a64c04869543ccb1d9038c P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:36.036432 9440 consensus_queue.cc:1048] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:36.051889 9593 tablet_copy_client.cc:806] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:36.053735 9593 tablet_copy_client.cc:670] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:36.056236 9593 tablet_copy_client.cc:538] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:36.060803 9636 tablet_copy_client.cc:323] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:53:36.062170 9440 raft_consensus.cc:2955] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:36.070983 4897 consensus_queue.cc:237] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:36.076653 5245 raft_consensus.cc:2955] T eab259b597a64c04869543ccb1d9038c P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:36.080997 4896 raft_consensus.cc:2955] T eab259b597a64c04869543ccb1d9038c P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:36.090871 4518 catalog_manager.cc:5697] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:36.099335 4715 raft_consensus.cc:1275] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:36.100250 5072 raft_consensus.cc:1275] T 069a5f0089b24a609b27d4a07a3c4353 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260807 13:53:36.100785 4806 consensus_peers.cc:597] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 069a5f0089b24a609b27d4a07a3c4353. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:36.101011 9428 consensus_queue.cc:1048] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:36.103142 9593 tablet_bootstrap.cc:492] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap starting.
I20260807 13:53:36.105270 9428 consensus_queue.cc:1048] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:36.141124 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet d27ce55f2acc4513a9fd90a338098eeb from peer 12ab71778f2f4b378765aaed1a0676a5 ({username='slave'} at 127.23.107.134:57547)
I20260807 13:53:36.141360 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet d27ce55f2acc4513a9fd90a338098eeb from peer 12ab71778f2f4b378765aaed1a0676a5 at {username='slave'} at 127.23.107.134:57547: session id = 12ab71778f2f4b378765aaed1a0676a5-d27ce55f2acc4513a9fd90a338098eeb
I20260807 13:53:36.144594 5101 tablet_copy_source_session.cc:215] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:36.147217 9636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27ce55f2acc4513a9fd90a338098eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:36.148222 9428 raft_consensus.cc:2955] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:36.150056 4716 raft_consensus.cc:2955] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:36.155050 9636 tablet_copy_client.cc:806] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:36.156297 9636 tablet_copy_client.cc:670] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:36.158353 9636 tablet_copy_client.cc:538] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:36.161370 5074 raft_consensus.cc:2955] T 069a5f0089b24a609b27d4a07a3c4353 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:36.169190 4518 catalog_manager.cc:5697] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:36.187256 9636 tablet_bootstrap.cc:492] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap starting.
I20260807 13:53:36.245522 9593 tablet_bootstrap.cc:492] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:36.246062 9593 tablet_bootstrap.cc:492] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap complete.
I20260807 13:53:36.246447 9593 ts_tablet_manager.cc:1403] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent bootstrapping tablet: real 0.143s user 0.053s sys 0.004s
I20260807 13:53:36.247372 9593 raft_consensus.cc:359] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:36.247605 9593 raft_consensus.cc:740] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77f2b2eade540c6bfd4f75e5229a3cd, State: Initialized, Role: FOLLOWER
I20260807 13:53:36.250360 9593 consensus_queue.cc:260] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:36.265141 9593 ts_tablet_manager.cc:1434] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent starting tablet: real 0.019s user 0.012s sys 0.004s
I20260807 13:53:36.266115 4748 tablet_copy_service.cc:342] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Request end of tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-68717842b14e4f06b528c08a65acd3b7 received from {username='slave'} at 127.23.107.133:40143
I20260807 13:53:36.266278 4748 tablet_copy_service.cc:434] P fa83b7af134b4e3b949ac3b4e4bcb5e7: ending tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-68717842b14e4f06b528c08a65acd3b7 on tablet 68717842b14e4f06b528c08a65acd3b7 with peer b77f2b2eade540c6bfd4f75e5229a3cd
I20260807 13:53:36.301477 9636 tablet_bootstrap.cc:492] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:36.301999 9636 tablet_bootstrap.cc:492] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap complete.
I20260807 13:53:36.302359 9636 ts_tablet_manager.cc:1403] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5: Time spent bootstrapping tablet: real 0.115s user 0.054s sys 0.008s
I20260807 13:53:36.303381 9636 raft_consensus.cc:359] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:36.303651 9636 raft_consensus.cc:740] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Initialized, Role: FOLLOWER
I20260807 13:53:36.303983 9636 consensus_queue.cc:260] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:36.311604 9636 ts_tablet_manager.cc:1434] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5: Time spent starting tablet: real 0.009s user 0.006s sys 0.004s
I20260807 13:53:36.313390 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session 12ab71778f2f4b378765aaed1a0676a5-d27ce55f2acc4513a9fd90a338098eeb received from {username='slave'} at 127.23.107.134:57547
I20260807 13:53:36.313593 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session 12ab71778f2f4b378765aaed1a0676a5-d27ce55f2acc4513a9fd90a338098eeb on tablet d27ce55f2acc4513a9fd90a338098eeb with peer 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:53:36.452869 9636 ts_tablet_manager.cc:933] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:36.470230 5245 consensus_queue.cc:237] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:36.477280 9636 tablet_copy_client.cc:323] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:53:36.480965 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet eab259b597a64c04869543ccb1d9038c from peer 12ab71778f2f4b378765aaed1a0676a5 ({username='slave'} at 127.23.107.134:57547)
I20260807 13:53:36.481199 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet eab259b597a64c04869543ccb1d9038c from peer 12ab71778f2f4b378765aaed1a0676a5 at {username='slave'} at 127.23.107.134:57547: session id = 12ab71778f2f4b378765aaed1a0676a5-eab259b597a64c04869543ccb1d9038c
I20260807 13:53:36.485496 5101 tablet_copy_source_session.cc:215] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
W20260807 13:53:36.486184 5154 consensus_peers.cc:597] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 -> Peer 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): Couldn't send request to peer 8a9903f009ff46b4a6875490823076c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e93615e4fb61416d8740ce61970610af. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:36.486411 4896 raft_consensus.cc:1275] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:36.487538 9677 consensus_queue.cc:1048] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:36.490191 5074 raft_consensus.cc:1275] T e93615e4fb61416d8740ce61970610af P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:36.491225 9677 consensus_queue.cc:1048] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:36.506654 7354 raft_consensus.cc:1217] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:36.513367 9636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eab259b597a64c04869543ccb1d9038c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:36.525548 9677 raft_consensus.cc:2955] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:36.528276 5074 raft_consensus.cc:2955] T e93615e4fb61416d8740ce61970610af P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:36.553627 4511 catalog_manager.cc:5697] T e93615e4fb61416d8740ce61970610af P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index -1 to 4, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:36.554517 9636 tablet_copy_client.cc:806] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:36.564016 9636 tablet_copy_client.cc:670] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:36.567312 9749 ts_tablet_manager.cc:933] T 522c3523f2af4eb29e30fa55da2acd3e P 31d7630573c8475a9f84978d4ebfb879: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:36.568167 9747 ts_tablet_manager.cc:933] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: Initiating tablet copy from peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:53:36.570865 4896 raft_consensus.cc:2955] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:36.574967 9636 tablet_copy_client.cc:538] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:36.583168 9749 tablet_copy_client.cc:323] T 522c3523f2af4eb29e30fa55da2acd3e P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:53:36.584043 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet 522c3523f2af4eb29e30fa55da2acd3e from peer 31d7630573c8475a9f84978d4ebfb879 ({username='slave'} at 127.23.107.136:39013)
I20260807 13:53:36.584293 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet 522c3523f2af4eb29e30fa55da2acd3e from peer 31d7630573c8475a9f84978d4ebfb879 at {username='slave'} at 127.23.107.136:39013: session id = 31d7630573c8475a9f84978d4ebfb879-522c3523f2af4eb29e30fa55da2acd3e
I20260807 13:53:36.589437 5101 tablet_copy_source_session.cc:215] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:36.591352 9749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522c3523f2af4eb29e30fa55da2acd3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:36.592516 9636 tablet_bootstrap.cc:492] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap starting.
I20260807 13:53:36.595326 5245 consensus_queue.cc:237] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:36.605495 9749 tablet_copy_client.cc:806] T 522c3523f2af4eb29e30fa55da2acd3e P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:36.605912 9749 tablet_copy_client.cc:670] T 522c3523f2af4eb29e30fa55da2acd3e P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:36.608122 9749 tablet_copy_client.cc:538] T 522c3523f2af4eb29e30fa55da2acd3e P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260807 13:53:36.614660 5151 consensus_peers.cc:597] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 -> Peer 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729): Couldn't send request to peer 31d7630573c8475a9f84978d4ebfb879. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b414c896ad884facb339e5e4a0329065. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:36.615468 4715 raft_consensus.cc:1275] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:36.616374 9749 tablet_bootstrap.cc:492] T 522c3523f2af4eb29e30fa55da2acd3e P 31d7630573c8475a9f84978d4ebfb879: Bootstrap starting.
I20260807 13:53:36.616864 9387 consensus_queue.cc:1048] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:36.634338 5074 raft_consensus.cc:1275] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:36.635231 9677 consensus_queue.cc:1048] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:36.650486 9387 raft_consensus.cc:2955] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:36.661113 4716 raft_consensus.cc:2955] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:36.682219 5074 raft_consensus.cc:2955] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:36.686753 4511 catalog_manager.cc:5697] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:36.737901 7180 raft_consensus.cc:1217] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20260807 13:53:36.746095 5245 consensus_queue.cc:237] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:36.759583 4716 raft_consensus.cc:1275] T 242a68df09cb4c7d9522a33d259ebf78 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:36.760532 9387 consensus_queue.cc:1048] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260807 13:53:36.761987 5151 consensus_peers.cc:597] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 -> Peer 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729): Couldn't send request to peer 31d7630573c8475a9f84978d4ebfb879. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 242a68df09cb4c7d9522a33d259ebf78. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:36.762740 4896 raft_consensus.cc:1275] T 242a68df09cb4c7d9522a33d259ebf78 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:36.765617 9387 consensus_queue.cc:1048] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:36.786733 9387 raft_consensus.cc:2955] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:36.788699 4897 raft_consensus.cc:2955] T 242a68df09cb4c7d9522a33d259ebf78 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:36.798454 4517 catalog_manager.cc:5697] T 242a68df09cb4c7d9522a33d259ebf78 P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:36.811102 9747 tablet_copy_client.cc:323] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.130:37489
I20260807 13:53:36.812014 4921 tablet_copy_service.cc:140] P c9d2944272bc447dafce7620ac2dbd4b: Received BeginTabletCopySession request for tablet 069a5f0089b24a609b27d4a07a3c4353 from peer 12ab71778f2f4b378765aaed1a0676a5 ({username='slave'} at 127.23.107.134:40561)
I20260807 13:53:36.812275 4921 tablet_copy_service.cc:161] P c9d2944272bc447dafce7620ac2dbd4b: Beginning new tablet copy session on tablet 069a5f0089b24a609b27d4a07a3c4353 from peer 12ab71778f2f4b378765aaed1a0676a5 at {username='slave'} at 127.23.107.134:40561: session id = 12ab71778f2f4b378765aaed1a0676a5-069a5f0089b24a609b27d4a07a3c4353
I20260807 13:53:36.817109 4921 tablet_copy_source_session.cc:215] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:36.836222 4716 raft_consensus.cc:2955] T 242a68df09cb4c7d9522a33d259ebf78 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:36.837261 9747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 069a5f0089b24a609b27d4a07a3c4353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:36.915197 9747 tablet_copy_client.cc:806] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:36.915541 9747 tablet_copy_client.cc:670] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:36.924465 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:36.939344 9747 tablet_copy_client.cc:538] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:36.965205 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:36.975244 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:36.986922 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:36.996544 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:37.006431 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:37.024164 9749 tablet_bootstrap.cc:492] T 522c3523f2af4eb29e30fa55da2acd3e P 31d7630573c8475a9f84978d4ebfb879: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:37.024708 9749 tablet_bootstrap.cc:492] T 522c3523f2af4eb29e30fa55da2acd3e P 31d7630573c8475a9f84978d4ebfb879: Bootstrap complete.
I20260807 13:53:37.025030 9749 ts_tablet_manager.cc:1403] T 522c3523f2af4eb29e30fa55da2acd3e P 31d7630573c8475a9f84978d4ebfb879: Time spent bootstrapping tablet: real 0.409s user 0.058s sys 0.036s
I20260807 13:53:37.033753 9747 tablet_bootstrap.cc:492] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap starting.
I20260807 13:53:37.039359 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:37.059701 9749 raft_consensus.cc:359] T 522c3523f2af4eb29e30fa55da2acd3e P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:37.060161 9749 raft_consensus.cc:740] T 522c3523f2af4eb29e30fa55da2acd3e P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d7630573c8475a9f84978d4ebfb879, State: Initialized, Role: FOLLOWER
I20260807 13:53:37.060578 9749 consensus_queue.cc:260] T 522c3523f2af4eb29e30fa55da2acd3e P 31d7630573c8475a9f84978d4ebfb879 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:37.100028 9749 ts_tablet_manager.cc:1434] T 522c3523f2af4eb29e30fa55da2acd3e P 31d7630573c8475a9f84978d4ebfb879: Time spent starting tablet: real 0.075s user 0.005s sys 0.001s
I20260807 13:53:37.101305 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session 31d7630573c8475a9f84978d4ebfb879-522c3523f2af4eb29e30fa55da2acd3e received from {username='slave'} at 127.23.107.136:39013
I20260807 13:53:37.101583 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session 31d7630573c8475a9f84978d4ebfb879-522c3523f2af4eb29e30fa55da2acd3e on tablet 522c3523f2af4eb29e30fa55da2acd3e with peer 31d7630573c8475a9f84978d4ebfb879
I20260807 13:53:37.103180 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:37.103704 9865 ts_tablet_manager.cc:933] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:37.136085 9636 tablet_bootstrap.cc:492] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:37.138612 9636 tablet_bootstrap.cc:492] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap complete.
I20260807 13:53:37.140406 9636 ts_tablet_manager.cc:1403] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5: Time spent bootstrapping tablet: real 0.548s user 0.058s sys 0.021s
I20260807 13:53:37.141522 9636 raft_consensus.cc:359] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:37.141942 9636 raft_consensus.cc:740] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Initialized, Role: FOLLOWER
I20260807 13:53:37.142282 9636 consensus_queue.cc:260] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:37.145612 9865 tablet_copy_client.cc:323] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:53:37.146869 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet e93615e4fb61416d8740ce61970610af from peer 8a9903f009ff46b4a6875490823076c4 ({username='slave'} at 127.23.107.135:38881)
I20260807 13:53:37.147107 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet e93615e4fb61416d8740ce61970610af from peer 8a9903f009ff46b4a6875490823076c4 at {username='slave'} at 127.23.107.135:38881: session id = 8a9903f009ff46b4a6875490823076c4-e93615e4fb61416d8740ce61970610af
I20260807 13:53:37.147682 9636 ts_tablet_manager.cc:1434] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260807 13:53:37.150863 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session 12ab71778f2f4b378765aaed1a0676a5-eab259b597a64c04869543ccb1d9038c received from {username='slave'} at 127.23.107.134:57547
I20260807 13:53:37.151065 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session 12ab71778f2f4b378765aaed1a0676a5-eab259b597a64c04869543ccb1d9038c on tablet eab259b597a64c04869543ccb1d9038c with peer 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:53:37.153983 5272 tablet_copy_source_session.cc:215] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:37.158301 9865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93615e4fb61416d8740ce61970610af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:37.166998 9865 tablet_copy_client.cc:806] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:37.167387 9865 tablet_copy_client.cc:670] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:37.173389 4896 consensus_queue.cc:237] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:37.178515 9865 tablet_copy_client.cc:538] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:37.192039 9749 ts_tablet_manager.cc:933] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:37.194373 9865 tablet_bootstrap.cc:492] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4: Bootstrap starting.
I20260807 13:53:37.225898 9749 tablet_copy_client.cc:323] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:53:37.228214 7354 raft_consensus.cc:1275] T 782ac4fa94fb4183940fca514cc068b0 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:37.229966 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet b414c896ad884facb339e5e4a0329065 from peer 31d7630573c8475a9f84978d4ebfb879 ({username='slave'} at 127.23.107.136:35045)
I20260807 13:53:37.230197 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet b414c896ad884facb339e5e4a0329065 from peer 31d7630573c8475a9f84978d4ebfb879 at {username='slave'} at 127.23.107.136:35045: session id = 31d7630573c8475a9f84978d4ebfb879-b414c896ad884facb339e5e4a0329065
I20260807 13:53:37.238238 4716 raft_consensus.cc:1275] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:37.241482 5245 raft_consensus.cc:1275] T 782ac4fa94fb4183940fca514cc068b0 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
W20260807 13:53:37.246302 4806 consensus_peers.cc:597] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b -> Peer 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): Couldn't send request to peer 8a9903f009ff46b4a6875490823076c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 782ac4fa94fb4183940fca514cc068b0. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:37.247071 9428 consensus_queue.cc:1048] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:37.247946 9428 consensus_queue.cc:1048] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:37.248591 9428 consensus_queue.cc:1048] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:37.262347 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:37.263239 5272 tablet_copy_source_session.cc:215] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:37.265761 9749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b414c896ad884facb339e5e4a0329065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:37.274827 9749 tablet_copy_client.cc:806] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:37.275735 9749 tablet_copy_client.cc:670] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:37.285754 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:37.307734 9749 tablet_copy_client.cc:538] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260807 13:53:37.315652 4806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.134:35975, user_credentials={real_user=slave}} blocked reactor thread for 69005.1us
I20260807 13:53:37.342518 9749 tablet_bootstrap.cc:492] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap starting.
I20260807 13:53:37.347131 9892 ts_tablet_manager.cc:933] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:37.352533 9889 raft_consensus.cc:2955] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:37.353165 5245 raft_consensus.cc:2955] T 782ac4fa94fb4183940fca514cc068b0 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:37.362722 4518 catalog_manager.cc:5697] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index 4 to 5, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:37.370038 4716 raft_consensus.cc:2955] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:37.372831 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:37.392953 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:37.412212 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:37.418183 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:37.423605 9892 tablet_copy_client.cc:323] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:53:37.440951 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet 242a68df09cb4c7d9522a33d259ebf78 from peer 31d7630573c8475a9f84978d4ebfb879 ({username='slave'} at 127.23.107.136:35045)
I20260807 13:53:37.441161 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet 242a68df09cb4c7d9522a33d259ebf78 from peer 31d7630573c8475a9f84978d4ebfb879 at {username='slave'} at 127.23.107.136:35045: session id = 31d7630573c8475a9f84978d4ebfb879-242a68df09cb4c7d9522a33d259ebf78
I20260807 13:53:37.445644 5272 tablet_copy_source_session.cc:215] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:37.446888 9865 tablet_bootstrap.cc:492] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:37.447337 9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242a68df09cb4c7d9522a33d259ebf78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:37.447521 9865 tablet_bootstrap.cc:492] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4: Bootstrap complete.
I20260807 13:53:37.447894 9865 ts_tablet_manager.cc:1403] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4: Time spent bootstrapping tablet: real 0.254s user 0.065s sys 0.038s
I20260807 13:53:37.448835 9865 raft_consensus.cc:359] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:37.449086 9865 raft_consensus.cc:740] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a9903f009ff46b4a6875490823076c4, State: Initialized, Role: FOLLOWER
I20260807 13:53:37.449406 9865 consensus_queue.cc:260] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:37.459447 7354 raft_consensus.cc:2955] T 782ac4fa94fb4183940fca514cc068b0 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:37.489153 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:37.493176 7353 raft_consensus.cc:1217] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:37.512272 9865 ts_tablet_manager.cc:1434] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4: Time spent starting tablet: real 0.064s user 0.020s sys 0.016s
I20260807 13:53:37.513258 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session 8a9903f009ff46b4a6875490823076c4-e93615e4fb61416d8740ce61970610af received from {username='slave'} at 127.23.107.135:38881
I20260807 13:53:37.513454 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session 8a9903f009ff46b4a6875490823076c4-e93615e4fb61416d8740ce61970610af on tablet e93615e4fb61416d8740ce61970610af with peer 8a9903f009ff46b4a6875490823076c4
I20260807 13:53:37.528761 9892 tablet_copy_client.cc:806] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:37.529134 9892 tablet_copy_client.cc:670] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:37.531282 9892 tablet_copy_client.cc:538] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:37.532545 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:37.535552 9892 tablet_bootstrap.cc:492] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap starting.
I20260807 13:53:37.564582 7690 raft_consensus.cc:1217] T 522c3523f2af4eb29e30fa55da2acd3e P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:37.604892 9747 tablet_bootstrap.cc:492] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:37.610743 9747 tablet_bootstrap.cc:492] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap complete.
I20260807 13:53:37.611097 9747 ts_tablet_manager.cc:1403] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: Time spent bootstrapping tablet: real 0.577s user 0.054s sys 0.006s
I20260807 13:53:37.614092 9747 raft_consensus.cc:359] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:37.614360 9747 raft_consensus.cc:740] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Initialized, Role: FOLLOWER
I20260807 13:53:37.614671 9747 consensus_queue.cc:260] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:37.616179 9747 ts_tablet_manager.cc:1434] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260807 13:53:37.617763 4921 tablet_copy_service.cc:342] P c9d2944272bc447dafce7620ac2dbd4b: Request end of tablet copy session 12ab71778f2f4b378765aaed1a0676a5-069a5f0089b24a609b27d4a07a3c4353 received from {username='slave'} at 127.23.107.134:40561
I20260807 13:53:37.617916 4921 tablet_copy_service.cc:434] P c9d2944272bc447dafce7620ac2dbd4b: ending tablet copy session 12ab71778f2f4b378765aaed1a0676a5-069a5f0089b24a609b27d4a07a3c4353 on tablet 069a5f0089b24a609b27d4a07a3c4353 with peer 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:53:37.637423 7523 raft_consensus.cc:1217] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:37.639250 7354 raft_consensus.cc:1217] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:37.676261 9892 tablet_bootstrap.cc:492] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:37.676893 9892 tablet_bootstrap.cc:492] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap complete.
I20260807 13:53:37.677243 9892 ts_tablet_manager.cc:1403] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879: Time spent bootstrapping tablet: real 0.142s user 0.061s sys 0.003s
I20260807 13:53:37.678391 9892 raft_consensus.cc:359] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:37.680706 9892 raft_consensus.cc:740] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d7630573c8475a9f84978d4ebfb879, State: Initialized, Role: FOLLOWER
I20260807 13:53:37.681139 9892 consensus_queue.cc:260] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:37.683355 9892 ts_tablet_manager.cc:1434] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260807 13:53:37.684198 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session 31d7630573c8475a9f84978d4ebfb879-242a68df09cb4c7d9522a33d259ebf78 received from {username='slave'} at 127.23.107.136:35045
I20260807 13:53:37.684355 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session 31d7630573c8475a9f84978d4ebfb879-242a68df09cb4c7d9522a33d259ebf78 on tablet 242a68df09cb4c7d9522a33d259ebf78 with peer 31d7630573c8475a9f84978d4ebfb879
I20260807 13:53:37.700670 9749 tablet_bootstrap.cc:492] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:37.701265 9749 tablet_bootstrap.cc:492] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap complete.
I20260807 13:53:37.701601 9749 ts_tablet_manager.cc:1403] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879: Time spent bootstrapping tablet: real 0.359s user 0.053s sys 0.003s
I20260807 13:53:37.702574 9749 raft_consensus.cc:359] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:37.702783 9749 raft_consensus.cc:740] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d7630573c8475a9f84978d4ebfb879, State: Initialized, Role: FOLLOWER
I20260807 13:53:37.707361 9749 consensus_queue.cc:260] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:37.710960 9749 ts_tablet_manager.cc:1434] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260807 13:53:37.716059 5074 consensus_queue.cc:237] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:37.716257 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session 31d7630573c8475a9f84978d4ebfb879-b414c896ad884facb339e5e4a0329065 received from {username='slave'} at 127.23.107.136:35045
I20260807 13:53:37.716405 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session 31d7630573c8475a9f84978d4ebfb879-b414c896ad884facb339e5e4a0329065 on tablet b414c896ad884facb339e5e4a0329065 with peer 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:37.732044 4982 consensus_peers.cc:597] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 81cbb42cd4954383976169ec16ef2416. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:37.733605 4896 raft_consensus.cc:1275] T 81cbb42cd4954383976169ec16ef2416 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:37.733652 4716 raft_consensus.cc:1275] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:37.734298 9631 consensus_queue.cc:1048] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:37.734628 9635 consensus_queue.cc:1048] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:37.748550 7690 raft_consensus.cc:1217] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:37.769097 9631 raft_consensus.cc:2955] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:37.769733 4896 raft_consensus.cc:2955] T 81cbb42cd4954383976169ec16ef2416 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:37.788594 4517 catalog_manager.cc:5697] T 81cbb42cd4954383976169ec16ef2416 P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:37.798233 4716 raft_consensus.cc:2955] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:37.849473 9865 ts_tablet_manager.cc:933] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4: Initiating tablet copy from peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:53:37.862502 9865 tablet_copy_client.cc:323] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.130:37489
I20260807 13:53:37.863720 4921 tablet_copy_service.cc:140] P c9d2944272bc447dafce7620ac2dbd4b: Received BeginTabletCopySession request for tablet 782ac4fa94fb4183940fca514cc068b0 from peer 8a9903f009ff46b4a6875490823076c4 ({username='slave'} at 127.23.107.135:57651)
I20260807 13:53:37.863934 4921 tablet_copy_service.cc:161] P c9d2944272bc447dafce7620ac2dbd4b: Beginning new tablet copy session on tablet 782ac4fa94fb4183940fca514cc068b0 from peer 8a9903f009ff46b4a6875490823076c4 at {username='slave'} at 127.23.107.135:57651: session id = 8a9903f009ff46b4a6875490823076c4-782ac4fa94fb4183940fca514cc068b0
I20260807 13:53:37.868167 4921 tablet_copy_source_session.cc:215] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:37.870335 9865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 782ac4fa94fb4183940fca514cc068b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:37.879221 9865 tablet_copy_client.cc:806] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:37.879606 9865 tablet_copy_client.cc:670] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:37.881734 9865 tablet_copy_client.cc:538] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:37.885816 9865 tablet_bootstrap.cc:492] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4: Bootstrap starting.
I20260807 13:53:37.994545 9865 tablet_bootstrap.cc:492] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:37.995280 9865 tablet_bootstrap.cc:492] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4: Bootstrap complete.
I20260807 13:53:37.995695 9865 ts_tablet_manager.cc:1403] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4: Time spent bootstrapping tablet: real 0.110s user 0.065s sys 0.020s
I20260807 13:53:37.996833 9865 raft_consensus.cc:359] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:37.997232 9865 raft_consensus.cc:740] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a9903f009ff46b4a6875490823076c4, State: Initialized, Role: FOLLOWER
I20260807 13:53:37.997736 9865 consensus_queue.cc:260] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:37.998579 9865 ts_tablet_manager.cc:1434] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260807 13:53:38.002490 4921 tablet_copy_service.cc:342] P c9d2944272bc447dafce7620ac2dbd4b: Request end of tablet copy session 8a9903f009ff46b4a6875490823076c4-782ac4fa94fb4183940fca514cc068b0 received from {username='slave'} at 127.23.107.135:57651
I20260807 13:53:38.002701 4921 tablet_copy_service.cc:434] P c9d2944272bc447dafce7620ac2dbd4b: ending tablet copy session 8a9903f009ff46b4a6875490823076c4-782ac4fa94fb4183940fca514cc068b0 on tablet 782ac4fa94fb4183940fca514cc068b0 with peer 8a9903f009ff46b4a6875490823076c4
I20260807 13:53:38.095192 7690 raft_consensus.cc:1217] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:38.138547 5245 consensus_queue.cc:237] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
W20260807 13:53:38.145277 5151 consensus_peers.cc:597] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 -> Peer 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729): Couldn't send request to peer 31d7630573c8475a9f84978d4ebfb879. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 50a090faa58e4f91961c9251030efacf. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:38.146998 4896 raft_consensus.cc:1275] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:38.148304 4716 raft_consensus.cc:1275] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:38.149185 10046 consensus_queue.cc:1048] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:38.150286 10046 consensus_queue.cc:1048] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:38.176683 9387 raft_consensus.cc:2955] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:38.194317 4896 raft_consensus.cc:2955] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:38.205240 4517 catalog_manager.cc:5697] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:38.210420 4716 raft_consensus.cc:2955] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:38.279338 10093 ts_tablet_manager.cc:933] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:38.312090 10093 tablet_copy_client.cc:323] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:53:38.314268 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet 81cbb42cd4954383976169ec16ef2416 from peer 12ab71778f2f4b378765aaed1a0676a5 ({username='slave'} at 127.23.107.134:57547)
I20260807 13:53:38.314476 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet 81cbb42cd4954383976169ec16ef2416 from peer 12ab71778f2f4b378765aaed1a0676a5 at {username='slave'} at 127.23.107.134:57547: session id = 12ab71778f2f4b378765aaed1a0676a5-81cbb42cd4954383976169ec16ef2416
I20260807 13:53:38.326484 5101 tablet_copy_source_session.cc:215] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:38.352993 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:38.353711 10093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81cbb42cd4954383976169ec16ef2416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:38.386468 7523 raft_consensus.cc:1217] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20260807 13:53:38.396715 10093 tablet_copy_client.cc:806] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:38.397074 10093 tablet_copy_client.cc:670] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:38.414851 10093 tablet_copy_client.cc:538] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:38.421757 10093 tablet_bootstrap.cc:492] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap starting.
I20260807 13:53:38.501463 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:38.522305 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:38.523093 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:38.553804 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:38.556102 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:38.569790 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:38.580132 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:38.589780 10153 ts_tablet_manager.cc:933] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:38.594309 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:38.597481 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:38.602837 10153 tablet_copy_client.cc:323] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:53:38.603814 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet 50a090faa58e4f91961c9251030efacf from peer 31d7630573c8475a9f84978d4ebfb879 ({username='slave'} at 127.23.107.136:35045)
I20260807 13:53:38.603981 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet 50a090faa58e4f91961c9251030efacf from peer 31d7630573c8475a9f84978d4ebfb879 at {username='slave'} at 127.23.107.136:35045: session id = 31d7630573c8475a9f84978d4ebfb879-50a090faa58e4f91961c9251030efacf
I20260807 13:53:38.607369 5272 tablet_copy_source_session.cc:215] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:38.609201 10153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a090faa58e4f91961c9251030efacf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:38.636677 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:38.639792 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:38.643141 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:38.669808 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:38.688349 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:38.741703 10153 tablet_copy_client.cc:806] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:38.742270 10153 tablet_copy_client.cc:670] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:38.782495 10153 tablet_copy_client.cc:538] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:38.841461 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:38.885133 10153 tablet_bootstrap.cc:492] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879: Bootstrap starting.
W20260807 13:53:38.954208 4632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:41217, user_credentials={real_user=slave}} blocked reactor thread for 88095.2us
I20260807 13:53:38.970022 10093 tablet_bootstrap.cc:492] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:38.970676 10093 tablet_bootstrap.cc:492] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap complete.
I20260807 13:53:38.971041 10093 ts_tablet_manager.cc:1403] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5: Time spent bootstrapping tablet: real 0.549s user 0.075s sys 0.027s
I20260807 13:53:38.971962 10093 raft_consensus.cc:359] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:38.972285 10093 raft_consensus.cc:740] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Initialized, Role: FOLLOWER
I20260807 13:53:38.972688 10093 consensus_queue.cc:260] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:39.048972 10093 ts_tablet_manager.cc:1434] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5: Time spent starting tablet: real 0.078s user 0.027s sys 0.044s
I20260807 13:53:39.050069 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session 12ab71778f2f4b378765aaed1a0676a5-81cbb42cd4954383976169ec16ef2416 received from {username='slave'} at 127.23.107.134:57547
I20260807 13:53:39.050231 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session 12ab71778f2f4b378765aaed1a0676a5-81cbb42cd4954383976169ec16ef2416 on tablet 81cbb42cd4954383976169ec16ef2416 with peer 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:53:39.147719 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:39.163406 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:39.174636 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:39.237246 4716 consensus_queue.cc:237] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:39.262496 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:39.289675 7354 raft_consensus.cc:1217] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:39.294231 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260807 13:53:39.296681 4632 consensus_peers.cc:597] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: faef317e47a244c6965864f82f21edfa. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:39.305898 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:39.306103 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:39.307730 4896 raft_consensus.cc:1275] T faef317e47a244c6965864f82f21edfa P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:39.312186 10186 consensus_queue.cc:1048] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:39.321547 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:39.326617 10153 tablet_bootstrap.cc:492] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:39.327246 10153 tablet_bootstrap.cc:492] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879: Bootstrap complete.
I20260807 13:53:39.327596 10153 ts_tablet_manager.cc:1403] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879: Time spent bootstrapping tablet: real 0.443s user 0.044s sys 0.009s
I20260807 13:53:39.337951 10153 raft_consensus.cc:359] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:39.338241 10153 raft_consensus.cc:740] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d7630573c8475a9f84978d4ebfb879, State: Initialized, Role: FOLLOWER
I20260807 13:53:39.364986 10153 consensus_queue.cc:260] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:39.393289 5074 raft_consensus.cc:1275] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:39.395380 10186 consensus_queue.cc:1048] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:39.402264 10153 ts_tablet_manager.cc:1434] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879: Time spent starting tablet: real 0.074s user 0.006s sys 0.000s
I20260807 13:53:39.403617 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session 31d7630573c8475a9f84978d4ebfb879-50a090faa58e4f91961c9251030efacf received from {username='slave'} at 127.23.107.136:35045
I20260807 13:53:39.403784 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session 31d7630573c8475a9f84978d4ebfb879-50a090faa58e4f91961c9251030efacf on tablet 50a090faa58e4f91961c9251030efacf with peer 31d7630573c8475a9f84978d4ebfb879
I20260807 13:53:39.406473 10194 raft_consensus.cc:2955] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:39.412649 4892 raft_consensus.cc:2955] T faef317e47a244c6965864f82f21edfa P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:39.417172 4511 catalog_manager.cc:5697] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:39.421555 5068 raft_consensus.cc:2955] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:39.741380 4716 consensus_queue.cc:237] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:39.745832 5068 raft_consensus.cc:1275] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
W20260807 13:53:39.746019 4632 consensus_peers.cc:597] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): Couldn't send request to peer 8a9903f009ff46b4a6875490823076c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: faef317e47a244c6965864f82f21edfa. This is attempt 1: this message will repeat every 5th retry.
W20260807 13:53:39.746639 4632 consensus_peers.cc:597] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: faef317e47a244c6965864f82f21edfa. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:39.746719 10104 consensus_queue.cc:1048] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:39.749954 4896 raft_consensus.cc:1275] T faef317e47a244c6965864f82f21edfa P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:39.750669 10104 consensus_queue.cc:1048] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:39.754160 10104 raft_consensus.cc:2955] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:39.758723 4896 raft_consensus.cc:2955] T faef317e47a244c6965864f82f21edfa P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:39.787030 5068 raft_consensus.cc:2955] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:39.793017 4518 catalog_manager.cc:5697] T faef317e47a244c6965864f82f21edfa P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index 4 to 5, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:39.802233 7690 raft_consensus.cc:1217] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:39.848842 5068 consensus_queue.cc:237] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:39.870529 4716 raft_consensus.cc:1275] T 16afb6ff06704a8795f1de84ffa81de0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:39.871721 10103 consensus_queue.cc:1048] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:39.888376 4896 raft_consensus.cc:1275] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:39.889452 10103 consensus_queue.cc:1048] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260807 13:53:39.891976 4982 consensus_peers.cc:597] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 -> Peer 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): Couldn't send request to peer 8a9903f009ff46b4a6875490823076c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 16afb6ff06704a8795f1de84ffa81de0. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:39.925125 10103 raft_consensus.cc:2955] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:39.939551 4511 catalog_manager.cc:5697] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index -1 to 4, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:39.941110 4716 raft_consensus.cc:2955] T 16afb6ff06704a8795f1de84ffa81de0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:39.964725 4896 raft_consensus.cc:2955] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:39.968276 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:39.997818 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:40.007586 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:40.029389 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:40.062223 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:40.110834 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:40.156975 10413 ts_tablet_manager.cc:933] T faef317e47a244c6965864f82f21edfa P 8a9903f009ff46b4a6875490823076c4: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:53:40.168083 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:40.170440 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:40.170563 10413 tablet_copy_client.cc:323] T faef317e47a244c6965864f82f21edfa P 8a9903f009ff46b4a6875490823076c4: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:53:40.171415 4748 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet faef317e47a244c6965864f82f21edfa from peer 8a9903f009ff46b4a6875490823076c4 ({username='slave'} at 127.23.107.135:56247)
I20260807 13:53:40.171615 4748 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet faef317e47a244c6965864f82f21edfa from peer 8a9903f009ff46b4a6875490823076c4 at {username='slave'} at 127.23.107.135:56247: session id = 8a9903f009ff46b4a6875490823076c4-faef317e47a244c6965864f82f21edfa
I20260807 13:53:40.176318 4748 tablet_copy_source_session.cc:215] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:40.189416 10413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faef317e47a244c6965864f82f21edfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:40.200459 10417 ts_tablet_manager.cc:933] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:53:40.223552 5068 consensus_queue.cc:237] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:40.233772 10417 tablet_copy_client.cc:323] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:53:40.234716 4748 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet faef317e47a244c6965864f82f21edfa from peer 12ab71778f2f4b378765aaed1a0676a5 ({username='slave'} at 127.23.107.134:34891)
I20260807 13:53:40.234952 4748 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet faef317e47a244c6965864f82f21edfa from peer 12ab71778f2f4b378765aaed1a0676a5 at {username='slave'} at 127.23.107.134:34891: session id = 12ab71778f2f4b378765aaed1a0676a5-faef317e47a244c6965864f82f21edfa
I20260807 13:53:40.240124 4748 tablet_copy_source_session.cc:215] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:40.242053 10417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faef317e47a244c6965864f82f21edfa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 13:53:40.249270 4982 consensus_peers.cc:597] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 739f4f0207104455bf3e87bc04f8d13c. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:40.250022 4715 raft_consensus.cc:1275] T 739f4f0207104455bf3e87bc04f8d13c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:40.251151 10365 consensus_queue.cc:1048] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:40.251438 10413 tablet_copy_client.cc:806] T faef317e47a244c6965864f82f21edfa P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:40.251869 10413 tablet_copy_client.cc:670] T faef317e47a244c6965864f82f21edfa P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:40.254371 10413 tablet_copy_client.cc:538] T faef317e47a244c6965864f82f21edfa P 8a9903f009ff46b4a6875490823076c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:40.258780 5248 raft_consensus.cc:1275] T 739f4f0207104455bf3e87bc04f8d13c P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:53:40.259811 10365 consensus_queue.cc:1048] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:53:40.276023 10365 raft_consensus.cc:2955] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:40.282284 5248 raft_consensus.cc:2955] T 739f4f0207104455bf3e87bc04f8d13c P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:40.285920 4715 raft_consensus.cc:2955] T 739f4f0207104455bf3e87bc04f8d13c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:40.288175 4518 catalog_manager.cc:5697] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index -1 to 4, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:40.294644 10417 tablet_copy_client.cc:806] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:40.296123 10417 tablet_copy_client.cc:670] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:40.303022 10413 tablet_bootstrap.cc:492] T faef317e47a244c6965864f82f21edfa P 8a9903f009ff46b4a6875490823076c4: Bootstrap starting.
I20260807 13:53:40.324059 10417 tablet_copy_client.cc:538] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:40.337364 10417 tablet_bootstrap.cc:492] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap starting.
I20260807 13:53:40.384260 10456 ts_tablet_manager.cc:933] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:40.431071 10456 tablet_copy_client.cc:323] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:53:40.432161 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet 16afb6ff06704a8795f1de84ffa81de0 from peer 8a9903f009ff46b4a6875490823076c4 ({username='slave'} at 127.23.107.135:53271)
I20260807 13:53:40.432379 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet 16afb6ff06704a8795f1de84ffa81de0 from peer 8a9903f009ff46b4a6875490823076c4 at {username='slave'} at 127.23.107.135:53271: session id = 8a9903f009ff46b4a6875490823076c4-16afb6ff06704a8795f1de84ffa81de0
I20260807 13:53:40.436131 5101 tablet_copy_source_session.cc:215] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:40.443473 10456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16afb6ff06704a8795f1de84ffa81de0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:40.468549 10456 tablet_copy_client.cc:806] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:40.468892 10456 tablet_copy_client.cc:670] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:40.485745 10456 tablet_copy_client.cc:538] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:40.494158 10456 tablet_bootstrap.cc:492] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4: Bootstrap starting.
I20260807 13:53:40.496971 10413 tablet_bootstrap.cc:492] T faef317e47a244c6965864f82f21edfa P 8a9903f009ff46b4a6875490823076c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:40.497534 10413 tablet_bootstrap.cc:492] T faef317e47a244c6965864f82f21edfa P 8a9903f009ff46b4a6875490823076c4: Bootstrap complete.
I20260807 13:53:40.497891 10413 ts_tablet_manager.cc:1403] T faef317e47a244c6965864f82f21edfa P 8a9903f009ff46b4a6875490823076c4: Time spent bootstrapping tablet: real 0.195s user 0.059s sys 0.001s
I20260807 13:53:40.498843 10413 raft_consensus.cc:359] T faef317e47a244c6965864f82f21edfa P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:40.499168 10413 raft_consensus.cc:740] T faef317e47a244c6965864f82f21edfa P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a9903f009ff46b4a6875490823076c4, State: Initialized, Role: FOLLOWER
I20260807 13:53:40.499600 10413 consensus_queue.cc:260] T faef317e47a244c6965864f82f21edfa P 8a9903f009ff46b4a6875490823076c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:40.503355 10413 ts_tablet_manager.cc:1434] T faef317e47a244c6965864f82f21edfa P 8a9903f009ff46b4a6875490823076c4: Time spent starting tablet: real 0.005s user 0.000s sys 0.005s
I20260807 13:53:40.504768 4748 tablet_copy_service.cc:342] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Request end of tablet copy session 8a9903f009ff46b4a6875490823076c4-faef317e47a244c6965864f82f21edfa received from {username='slave'} at 127.23.107.135:56247
I20260807 13:53:40.504974 4748 tablet_copy_service.cc:434] P fa83b7af134b4e3b949ac3b4e4bcb5e7: ending tablet copy session 8a9903f009ff46b4a6875490823076c4-faef317e47a244c6965864f82f21edfa on tablet faef317e47a244c6965864f82f21edfa with peer 8a9903f009ff46b4a6875490823076c4
I20260807 13:53:40.560523 4715 consensus_queue.cc:237] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
W20260807 13:53:40.573947 4632 consensus_peers.cc:597] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:40.574395 7523 raft_consensus.cc:1275] T faef317e47a244c6965864f82f21edfa P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:53:40.575304 10194 consensus_queue.cc:1048] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:53:40.579052 5068 raft_consensus.cc:1275] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:53:40.580516 10194 consensus_queue.cc:1048] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:53:40.581318 10417 tablet_bootstrap.cc:492] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:40.581992 10417 tablet_bootstrap.cc:492] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap complete.
I20260807 13:53:40.582353 10417 ts_tablet_manager.cc:1403] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5: Time spent bootstrapping tablet: real 0.249s user 0.064s sys 0.024s
I20260807 13:53:40.583324 10417 raft_consensus.cc:359] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:40.583864 10417 raft_consensus.cc:740] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Initialized, Role: FOLLOWER
I20260807 13:53:40.584280 10417 consensus_queue.cc:260] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:40.606767 10417 ts_tablet_manager.cc:1434] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5: Time spent starting tablet: real 0.024s user 0.006s sys 0.003s
I20260807 13:53:40.610093 4748 tablet_copy_service.cc:342] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Request end of tablet copy session 12ab71778f2f4b378765aaed1a0676a5-faef317e47a244c6965864f82f21edfa received from {username='slave'} at 127.23.107.134:34891
I20260807 13:53:40.610311 4748 tablet_copy_service.cc:434] P fa83b7af134b4e3b949ac3b4e4bcb5e7: ending tablet copy session 12ab71778f2f4b378765aaed1a0676a5-faef317e47a244c6965864f82f21edfa on tablet faef317e47a244c6965864f82f21edfa with peer 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:53:40.611094 4896 raft_consensus.cc:1275] T faef317e47a244c6965864f82f21edfa P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:53:40.618501 10194 consensus_queue.cc:1048] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:53:40.624181 10194 raft_consensus.cc:2955] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:40.641088 4896 raft_consensus.cc:2955] T faef317e47a244c6965864f82f21edfa P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:40.650669 4517 catalog_manager.cc:5697] T faef317e47a244c6965864f82f21edfa P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index 5 to 6, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
W20260807 13:53:40.651849 4629 consensus_peers.cc:597] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729): Couldn't send request to peer 31d7630573c8475a9f84978d4ebfb879. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: faef317e47a244c6965864f82f21edfa. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:40.660382 10456 tablet_bootstrap.cc:492] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:40.661279 10456 tablet_bootstrap.cc:492] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4: Bootstrap complete.
I20260807 13:53:40.661664 10456 ts_tablet_manager.cc:1403] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4: Time spent bootstrapping tablet: real 0.168s user 0.083s sys 0.026s
I20260807 13:53:40.662518 10456 raft_consensus.cc:359] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:40.662878 10456 raft_consensus.cc:740] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a9903f009ff46b4a6875490823076c4, State: Initialized, Role: FOLLOWER
I20260807 13:53:40.664125 10456 consensus_queue.cc:260] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:40.667286 10456 ts_tablet_manager.cc:1434] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260807 13:53:40.670116 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session 8a9903f009ff46b4a6875490823076c4-16afb6ff06704a8795f1de84ffa81de0 received from {username='slave'} at 127.23.107.135:53271
I20260807 13:53:40.670347 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session 8a9903f009ff46b4a6875490823076c4-16afb6ff06704a8795f1de84ffa81de0 on tablet 16afb6ff06704a8795f1de84ffa81de0 with peer 8a9903f009ff46b4a6875490823076c4
I20260807 13:53:40.681533 5068 raft_consensus.cc:2955] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:40.717249 7523 raft_consensus.cc:2955] T faef317e47a244c6965864f82f21edfa P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:40.737612 7523 raft_consensus.cc:1217] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20260807 13:53:40.756547 10417 ts_tablet_manager.cc:933] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:40.813687 10417 tablet_copy_client.cc:323] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:53:40.814774 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet 739f4f0207104455bf3e87bc04f8d13c from peer 12ab71778f2f4b378765aaed1a0676a5 ({username='slave'} at 127.23.107.134:57547)
I20260807 13:53:40.815023 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet 739f4f0207104455bf3e87bc04f8d13c from peer 12ab71778f2f4b378765aaed1a0676a5 at {username='slave'} at 127.23.107.134:57547: session id = 12ab71778f2f4b378765aaed1a0676a5-739f4f0207104455bf3e87bc04f8d13c
I20260807 13:53:40.826804 5101 tablet_copy_source_session.cc:215] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:40.831233 10417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739f4f0207104455bf3e87bc04f8d13c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:40.867973 10417 tablet_copy_client.cc:806] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:40.868935 10417 tablet_copy_client.cc:670] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:40.883632 10417 tablet_copy_client.cc:538] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:40.901217 10417 tablet_bootstrap.cc:492] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap starting.
I20260807 13:53:41.125605 10417 tablet_bootstrap.cc:492] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:41.126871 10417 tablet_bootstrap.cc:492] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap complete.
I20260807 13:53:41.127259 10417 ts_tablet_manager.cc:1403] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5: Time spent bootstrapping tablet: real 0.226s user 0.084s sys 0.018s
I20260807 13:53:41.130551 10417 raft_consensus.cc:359] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:41.130851 10417 raft_consensus.cc:740] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Initialized, Role: FOLLOWER
I20260807 13:53:41.132308 10417 consensus_queue.cc:260] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:41.194339 7354 raft_consensus.cc:2955] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:41.259238 10616 ts_tablet_manager.cc:933] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:53:41.273212 10616 tablet_copy_client.cc:323] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:53:41.292766 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:41.309684 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:41.310806 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:41.326318 10417 ts_tablet_manager.cc:1434] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5: Time spent starting tablet: real 0.199s user 0.023s sys 0.035s
I20260807 13:53:41.328670 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session 12ab71778f2f4b378765aaed1a0676a5-739f4f0207104455bf3e87bc04f8d13c received from {username='slave'} at 127.23.107.134:57547
I20260807 13:53:41.328857 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session 12ab71778f2f4b378765aaed1a0676a5-739f4f0207104455bf3e87bc04f8d13c on tablet 739f4f0207104455bf3e87bc04f8d13c with peer 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:53:41.344749 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:41.347648 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:41.360370 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:41.363755 5068 consensus_queue.cc:237] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:41.378686 4748 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet faef317e47a244c6965864f82f21edfa from peer 31d7630573c8475a9f84978d4ebfb879 ({username='slave'} at 127.23.107.136:52551)
I20260807 13:53:41.378890 4748 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet faef317e47a244c6965864f82f21edfa from peer 31d7630573c8475a9f84978d4ebfb879 at {username='slave'} at 127.23.107.136:52551: session id = 31d7630573c8475a9f84978d4ebfb879-faef317e47a244c6965864f82f21edfa
I20260807 13:53:41.383591 4748 tablet_copy_source_session.cc:215] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:41.392527 10616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faef317e47a244c6965864f82f21edfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:41.431452 7354 raft_consensus.cc:1275] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
W20260807 13:53:41.433245 4982 consensus_peers.cc:597] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 -> Peer 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): Couldn't send request to peer 8a9903f009ff46b4a6875490823076c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 739f4f0207104455bf3e87bc04f8d13c. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:41.433841 10552 consensus_queue.cc:1048] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:41.437301 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:41.444023 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:41.452185 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:41.456627 10616 tablet_copy_client.cc:806] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:41.456921 10616 tablet_copy_client.cc:670] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:41.461762 5248 raft_consensus.cc:1275] T 739f4f0207104455bf3e87bc04f8d13c P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:41.462494 10552 consensus_queue.cc:1048] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:41.463613 10616 tablet_copy_client.cc:538] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:41.475021 4716 raft_consensus.cc:1275] T 739f4f0207104455bf3e87bc04f8d13c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:41.475711 10552 consensus_queue.cc:1048] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:41.478679 10616 tablet_bootstrap.cc:492] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879: Bootstrap starting.
I20260807 13:53:41.495179 10365 raft_consensus.cc:2955] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:41.514921 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:41.504038 4716 raft_consensus.cc:2955] T 739f4f0207104455bf3e87bc04f8d13c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:41.539953 4513 catalog_manager.cc:5697] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 4 to 5, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:41.552608 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:41.557977 5245 raft_consensus.cc:2955] T 739f4f0207104455bf3e87bc04f8d13c P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:41.576865 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:41.589075 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:41.600418 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:41.602051 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:41.625743 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:41.636773 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:41.652319 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:41.674726 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
W20260807 13:53:41.693655 4982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.134:35975, user_credentials={real_user=slave}} blocked reactor thread for 135913us
I20260807 13:53:41.695029 7354 raft_consensus.cc:2955] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
W20260807 13:53:41.697395 4981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.130:37489, user_credentials={real_user=slave}} blocked reactor thread for 138006us
I20260807 13:53:41.774269 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:41.782178 10616 tablet_bootstrap.cc:492] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:41.782791 10616 tablet_bootstrap.cc:492] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879: Bootstrap complete.
I20260807 13:53:41.783174 10616 ts_tablet_manager.cc:1403] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879: Time spent bootstrapping tablet: real 0.306s user 0.049s sys 0.010s
I20260807 13:53:41.784289 10616 raft_consensus.cc:359] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:41.784626 10616 raft_consensus.cc:740] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d7630573c8475a9f84978d4ebfb879, State: Initialized, Role: FOLLOWER
I20260807 13:53:41.784955 10616 consensus_queue.cc:260] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:41.795073 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:41.844264 10705 ts_tablet_manager.cc:933] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:41.849241 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:41.858647 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:41.872570 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:41.886652 10705 tablet_copy_client.cc:323] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
W20260807 13:53:41.891093 4630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.131:40441, user_credentials={real_user=slave}} blocked reactor thread for 59648.3us
I20260807 13:53:41.910761 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet 739f4f0207104455bf3e87bc04f8d13c from peer 8a9903f009ff46b4a6875490823076c4 ({username='slave'} at 127.23.107.135:53271)
I20260807 13:53:41.911221 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet 739f4f0207104455bf3e87bc04f8d13c from peer 8a9903f009ff46b4a6875490823076c4 at {username='slave'} at 127.23.107.135:53271: session id = 8a9903f009ff46b4a6875490823076c4-739f4f0207104455bf3e87bc04f8d13c
I20260807 13:53:41.915689 5101 tablet_copy_source_session.cc:215] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:41.924721 10705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739f4f0207104455bf3e87bc04f8d13c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:42.006114 10705 tablet_copy_client.cc:806] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:42.006496 10705 tablet_copy_client.cc:670] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:42.013525 10705 tablet_copy_client.cc:538] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:42.019686 10705 tablet_bootstrap.cc:492] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4: Bootstrap starting.
I20260807 13:53:42.045886 10616 ts_tablet_manager.cc:1434] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879: Time spent starting tablet: real 0.263s user 0.043s sys 0.038s
I20260807 13:53:42.046949 4748 tablet_copy_service.cc:342] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Request end of tablet copy session 31d7630573c8475a9f84978d4ebfb879-faef317e47a244c6965864f82f21edfa received from {username='slave'} at 127.23.107.136:52551
I20260807 13:53:42.047143 4748 tablet_copy_service.cc:434] P fa83b7af134b4e3b949ac3b4e4bcb5e7: ending tablet copy session 31d7630573c8475a9f84978d4ebfb879-faef317e47a244c6965864f82f21edfa on tablet faef317e47a244c6965864f82f21edfa with peer 31d7630573c8475a9f84978d4ebfb879
I20260807 13:53:42.234138 10705 tablet_bootstrap.cc:492] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:42.234625 10705 tablet_bootstrap.cc:492] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4: Bootstrap complete.
I20260807 13:53:42.234931 10705 ts_tablet_manager.cc:1403] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4: Time spent bootstrapping tablet: real 0.215s user 0.063s sys 0.004s
I20260807 13:53:42.235663 10705 raft_consensus.cc:359] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:42.235884 10705 raft_consensus.cc:740] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a9903f009ff46b4a6875490823076c4, State: Initialized, Role: FOLLOWER
I20260807 13:53:42.236207 10705 consensus_queue.cc:260] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:42.240808 10705 ts_tablet_manager.cc:1434] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4: Time spent starting tablet: real 0.006s user 0.004s sys 0.003s
I20260807 13:53:42.244161 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session 8a9903f009ff46b4a6875490823076c4-739f4f0207104455bf3e87bc04f8d13c received from {username='slave'} at 127.23.107.135:53271
I20260807 13:53:42.244340 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session 8a9903f009ff46b4a6875490823076c4-739f4f0207104455bf3e87bc04f8d13c on tablet 739f4f0207104455bf3e87bc04f8d13c with peer 8a9903f009ff46b4a6875490823076c4
I20260807 13:53:42.309785 7523 raft_consensus.cc:1217] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20260807 13:53:42.540205 7691 raft_consensus.cc:1217] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.5->[1.6-1.6] Dedup: 1.6->[]
I20260807 13:53:42.743031 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:42.787834 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:42.804982 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:42.818385 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:42.825917 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:42.874914 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:42.901248 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:42.931830 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:43.131079 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:43.136866 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:43.260741 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:43.272974 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:43.299747 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:43.324091 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:43.414728 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:43.442329 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:43.705916 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:43.761673 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:43.799270 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:43.820597 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:43.835115 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:43.846563 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:43.878492 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:43.880630 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:43.994755 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:44.009233 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:44.013718 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:44.014184 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:44.024871 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:44.126904 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:44.146344 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:44.179600 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:44.214228 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:44.230989 5072 consensus_queue.cc:237] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:44.242352 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:44.245370 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:44.247375 7354 raft_consensus.cc:1275] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:53:44.249260 10688 consensus_queue.cc:1048] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:53:44.251626 5248 raft_consensus.cc:1275] T 739f4f0207104455bf3e87bc04f8d13c P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:53:44.252429 11098 consensus_queue.cc:1048] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:53:44.254877 7523 raft_consensus.cc:1275] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:53:44.255787 11098 consensus_queue.cc:1048] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:53:44.270308 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:44.298380 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:44.311583 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:44.322993 11098 raft_consensus.cc:2955] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:44.328326 7353 raft_consensus.cc:2955] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:44.339725 7523 raft_consensus.cc:2955] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:44.340871 4520 catalog_manager.cc:5697] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 5 to 6, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:44.368081 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:44.387333 5248 raft_consensus.cc:2955] T 739f4f0207104455bf3e87bc04f8d13c P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:44.395416 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:44.404827 4688 tablet_service.cc:1558] Processing DeleteTablet for tablet 739f4f0207104455bf3e87bc04f8d13c with delete_type TABLET_DATA_TOMBSTONED (TS fa83b7af134b4e3b949ac3b4e4bcb5e7 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:56314
I20260807 13:53:44.454269 11137 tablet_replica.cc:333] T 739f4f0207104455bf3e87bc04f8d13c P fa83b7af134b4e3b949ac3b4e4bcb5e7: stopping tablet replica
I20260807 13:53:44.454862 11137 raft_consensus.cc:2243] T 739f4f0207104455bf3e87bc04f8d13c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:53:44.455379 11137 raft_consensus.cc:2272] T 739f4f0207104455bf3e87bc04f8d13c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:53:44.457126 11137 ts_tablet_manager.cc:1916] T 739f4f0207104455bf3e87bc04f8d13c P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:53:44.570688 11137 ts_tablet_manager.cc:1929] T 739f4f0207104455bf3e87bc04f8d13c P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260807 13:53:44.603103 11137 log.cc:1199] T 739f4f0207104455bf3e87bc04f8d13c P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/wals/739f4f0207104455bf3e87bc04f8d13c
I20260807 13:53:44.608058 4506 catalog_manager.cc:5028] TS fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): tablet 739f4f0207104455bf3e87bc04f8d13c (table rebalance_test_table_3 [id=c2c7db1795a1414c8299bebbeaf60404]) successfully deleted
I20260807 13:53:44.835796 5248 consensus_queue.cc:237] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:44.901357 7353 raft_consensus.cc:1275] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:44.902289 11140 consensus_queue.cc:1048] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:44.905726 4892 raft_consensus.cc:1275] T 80898a5a2cf046f1b7344dfceb175bbd P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:44.906876 11140 consensus_queue.cc:1048] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:44.910614 11140 raft_consensus.cc:2955] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:44.916363 7354 raft_consensus.cc:2955] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:44.927889 4514 catalog_manager.cc:5697] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:44.938390 4892 raft_consensus.cc:2955] T 80898a5a2cf046f1b7344dfceb175bbd P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:44.969028 4896 consensus_queue.cc:237] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:45.073894 5248 consensus_queue.cc:237] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
W20260807 13:53:45.105516 4982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:41217, user_credentials={real_user=slave}} blocked reactor thread for 115302us
I20260807 13:53:45.114326 7691 raft_consensus.cc:1275] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:45.115573 10891 consensus_queue.cc:1048] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:45.137461 5245 raft_consensus.cc:1275] T a29bfc37eabb411f845203c281444086 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:45.138269 10009 consensus_queue.cc:1048] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:45.142174 5039 tablet_service.cc:1558] Processing DeleteTablet for tablet 80898a5a2cf046f1b7344dfceb175bbd with delete_type TABLET_DATA_TOMBSTONED (TS 01adf83af3e04875b5fac9470d4da915 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36810
I20260807 13:53:45.144129 10009 raft_consensus.cc:2955] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:45.150480 7523 raft_consensus.cc:1275] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:45.151255 10586 consensus_queue.cc:1048] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:45.158952 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:45.164805 5037 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:45.165011 10586 raft_consensus.cc:2955] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:45.181586 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:45.184700 11288 tablet_replica.cc:333] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915: stopping tablet replica
I20260807 13:53:45.186347 7690 raft_consensus.cc:2955] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:45.206259 4896 raft_consensus.cc:1275] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:45.209093 11140 consensus_queue.cc:1048] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:45.185586 11288 raft_consensus.cc:2243] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:53:45.210103 11288 raft_consensus.cc:2272] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:53:45.213505 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:45.223083 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:45.224927 11288 ts_tablet_manager.cc:1916] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:53:45.231662 4514 catalog_manager.cc:5697] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 reported cstate change: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:45.236680 5039 tablet_service.cc:1558] Processing DeleteTablet for tablet a29bfc37eabb411f845203c281444086 with delete_type TABLET_DATA_TOMBSTONED (TS 01adf83af3e04875b5fac9470d4da915 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36810
I20260807 13:53:45.246260 7523 raft_consensus.cc:2955] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:45.250763 4514 catalog_manager.cc:5697] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:45.256678 5039 tablet_service.cc:1558] Processing DeleteTablet for tablet e93615e4fb61416d8740ce61970610af with delete_type TABLET_DATA_TOMBSTONED (TS 01adf83af3e04875b5fac9470d4da915 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36810
I20260807 13:53:45.265453 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:45.282253 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:45.292235 4896 raft_consensus.cc:2955] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:45.299875 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:45.320109 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:45.320267 5248 raft_consensus.cc:2955] T a29bfc37eabb411f845203c281444086 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:45.354794 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:45.355237 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:45.355944 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:45.382246 11288 ts_tablet_manager.cc:1929] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:53:45.382647 11288 log.cc:1199] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/wals/80898a5a2cf046f1b7344dfceb175bbd
I20260807 13:53:45.384109 11288 tablet_replica.cc:333] T a29bfc37eabb411f845203c281444086 P 01adf83af3e04875b5fac9470d4da915: stopping tablet replica
I20260807 13:53:45.384125 4504 catalog_manager.cc:5028] TS 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): tablet 80898a5a2cf046f1b7344dfceb175bbd (table rebalance_test_table_1 [id=7f1d26639edd4cb398339b2b0d3659a3]) successfully deleted
I20260807 13:53:45.384564 11288 raft_consensus.cc:2243] T a29bfc37eabb411f845203c281444086 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:53:45.385129 11288 raft_consensus.cc:2272] T a29bfc37eabb411f845203c281444086 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:53:45.411824 11288 ts_tablet_manager.cc:1916] T a29bfc37eabb411f845203c281444086 P 01adf83af3e04875b5fac9470d4da915: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:53:45.446367 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:45.465458 11288 ts_tablet_manager.cc:1929] T a29bfc37eabb411f845203c281444086 P 01adf83af3e04875b5fac9470d4da915: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:53:45.465634 11288 log.cc:1199] T a29bfc37eabb411f845203c281444086 P 01adf83af3e04875b5fac9470d4da915: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/wals/a29bfc37eabb411f845203c281444086
I20260807 13:53:45.466542 11288 tablet_replica.cc:333] T e93615e4fb61416d8740ce61970610af P 01adf83af3e04875b5fac9470d4da915: stopping tablet replica
I20260807 13:53:45.466645 4504 catalog_manager.cc:5028] TS 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): tablet a29bfc37eabb411f845203c281444086 (table rebalance_test_table_5 [id=b6c061acc30c4e5aa6bee1f054e3a59a]) successfully deleted
I20260807 13:53:45.466840 11288 raft_consensus.cc:2243] T e93615e4fb61416d8740ce61970610af P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:53:45.467141 11288 raft_consensus.cc:2272] T e93615e4fb61416d8740ce61970610af P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:53:45.492645 11288 ts_tablet_manager.cc:1916] T e93615e4fb61416d8740ce61970610af P 01adf83af3e04875b5fac9470d4da915: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:53:45.512079 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:45.528019 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:45.551345 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:45.692648 11288 ts_tablet_manager.cc:1929] T e93615e4fb61416d8740ce61970610af P 01adf83af3e04875b5fac9470d4da915: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:53:45.692837 11288 log.cc:1199] T e93615e4fb61416d8740ce61970610af P 01adf83af3e04875b5fac9470d4da915: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/wals/e93615e4fb61416d8740ce61970610af
I20260807 13:53:45.693849 4504 catalog_manager.cc:5028] TS 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): tablet e93615e4fb61416d8740ce61970610af (table rebalance_test_table_9 [id=96e83925faa542ffa4808b01a5adbbb3]) successfully deleted
W20260807 13:53:45.708074 4982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.129:32841, user_credentials={real_user=slave}} blocked reactor thread for 51419.6us
I20260807 13:53:46.132388 4715 consensus_queue.cc:237] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:46.156090 7690 raft_consensus.cc:1275] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:53:46.156862 10529 consensus_queue.cc:1048] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:53:46.165613 7524 raft_consensus.cc:1275] T faef317e47a244c6965864f82f21edfa P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:53:46.166498 10529 consensus_queue.cc:1048] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:53:46.177505 7354 raft_consensus.cc:1275] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:53:46.178350 10529 consensus_queue.cc:1048] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:53:46.184070 11368 raft_consensus.cc:2955] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:46.195256 7354 raft_consensus.cc:2955] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:46.203020 5074 raft_consensus.cc:1275] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:53:46.203800 11096 consensus_queue.cc:1048] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:53:46.233250 7524 raft_consensus.cc:2955] T faef317e47a244c6965864f82f21edfa P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:46.239794 4517 catalog_manager.cc:5697] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index 6 to 7, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:46.272722 5074 raft_consensus.cc:2955] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:46.281560 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:46.297190 7690 raft_consensus.cc:2955] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:46.303726 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:46.321976 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:46.325013 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:46.376493 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:46.379241 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:46.409022 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:46.434741 4865 tablet_service.cc:1558] Processing DeleteTablet for tablet faef317e47a244c6965864f82f21edfa with delete_type TABLET_DATA_TOMBSTONED (TS c9d2944272bc447dafce7620ac2dbd4b not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:36624
I20260807 13:53:46.442783 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:46.495901 11525 tablet_replica.cc:333] T faef317e47a244c6965864f82f21edfa P c9d2944272bc447dafce7620ac2dbd4b: stopping tablet replica
I20260807 13:53:46.496635 11525 raft_consensus.cc:2243] T faef317e47a244c6965864f82f21edfa P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:53:46.497256 11525 raft_consensus.cc:2272] T faef317e47a244c6965864f82f21edfa P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:53:46.518738 11525 ts_tablet_manager.cc:1916] T faef317e47a244c6965864f82f21edfa P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:53:46.537710 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:46.584182 11525 ts_tablet_manager.cc:1929] T faef317e47a244c6965864f82f21edfa P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20260807 13:53:46.596091 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:46.645042 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:46.650033 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:46.671857 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:46.595602 4896 consensus_queue.cc:237] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:46.691581 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:46.697022 7354 raft_consensus.cc:1275] T 782ac4fa94fb4183940fca514cc068b0 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:53:46.697391 4715 raft_consensus.cc:1275] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:53:46.698055 10009 consensus_queue.cc:1048] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:53:46.699123 11525 log.cc:1199] T faef317e47a244c6965864f82f21edfa P c9d2944272bc447dafce7620ac2dbd4b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/faef317e47a244c6965864f82f21edfa
I20260807 13:53:46.700318 10891 consensus_queue.cc:1048] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:53:46.700361 4505 catalog_manager.cc:5028] TS c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): tablet faef317e47a244c6965864f82f21edfa (table rebalance_test_table_8 [id=91303cf8b9064e06b8c4165942b287f2]) successfully deleted
I20260807 13:53:46.701903 7524 raft_consensus.cc:1275] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:53:46.702556 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:46.702662 10891 consensus_queue.cc:1048] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:53:46.743081 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:46.753374 10891 raft_consensus.cc:2955] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:46.763193 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:46.770016 4715 raft_consensus.cc:2955] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:46.786722 4511 catalog_manager.cc:5697] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index 5 to 6, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:46.789695 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:46.800590 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 782ac4fa94fb4183940fca514cc068b0 with delete_type TABLET_DATA_TOMBSTONED (TS edf940ebcc1140cfa0c23214e0c0f179 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:53540
I20260807 13:53:46.802652 7354 raft_consensus.cc:2955] T 782ac4fa94fb4183940fca514cc068b0 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:46.813504 7523 raft_consensus.cc:2955] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:46.815526 11566 tablet_replica.cc:333] T 782ac4fa94fb4183940fca514cc068b0 P edf940ebcc1140cfa0c23214e0c0f179: stopping tablet replica
I20260807 13:53:46.818922 11566 raft_consensus.cc:2243] T 782ac4fa94fb4183940fca514cc068b0 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:53:46.826588 11566 raft_consensus.cc:2272] T 782ac4fa94fb4183940fca514cc068b0 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:53:46.828401 11566 ts_tablet_manager.cc:1916] T 782ac4fa94fb4183940fca514cc068b0 P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:53:46.861356 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:46.876187 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:46.884771 11566 ts_tablet_manager.cc:1929] T 782ac4fa94fb4183940fca514cc068b0 P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260807 13:53:46.885190 11566 log.cc:1199] T 782ac4fa94fb4183940fca514cc068b0 P edf940ebcc1140cfa0c23214e0c0f179: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal/wals/782ac4fa94fb4183940fca514cc068b0
I20260807 13:53:46.889870 4506 catalog_manager.cc:5028] TS edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): tablet 782ac4fa94fb4183940fca514cc068b0 (table rebalance_test_table_2 [id=35d13981f3a742dd9369d1e7bf18498c]) successfully deleted
I20260807 13:53:46.901952 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:46.903434 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:46.920881 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:46.978399 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:47.203516 5074 consensus_queue.cc:237] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:47.213481 7524 raft_consensus.cc:1275] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:53:47.214444 10688 consensus_queue.cc:1048] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:53:47.218310 7354 raft_consensus.cc:1275] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:53:47.219156 10688 consensus_queue.cc:1048] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:53:47.220168 11366 raft_consensus.cc:2955] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:47.220780 7524 raft_consensus.cc:2955] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:47.227377 4511 catalog_manager.cc:5697] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 reported cstate change: config changed from index 6 to 7, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:47.235432 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 739f4f0207104455bf3e87bc04f8d13c with delete_type TABLET_DATA_TOMBSTONED (TS edf940ebcc1140cfa0c23214e0c0f179 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:53540
I20260807 13:53:47.235822 11566 tablet_replica.cc:333] T 739f4f0207104455bf3e87bc04f8d13c P edf940ebcc1140cfa0c23214e0c0f179: stopping tablet replica
I20260807 13:53:47.236052 11566 raft_consensus.cc:2243] T 739f4f0207104455bf3e87bc04f8d13c P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:53:47.236327 11566 raft_consensus.cc:2272] T 739f4f0207104455bf3e87bc04f8d13c P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:53:47.237139 11566 ts_tablet_manager.cc:1916] T 739f4f0207104455bf3e87bc04f8d13c P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:53:47.243970 11566 ts_tablet_manager.cc:1929] T 739f4f0207104455bf3e87bc04f8d13c P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20260807 13:53:47.244227 11566 log.cc:1199] T 739f4f0207104455bf3e87bc04f8d13c P edf940ebcc1140cfa0c23214e0c0f179: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal/wals/739f4f0207104455bf3e87bc04f8d13c
I20260807 13:53:47.246918 4506 catalog_manager.cc:5028] TS edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): tablet 739f4f0207104455bf3e87bc04f8d13c (table rebalance_test_table_3 [id=c2c7db1795a1414c8299bebbeaf60404]) successfully deleted
I20260807 13:53:47.251703 7354 raft_consensus.cc:2955] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:47.377447 4715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "faef317e47a244c6965864f82f21edfa"
dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:34736
I20260807 13:53:47.377782 4715 raft_consensus.cc:606] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Received request to transfer leadership
I20260807 13:53:47.444397 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:47.460354 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:47.470100 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:47.554669 7328 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:47.564921 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:47.586637 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:53:47.588078 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:47.594013 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:47.694666 10529 raft_consensus.cc:993] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7: : Instructing follower 12ab71778f2f4b378765aaed1a0676a5 to start an election
I20260807 13:53:47.694905 10529 raft_consensus.cc:1081] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Signalling peer 12ab71778f2f4b378765aaed1a0676a5 to start an election
I20260807 13:53:47.696141 7354 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "faef317e47a244c6965864f82f21edfa"
dest_uuid: "12ab71778f2f4b378765aaed1a0676a5"
from {username='slave'} at 127.23.107.129:53325
I20260807 13:53:47.696439 7354 raft_consensus.cc:493] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:53:47.696642 7354 raft_consensus.cc:3060] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:53:47.700333 7354 raft_consensus.cc:515] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:47.703747 4715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faef317e47a244c6965864f82f21edfa" candidate_uuid: "12ab71778f2f4b378765aaed1a0676a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: true dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
I20260807 13:53:47.703969 4715 raft_consensus.cc:3055] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:53:47.704105 4715 raft_consensus.cc:740] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Running, Role: LEADER
I20260807 13:53:47.704437 4715 consensus_queue.cc:260] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:47.704913 4715 raft_consensus.cc:3060] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:53:47.708490 4715 raft_consensus.cc:2468] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12ab71778f2f4b378765aaed1a0676a5 in term 2.
I20260807 13:53:47.715673 7354 leader_election.cc:290] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 election: Requested vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385), 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729)
I20260807 13:53:47.729000 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faef317e47a244c6965864f82f21edfa" candidate_uuid: "12ab71778f2f4b378765aaed1a0676a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: true dest_uuid: "01adf83af3e04875b5fac9470d4da915"
I20260807 13:53:47.731127 5074 raft_consensus.cc:3060] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:53:47.734736 5074 raft_consensus.cc:2468] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12ab71778f2f4b378765aaed1a0676a5 in term 2.
I20260807 13:53:47.735992 7272 leader_election.cc:304] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, 12ab71778f2f4b378765aaed1a0676a5, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:47.736768 11570 raft_consensus.cc:2804] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:53:47.753280 7524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faef317e47a244c6965864f82f21edfa" candidate_uuid: "12ab71778f2f4b378765aaed1a0676a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: true dest_uuid: "8a9903f009ff46b4a6875490823076c4"
I20260807 13:53:47.753738 7524 raft_consensus.cc:3060] T faef317e47a244c6965864f82f21edfa P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:53:47.758972 7524 raft_consensus.cc:2468] T faef317e47a244c6965864f82f21edfa P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12ab71778f2f4b378765aaed1a0676a5 in term 2.
I20260807 13:53:47.765226 7690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faef317e47a244c6965864f82f21edfa" candidate_uuid: "12ab71778f2f4b378765aaed1a0676a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: true dest_uuid: "31d7630573c8475a9f84978d4ebfb879"
I20260807 13:53:47.765663 7690 raft_consensus.cc:3060] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:53:47.769495 7690 raft_consensus.cc:2468] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12ab71778f2f4b378765aaed1a0676a5 in term 2.
I20260807 13:53:47.782615 11570 raft_consensus.cc:697] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [term 2 LEADER]: Becoming Leader. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Running, Role: LEADER
I20260807 13:53:47.783370 11570 consensus_queue.cc:237] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:47.831161 4510 catalog_manager.cc:5697] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: term changed from 1 to 2, leader changed from fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) to 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134). New cstate: current_term: 2 leader_uuid: "12ab71778f2f4b378765aaed1a0676a5" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:47.871806 5248 consensus_queue.cc:237] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:47.910019 7690 raft_consensus.cc:1275] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:47.911084 11300 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:47.927729 5074 raft_consensus.cc:1275] T 96bc42d66fa04fb69afa630969dbb579 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:47.928704 11300 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:47.961026 11140 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:47.964833 5068 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:47.965646 7691 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:47.983779 4510 catalog_manager.cc:5697] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:48.005863 4688 tablet_service.cc:1558] Processing DeleteTablet for tablet 96bc42d66fa04fb69afa630969dbb579 with delete_type TABLET_DATA_TOMBSTONED (TS fa83b7af134b4e3b949ac3b4e4bcb5e7 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:56314
I20260807 13:53:48.006785 11793 tablet_replica.cc:333] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7: stopping tablet replica
I20260807 13:53:48.007124 11793 raft_consensus.cc:2243] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:53:48.007616 11793 raft_consensus.cc:2272] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:53:48.009080 11793 ts_tablet_manager.cc:1916] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:53:48.024708 11793 ts_tablet_manager.cc:1929] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:53:48.028788 11793 log.cc:1199] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/wals/96bc42d66fa04fb69afa630969dbb579
I20260807 13:53:48.030503 4506 catalog_manager.cc:5028] TS fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): tablet 96bc42d66fa04fb69afa630969dbb579 (table rebalance_test_table_4 [id=e242e42da20d4458a49a269a9569307a]) successfully deleted
I20260807 13:53:48.074868 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:48.092099 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:53:48.120800 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:48.137742 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:48.169286 5074 raft_consensus.cc:1275] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260807 13:53:48.170203 11570 consensus_queue.cc:1048] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:53:48.171252 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:48.217703 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:48.222244 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:48.255554 7691 raft_consensus.cc:1275] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260807 13:53:48.256956 11570 consensus_queue.cc:1048] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:53:48.258740 4715 raft_consensus.cc:1275] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260807 13:53:48.259744 11740 consensus_queue.cc:1048] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:53:48.265995 7524 raft_consensus.cc:1275] T faef317e47a244c6965864f82f21edfa P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260807 13:53:48.267007 11740 consensus_queue.cc:1048] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:53:48.346637 4688 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:53:48.452148 4896 consensus_queue.cc:237] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:48.489895 4717 raft_consensus.cc:1275] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:48.490254 7179 raft_consensus.cc:1275] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:48.490674 11795 consensus_queue.cc:1048] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:48.493288 10891 consensus_queue.cc:1048] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:48.517028 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:48.535897 10891 raft_consensus.cc:2955] T d02aa7a26c024b4083421b5d742f7bcb P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:48.546051 4715 raft_consensus.cc:2955] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:48.554842 4517 catalog_manager.cc:5697] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:48.555817 7179 raft_consensus.cc:2955] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:48.587270 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:53:48.599936 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:48.630206 5039 tablet_service.cc:1558] Processing DeleteTablet for tablet d02aa7a26c024b4083421b5d742f7bcb with delete_type TABLET_DATA_TOMBSTONED (TS 01adf83af3e04875b5fac9470d4da915 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36810
I20260807 13:53:48.652482 11906 tablet_replica.cc:333] T d02aa7a26c024b4083421b5d742f7bcb P 01adf83af3e04875b5fac9470d4da915: stopping tablet replica
I20260807 13:53:48.655480 11906 raft_consensus.cc:2243] T d02aa7a26c024b4083421b5d742f7bcb P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:53:48.655884 11906 raft_consensus.cc:2272] T d02aa7a26c024b4083421b5d742f7bcb P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:53:48.656755 11906 ts_tablet_manager.cc:1916] T d02aa7a26c024b4083421b5d742f7bcb P 01adf83af3e04875b5fac9470d4da915: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:53:48.690096 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:48.693936 11906 ts_tablet_manager.cc:1929] T d02aa7a26c024b4083421b5d742f7bcb P 01adf83af3e04875b5fac9470d4da915: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:53:48.696951 11906 log.cc:1199] T d02aa7a26c024b4083421b5d742f7bcb P 01adf83af3e04875b5fac9470d4da915: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/wals/d02aa7a26c024b4083421b5d742f7bcb
I20260807 13:53:48.698383 4504 catalog_manager.cc:5028] TS 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): tablet d02aa7a26c024b4083421b5d742f7bcb (table rebalance_test_table_7 [id=2ff801ea568346e096cc895a279c109c]) successfully deleted
I20260807 13:53:48.709724 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:48.752861 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:48.770567 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:48.772454 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:48.804224 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:48.830839 4688 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:53:48.847355 4688 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:53:48.875828 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:48.877717 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:48.887764 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:48.922303 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:53:48.950196 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:49.294363 5248 consensus_queue.cc:237] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:49.346709 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:49.351876 7354 raft_consensus.cc:1275] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:53:49.352772 11805 consensus_queue.cc:1048] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:53:49.386232 11805 raft_consensus.cc:2955] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:49.400449 4513 catalog_manager.cc:5697] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:49.401192 7353 raft_consensus.cc:2955] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:53:49.418725 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:53:49.451445 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:49.456867 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:49.484934 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:49.524793 4865 tablet_service.cc:1558] Processing DeleteTablet for tablet 80898a5a2cf046f1b7344dfceb175bbd with delete_type TABLET_DATA_TOMBSTONED (TS c9d2944272bc447dafce7620ac2dbd4b not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:36624
I20260807 13:53:49.526652 5248 consensus_queue.cc:237] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
W20260807 13:53:49.530012 5151 consensus_peers.cc:597] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 -> Peer 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729): Couldn't send request to peer 31d7630573c8475a9f84978d4ebfb879. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 80898a5a2cf046f1b7344dfceb175bbd. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:49.531342 7354 raft_consensus.cc:1275] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:53:49.532141 11805 consensus_queue.cc:1048] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:53:49.534976 11805 raft_consensus.cc:2955] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:49.538371 7353 raft_consensus.cc:2955] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:49.547994 4513 catalog_manager.cc:5697] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: config changed from index 6 to 7, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:49.551087 4506 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet 80898a5a2cf046f1b7344dfceb175bbd with cas_config_opid_index 6: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260807 13:53:49.558382 4688 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:53:49.559157 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:49.565193 12078 tablet_replica.cc:333] T 80898a5a2cf046f1b7344dfceb175bbd P c9d2944272bc447dafce7620ac2dbd4b: stopping tablet replica
I20260807 13:53:49.565586 12078 raft_consensus.cc:2243] T 80898a5a2cf046f1b7344dfceb175bbd P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:53:49.565987 12078 raft_consensus.cc:2272] T 80898a5a2cf046f1b7344dfceb175bbd P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:53:49.566956 12078 ts_tablet_manager.cc:1916] T 80898a5a2cf046f1b7344dfceb175bbd P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:53:49.623649 12078 ts_tablet_manager.cc:1929] T 80898a5a2cf046f1b7344dfceb175bbd P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260807 13:53:49.625572 12078 log.cc:1199] T 80898a5a2cf046f1b7344dfceb175bbd P c9d2944272bc447dafce7620ac2dbd4b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/80898a5a2cf046f1b7344dfceb175bbd
I20260807 13:53:49.627120 4505 catalog_manager.cc:5028] TS c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): tablet 80898a5a2cf046f1b7344dfceb175bbd (table rebalance_test_table_1 [id=7f1d26639edd4cb398339b2b0d3659a3]) successfully deleted
I20260807 13:53:49.661044 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:49.683212 5074 consensus_queue.cc:237] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:49.701916 5248 raft_consensus.cc:1275] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:49.702803 11870 consensus_queue.cc:1048] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:49.703711 7524 raft_consensus.cc:1275] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:49.705662 11870 consensus_queue.cc:1048] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:49.719720 11870 raft_consensus.cc:2955] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:49.722666 7523 raft_consensus.cc:2955] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:49.728356 5248 raft_consensus.cc:2955] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:49.732856 4513 catalog_manager.cc:5697] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:49.738510 4688 tablet_service.cc:1558] Processing DeleteTablet for tablet ffa98a163d7540e3a911a39334657138 with delete_type TABLET_DATA_TOMBSTONED (TS fa83b7af134b4e3b949ac3b4e4bcb5e7 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:56314
I20260807 13:53:49.739583 12121 tablet_replica.cc:333] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: stopping tablet replica
I20260807 13:53:49.740456 12121 raft_consensus.cc:2243] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:53:49.740830 12121 raft_consensus.cc:2272] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:53:49.741848 12121 ts_tablet_manager.cc:1916] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:53:49.751148 12121 ts_tablet_manager.cc:1929] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:53:49.751396 12121 log.cc:1199] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/wals/ffa98a163d7540e3a911a39334657138
I20260807 13:53:49.752650 4506 catalog_manager.cc:5028] TS fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): tablet ffa98a163d7540e3a911a39334657138 (table rebalance_test_table_6 [id=6008038c907645199b055dacb5772621]) successfully deleted
I20260807 13:53:49.789515 7354 consensus_queue.cc:237] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 2.8, Last appended by leader: 7, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:49.825675 7690 raft_consensus.cc:1275] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260807 13:53:49.826756 11740 consensus_queue.cc:1048] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:53:49.846513 7523 raft_consensus.cc:1275] T faef317e47a244c6965864f82f21edfa P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260807 13:53:49.847278 11740 consensus_queue.cc:1048] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:53:49.851742 5074 raft_consensus.cc:1275] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260807 13:53:49.852568 11740 consensus_queue.cc:1048] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:53:49.869095 11740 raft_consensus.cc:2955] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [term 2 LEADER]: Committing config change with OpId 2.9: config changed from index 7 to 9, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:49.875422 7690 raft_consensus.cc:2955] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Committing config change with OpId 2.9: config changed from index 7 to 9, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:49.880576 5074 raft_consensus.cc:2955] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Committing config change with OpId 2.9: config changed from index 7 to 9, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:49.881783 7523 raft_consensus.cc:2955] T faef317e47a244c6965864f82f21edfa P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Committing config change with OpId 2.9: config changed from index 7 to 9, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:49.886950 4517 catalog_manager.cc:5697] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: config changed from index 7 to 9, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New cstate: current_term: 2 leader_uuid: "12ab71778f2f4b378765aaed1a0676a5" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:49.907256 4688 tablet_service.cc:1558] Processing DeleteTablet for tablet faef317e47a244c6965864f82f21edfa with delete_type TABLET_DATA_TOMBSTONED (TS fa83b7af134b4e3b949ac3b4e4bcb5e7 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:56314
I20260807 13:53:49.908039 12121 tablet_replica.cc:333] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7: stopping tablet replica
I20260807 13:53:49.908324 12121 raft_consensus.cc:2243] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:53:49.908576 12121 raft_consensus.cc:2272] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:53:49.909561 12121 ts_tablet_manager.cc:1916] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:53:49.914636 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:49.927167 12121 ts_tablet_manager.cc:1929] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.8
I20260807 13:53:49.927412 12121 log.cc:1199] T faef317e47a244c6965864f82f21edfa P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/wals/faef317e47a244c6965864f82f21edfa
I20260807 13:53:49.928433 4506 catalog_manager.cc:5028] TS fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): tablet faef317e47a244c6965864f82f21edfa (table rebalance_test_table_8 [id=91303cf8b9064e06b8c4165942b287f2]) successfully deleted
I20260807 13:53:49.970232 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:53:49.980393 12185 ts_tablet_manager.cc:933] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:49.981277 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:49.999423 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:50.000470 12185 tablet_copy_client.cc:323] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:53:50.002054 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet 80898a5a2cf046f1b7344dfceb175bbd from peer 31d7630573c8475a9f84978d4ebfb879 ({username='slave'} at 127.23.107.136:35045)
I20260807 13:53:50.002271 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet 80898a5a2cf046f1b7344dfceb175bbd from peer 31d7630573c8475a9f84978d4ebfb879 at {username='slave'} at 127.23.107.136:35045: session id = 31d7630573c8475a9f84978d4ebfb879-80898a5a2cf046f1b7344dfceb175bbd
I20260807 13:53:50.008978 5272 tablet_copy_source_session.cc:215] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:50.010067 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:50.010440 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:50.010677 12185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80898a5a2cf046f1b7344dfceb175bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:50.027055 12185 tablet_copy_client.cc:806] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:50.027346 12185 tablet_copy_client.cc:670] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:50.030128 12185 tablet_copy_client.cc:538] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:50.051265 12185 tablet_bootstrap.cc:492] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879: Bootstrap starting.
I20260807 13:53:50.062207 4688 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:53:50.063082 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:50.279896 12185 tablet_bootstrap.cc:492] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:50.280491 12185 tablet_bootstrap.cc:492] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879: Bootstrap complete.
I20260807 13:53:50.280835 12185 ts_tablet_manager.cc:1403] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879: Time spent bootstrapping tablet: real 0.230s user 0.048s sys 0.007s
I20260807 13:53:50.281888 12185 raft_consensus.cc:359] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:50.282151 12185 raft_consensus.cc:740] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d7630573c8475a9f84978d4ebfb879, State: Initialized, Role: FOLLOWER
I20260807 13:53:50.282452 12185 consensus_queue.cc:260] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:50.283250 12185 ts_tablet_manager.cc:1434] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
I20260807 13:53:50.284502 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session 31d7630573c8475a9f84978d4ebfb879-80898a5a2cf046f1b7344dfceb175bbd received from {username='slave'} at 127.23.107.136:35045
I20260807 13:53:50.284667 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session 31d7630573c8475a9f84978d4ebfb879-80898a5a2cf046f1b7344dfceb175bbd on tablet 80898a5a2cf046f1b7344dfceb175bbd with peer 31d7630573c8475a9f84978d4ebfb879
I20260807 13:53:50.331700 5248 consensus_queue.cc:237] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:50.339638 4892 raft_consensus.cc:1275] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:50.340075 7523 raft_consensus.cc:1275] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:50.340770 11805 consensus_queue.cc:1048] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:50.341408 11805 consensus_queue.cc:1048] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:50.359103 11300 raft_consensus.cc:2955] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:50.366552 4892 raft_consensus.cc:2955] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:50.371086 7523 raft_consensus.cc:2955] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:50.380129 4517 catalog_manager.cc:5697] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:50.389619 4688 tablet_service.cc:1558] Processing DeleteTablet for tablet 1715828a5d96455abecae985d1dca004 with delete_type TABLET_DATA_TOMBSTONED (TS fa83b7af134b4e3b949ac3b4e4bcb5e7 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:56314
I20260807 13:53:50.390110 12121 tablet_replica.cc:333] T 1715828a5d96455abecae985d1dca004 P fa83b7af134b4e3b949ac3b4e4bcb5e7: stopping tablet replica
I20260807 13:53:50.390369 12121 raft_consensus.cc:2243] T 1715828a5d96455abecae985d1dca004 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:53:50.390636 12121 raft_consensus.cc:2272] T 1715828a5d96455abecae985d1dca004 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:53:50.391512 12121 ts_tablet_manager.cc:1916] T 1715828a5d96455abecae985d1dca004 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:53:50.398622 12121 ts_tablet_manager.cc:1929] T 1715828a5d96455abecae985d1dca004 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:53:50.398873 12121 log.cc:1199] T 1715828a5d96455abecae985d1dca004 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/wals/1715828a5d96455abecae985d1dca004
I20260807 13:53:50.399976 4506 catalog_manager.cc:5028] TS fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): tablet 1715828a5d96455abecae985d1dca004 (table rebalance_test_table_2 [id=35d13981f3a742dd9369d1e7bf18498c]) successfully deleted
I20260807 13:53:50.537233 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:50.560487 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:53:50.591266 7691 raft_consensus.cc:1217] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260807 13:53:50.646649 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:50.653856 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:50.665797 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:50.673214 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:50.678000 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:50.721760 4688 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:53:50.892601 5074 consensus_queue.cc:237] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:50.902570 7523 raft_consensus.cc:1275] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:50.913096 11870 consensus_queue.cc:1048] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:50.916891 4892 raft_consensus.cc:1275] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:50.917860 12087 consensus_queue.cc:1048] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:50.921473 12087 raft_consensus.cc:2955] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:50.926383 7523 raft_consensus.cc:2955] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:50.941193 4517 catalog_manager.cc:5697] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:50.957669 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:53:50.962018 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:50.973250 4892 raft_consensus.cc:2955] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:50.991154 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:51.021971 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:51.034597 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:51.045104 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:51.069669 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:51.114682 4688 tablet_service.cc:1558] Processing DeleteTablet for tablet 16afb6ff06704a8795f1de84ffa81de0 with delete_type TABLET_DATA_TOMBSTONED (TS fa83b7af134b4e3b949ac3b4e4bcb5e7 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:56314
I20260807 13:53:51.118958 4687 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:53:51.174010 12395 tablet_replica.cc:333] T 16afb6ff06704a8795f1de84ffa81de0 P fa83b7af134b4e3b949ac3b4e4bcb5e7: stopping tablet replica
I20260807 13:53:51.174366 12395 raft_consensus.cc:2243] T 16afb6ff06704a8795f1de84ffa81de0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:53:51.174809 12395 raft_consensus.cc:2272] T 16afb6ff06704a8795f1de84ffa81de0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:53:51.176684 12395 ts_tablet_manager.cc:1916] T 16afb6ff06704a8795f1de84ffa81de0 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:53:51.244972 12395 ts_tablet_manager.cc:1929] T 16afb6ff06704a8795f1de84ffa81de0 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:53:51.245220 12395 log.cc:1199] T 16afb6ff06704a8795f1de84ffa81de0 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/wals/16afb6ff06704a8795f1de84ffa81de0
I20260807 13:53:51.246270 4506 catalog_manager.cc:5028] TS fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): tablet 16afb6ff06704a8795f1de84ffa81de0 (table rebalance_test_table_0 [id=14867b014aab43119171102f60bb134d]) successfully deleted
I20260807 13:53:51.355645 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:51.372881 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:51.386299 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:51.412181 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:51.417933 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:51.430581 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:51.447664 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:53:51.528592 4688 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:53:51.543812 5068 consensus_queue.cc:237] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:51.562923 7691 raft_consensus.cc:1275] T 522c3523f2af4eb29e30fa55da2acd3e P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:51.563868 11870 consensus_queue.cc:1048] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:51.572670 5248 raft_consensus.cc:1275] T 522c3523f2af4eb29e30fa55da2acd3e P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:51.573516 12087 consensus_queue.cc:1048] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:51.578018 11870 raft_consensus.cc:2955] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:51.583320 7690 raft_consensus.cc:2955] T 522c3523f2af4eb29e30fa55da2acd3e P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:51.594213 4511 catalog_manager.cc:5697] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:51.619434 5248 raft_consensus.cc:2955] T 522c3523f2af4eb29e30fa55da2acd3e P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:51.678995 4688 tablet_service.cc:1558] Processing DeleteTablet for tablet 522c3523f2af4eb29e30fa55da2acd3e with delete_type TABLET_DATA_TOMBSTONED (TS fa83b7af134b4e3b949ac3b4e4bcb5e7 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:56314
I20260807 13:53:51.680084 12395 tablet_replica.cc:333] T 522c3523f2af4eb29e30fa55da2acd3e P fa83b7af134b4e3b949ac3b4e4bcb5e7: stopping tablet replica
I20260807 13:53:51.680372 12395 raft_consensus.cc:2243] T 522c3523f2af4eb29e30fa55da2acd3e P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:53:51.680758 12395 raft_consensus.cc:2272] T 522c3523f2af4eb29e30fa55da2acd3e P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:53:51.682090 12395 ts_tablet_manager.cc:1916] T 522c3523f2af4eb29e30fa55da2acd3e P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:53:51.692414 12395 ts_tablet_manager.cc:1929] T 522c3523f2af4eb29e30fa55da2acd3e P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:53:51.694177 12395 log.cc:1199] T 522c3523f2af4eb29e30fa55da2acd3e P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/wals/522c3523f2af4eb29e30fa55da2acd3e
I20260807 13:53:51.695271 4506 catalog_manager.cc:5028] TS fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): tablet 522c3523f2af4eb29e30fa55da2acd3e (table rebalance_test_table_7 [id=2ff801ea568346e096cc895a279c109c]) successfully deleted
I20260807 13:53:51.918371 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:51.953800 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:53:52.025774 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:52.057024 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:52.122429 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:52.179971 4688 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:53:52.230785 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:52.356559 5248 consensus_queue.cc:237] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:52.358363 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:52.360635 7690 raft_consensus.cc:1275] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:52.360865 4715 raft_consensus.cc:1275] T 242a68df09cb4c7d9522a33d259ebf78 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:52.361704 12575 consensus_queue.cc:1048] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:52.367712 12575 consensus_queue.cc:1048] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:52.391925 12575 raft_consensus.cc:2955] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:52.400370 7690 raft_consensus.cc:2955] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:52.405504 4715 raft_consensus.cc:2955] T 242a68df09cb4c7d9522a33d259ebf78 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:52.408332 5248 consensus_queue.cc:237] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:52.408344 4510 catalog_manager.cc:5697] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index 4 to 5, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:52.415925 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:52.456367 7691 raft_consensus.cc:1275] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:53:52.457193 12575 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:53:52.461815 11300 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:52.467666 7691 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:52.488301 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:52.501483 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:53:52.522990 4865 tablet_service.cc:1558] Processing DeleteTablet for tablet 242a68df09cb4c7d9522a33d259ebf78 with delete_type TABLET_DATA_TOMBSTONED (TS c9d2944272bc447dafce7620ac2dbd4b not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36624
I20260807 13:53:52.529945 4511 catalog_manager.cc:5697] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 reported cstate change: config changed from index 5 to 6, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:52.533867 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:52.537077 5039 tablet_service.cc:1558] Processing DeleteTablet for tablet 96bc42d66fa04fb69afa630969dbb579 with delete_type TABLET_DATA_TOMBSTONED (TS 01adf83af3e04875b5fac9470d4da915 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:36810
I20260807 13:53:52.539074 5248 consensus_queue.cc:237] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:52.541958 7690 raft_consensus.cc:1275] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:53:52.542711 11300 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260807 13:53:52.544226 5154 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 -> Peer 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): Couldn't send request to peer 8a9903f009ff46b4a6875490823076c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 96bc42d66fa04fb69afa630969dbb579. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:52.546564 11300 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:52.550664 7691 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:52.559387 4506 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet 96bc42d66fa04fb69afa630969dbb579 with cas_config_opid_index 6: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260807 13:53:52.561685 12638 tablet_replica.cc:333] T 96bc42d66fa04fb69afa630969dbb579 P 01adf83af3e04875b5fac9470d4da915: stopping tablet replica
I20260807 13:53:52.562237 12632 tablet_replica.cc:333] T 242a68df09cb4c7d9522a33d259ebf78 P c9d2944272bc447dafce7620ac2dbd4b: stopping tablet replica
I20260807 13:53:52.562667 12632 raft_consensus.cc:2243] T 242a68df09cb4c7d9522a33d259ebf78 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:53:52.563308 12632 raft_consensus.cc:2272] T 242a68df09cb4c7d9522a33d259ebf78 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:53:52.564194 12632 ts_tablet_manager.cc:1916] T 242a68df09cb4c7d9522a33d259ebf78 P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:53:52.570216 4511 catalog_manager.cc:5697] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 reported cstate change: config changed from index 6 to 7, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:52.572090 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:52.573581 12638 raft_consensus.cc:2243] T 96bc42d66fa04fb69afa630969dbb579 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:53:52.574069 12638 raft_consensus.cc:2272] T 96bc42d66fa04fb69afa630969dbb579 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:53:52.601507 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:52.601527 12638 ts_tablet_manager.cc:1916] T 96bc42d66fa04fb69afa630969dbb579 P 01adf83af3e04875b5fac9470d4da915: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:53:52.615545 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:52.655691 12632 ts_tablet_manager.cc:1929] T 242a68df09cb4c7d9522a33d259ebf78 P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:53:52.668051 4688 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:53:52.668973 12638 ts_tablet_manager.cc:1929] T 96bc42d66fa04fb69afa630969dbb579 P 01adf83af3e04875b5fac9470d4da915: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260807 13:53:52.669239 12632 log.cc:1199] T 242a68df09cb4c7d9522a33d259ebf78 P c9d2944272bc447dafce7620ac2dbd4b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/242a68df09cb4c7d9522a33d259ebf78
I20260807 13:53:52.671811 4505 catalog_manager.cc:5028] TS c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): tablet 242a68df09cb4c7d9522a33d259ebf78 (table rebalance_test_table_6 [id=6008038c907645199b055dacb5772621]) successfully deleted
I20260807 13:53:52.672057 12638 log.cc:1199] T 96bc42d66fa04fb69afa630969dbb579 P 01adf83af3e04875b5fac9470d4da915: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/wals/96bc42d66fa04fb69afa630969dbb579
I20260807 13:53:52.674306 4504 catalog_manager.cc:5028] TS 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): tablet 96bc42d66fa04fb69afa630969dbb579 (table rebalance_test_table_4 [id=e242e42da20d4458a49a269a9569307a]) successfully deleted
I20260807 13:53:52.911280 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:52.932324 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:53:52.963004 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:53.030514 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:53.064286 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:53.065929 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:53.086807 4688 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:53:53.154994 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:53.163985 12767 ts_tablet_manager.cc:933] T 96bc42d66fa04fb69afa630969dbb579 P 8a9903f009ff46b4a6875490823076c4: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:53:53.226810 12767 tablet_copy_client.cc:323] T 96bc42d66fa04fb69afa630969dbb579 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:53:53.227762 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet 96bc42d66fa04fb69afa630969dbb579 from peer 8a9903f009ff46b4a6875490823076c4 ({username='slave'} at 127.23.107.135:38881)
I20260807 13:53:53.227917 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet 96bc42d66fa04fb69afa630969dbb579 from peer 8a9903f009ff46b4a6875490823076c4 at {username='slave'} at 127.23.107.135:38881: session id = 8a9903f009ff46b4a6875490823076c4-96bc42d66fa04fb69afa630969dbb579
I20260807 13:53:53.232646 5272 tablet_copy_source_session.cc:215] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:53.238410 12767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96bc42d66fa04fb69afa630969dbb579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:53.263732 12767 tablet_copy_client.cc:806] T 96bc42d66fa04fb69afa630969dbb579 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:53.264065 12767 tablet_copy_client.cc:670] T 96bc42d66fa04fb69afa630969dbb579 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:53.267724 12767 tablet_copy_client.cc:538] T 96bc42d66fa04fb69afa630969dbb579 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:53.273020 12767 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P 8a9903f009ff46b4a6875490823076c4: Bootstrap starting.
I20260807 13:53:53.293955 5248 consensus_queue.cc:237] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:53.328214 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:53.329090 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:53:53.378227 7691 raft_consensus.cc:1275] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:53.379103 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:53.380122 11300 consensus_queue.cc:1048] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:53.390322 4892 raft_consensus.cc:1275] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:53.391814 11300 consensus_queue.cc:1048] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:53.397571 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:53.406493 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:53.422375 11300 raft_consensus.cc:2955] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:53.430984 4510 catalog_manager.cc:5697] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:53.434237 4892 raft_consensus.cc:2955] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:53.470624 7691 raft_consensus.cc:2955] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:53.486619 5068 consensus_queue.cc:237] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:53.495307 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:53.498588 4688 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:53:53.535511 7524 raft_consensus.cc:1275] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:53:53.547914 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:53.594092 11870 consensus_queue.cc:1048] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:53:53.599850 4688 tablet_service.cc:1558] Processing DeleteTablet for tablet 50a090faa58e4f91961c9251030efacf with delete_type TABLET_DATA_TOMBSTONED (TS fa83b7af134b4e3b949ac3b4e4bcb5e7 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:56314
I20260807 13:53:53.618140 12767 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P 8a9903f009ff46b4a6875490823076c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:53.618927 12767 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P 8a9903f009ff46b4a6875490823076c4: Bootstrap complete.
I20260807 13:53:53.633735 12767 ts_tablet_manager.cc:1403] T 96bc42d66fa04fb69afa630969dbb579 P 8a9903f009ff46b4a6875490823076c4: Time spent bootstrapping tablet: real 0.361s user 0.071s sys 0.051s
I20260807 13:53:53.635114 12767 raft_consensus.cc:359] T 96bc42d66fa04fb69afa630969dbb579 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:53.635504 12767 raft_consensus.cc:740] T 96bc42d66fa04fb69afa630969dbb579 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a9903f009ff46b4a6875490823076c4, State: Initialized, Role: FOLLOWER
I20260807 13:53:53.635845 12767 consensus_queue.cc:260] T 96bc42d66fa04fb69afa630969dbb579 P 8a9903f009ff46b4a6875490823076c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:53.640833 11870 raft_consensus.cc:2955] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:53.648983 7524 raft_consensus.cc:2955] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:53.652007 12842 tablet_replica.cc:333] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: stopping tablet replica
I20260807 13:53:53.654735 12842 raft_consensus.cc:2243] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:53:53.655483 12842 raft_consensus.cc:2272] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:53:53.658492 12842 ts_tablet_manager.cc:1916] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:53:53.679873 4513 catalog_manager.cc:5697] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 5 to 6, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:53.687948 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet ffa98a163d7540e3a911a39334657138 with delete_type TABLET_DATA_TOMBSTONED (TS edf940ebcc1140cfa0c23214e0c0f179 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:53540
I20260807 13:53:53.690299 5068 consensus_queue.cc:237] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
W20260807 13:53:53.694907 4982 consensus_peers.cc:597] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:53.703153 12767 ts_tablet_manager.cc:1434] T 96bc42d66fa04fb69afa630969dbb579 P 8a9903f009ff46b4a6875490823076c4: Time spent starting tablet: real 0.069s user 0.011s sys 0.011s
I20260807 13:53:53.706914 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session 8a9903f009ff46b4a6875490823076c4-96bc42d66fa04fb69afa630969dbb579 received from {username='slave'} at 127.23.107.135:38881
I20260807 13:53:53.707055 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session 8a9903f009ff46b4a6875490823076c4-96bc42d66fa04fb69afa630969dbb579 on tablet 96bc42d66fa04fb69afa630969dbb579 with peer 8a9903f009ff46b4a6875490823076c4
I20260807 13:53:53.716231 12853 tablet_replica.cc:333] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179: stopping tablet replica
I20260807 13:53:53.724881 12853 raft_consensus.cc:2243] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:53:53.725411 12842 ts_tablet_manager.cc:1929] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:53:53.725685 12853 raft_consensus.cc:2272] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:53:53.727068 7522 raft_consensus.cc:1275] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:53:53.728981 12845 consensus_queue.cc:1048] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:53:53.732484 12853 ts_tablet_manager.cc:1916] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:53:53.736418 12842 log.cc:1199] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/wals/50a090faa58e4f91961c9251030efacf
I20260807 13:53:53.748461 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:53.758515 4506 catalog_manager.cc:5028] TS fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): tablet 50a090faa58e4f91961c9251030efacf (table rebalance_test_table_8 [id=91303cf8b9064e06b8c4165942b287f2]) successfully deleted
I20260807 13:53:53.761121 12845 raft_consensus.cc:2955] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:53:53.766650 7524 raft_consensus.cc:2955] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:53:53.773156 4504 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet ffa98a163d7540e3a911a39334657138 with cas_config_opid_index 6: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260807 13:53:53.776932 4513 catalog_manager.cc:5697] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 6 to 7, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:53:53.790772 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:53.840909 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:53.884169 12853 ts_tablet_manager.cc:1929] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260807 13:53:53.893589 12853 log.cc:1199] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal/wals/ffa98a163d7540e3a911a39334657138
I20260807 13:53:53.895035 4506 catalog_manager.cc:5028] TS edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): tablet ffa98a163d7540e3a911a39334657138 (table rebalance_test_table_6 [id=6008038c907645199b055dacb5772621]) successfully deleted
I20260807 13:53:53.902710 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:53:53.908716 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:53.928175 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:53.928659 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:54.023180 4688 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:53:54.133199 7524 raft_consensus.cc:1217] T 96bc42d66fa04fb69afa630969dbb579 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260807 13:53:54.250375 12955 ts_tablet_manager.cc:933] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:54.261952 12955 tablet_copy_client.cc:323] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:53:54.262816 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet ffa98a163d7540e3a911a39334657138 from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 ({username='slave'} at 127.23.107.129:37907)
I20260807 13:53:54.262982 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet ffa98a163d7540e3a911a39334657138 from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 at {username='slave'} at 127.23.107.129:37907: session id = fa83b7af134b4e3b949ac3b4e4bcb5e7-ffa98a163d7540e3a911a39334657138
I20260807 13:53:54.268304 5101 tablet_copy_source_session.cc:215] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:54.270115 12955 ts_tablet_manager.cc:1916] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:53:54.280789 12955 ts_tablet_manager.cc:1929] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.4
I20260807 13:53:54.281107 12955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa98a163d7540e3a911a39334657138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:54.284885 4715 consensus_queue.cc:237] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:54.285079 12955 tablet_copy_client.cc:806] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:54.285363 12955 tablet_copy_client.cc:670] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:54.287530 12955 tablet_copy_client.cc:538] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:54.296700 12955 tablet_bootstrap.cc:492] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:53:54.296645 4717 consensus_queue.cc:237] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:54.322309 7179 raft_consensus.cc:1275] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:54.323333 12396 consensus_queue.cc:1048] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:54.347004 5068 raft_consensus.cc:1275] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:54.348140 12396 consensus_queue.cc:1048] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:54.365967 7180 raft_consensus.cc:1275] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:54.367692 12396 consensus_queue.cc:1048] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:54.387917 4892 raft_consensus.cc:1275] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:54.389336 12396 consensus_queue.cc:1048] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:54.396687 12092 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:54.403412 4896 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:54.407644 4510 catalog_manager.cc:5697] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index 4 to 5, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:54.426612 7178 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:54.434295 12396 raft_consensus.cc:2955] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:54.435114 5068 raft_consensus.cc:2955] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:54.436890 7180 raft_consensus.cc:2955] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:54.464143 4515 catalog_manager.cc:5697] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 4 to 5, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:54.476981 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 966ebd287fc14e498e5bd3e6542194ca with delete_type TABLET_DATA_TOMBSTONED (TS edf940ebcc1140cfa0c23214e0c0f179 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:53540
I20260807 13:53:54.479245 5216 tablet_service.cc:1558] Processing DeleteTablet for tablet 04dac80fea124c25b34af8cc290c0d7f with delete_type TABLET_DATA_TOMBSTONED (TS edf940ebcc1140cfa0c23214e0c0f179 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:53540
I20260807 13:53:54.500499 13011 tablet_replica.cc:333] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179: stopping tablet replica
I20260807 13:53:54.502604 13011 raft_consensus.cc:2243] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:53:54.503382 13011 raft_consensus.cc:2272] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:53:54.505239 12955 tablet_bootstrap.cc:492] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:54.506551 13011 ts_tablet_manager.cc:1916] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:53:54.507665 12955 tablet_bootstrap.cc:492] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap complete.
I20260807 13:53:54.513020 12955 ts_tablet_manager.cc:1403] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.216s user 0.070s sys 0.016s
I20260807 13:53:54.515659 12955 raft_consensus.cc:359] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:54.516387 12955 raft_consensus.cc:740] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:53:54.517019 12955 consensus_queue.cc:260] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:54.518340 12955 ts_tablet_manager.cc:1434] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260807 13:53:54.524114 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session fa83b7af134b4e3b949ac3b4e4bcb5e7-ffa98a163d7540e3a911a39334657138 received from {username='slave'} at 127.23.107.129:37907
I20260807 13:53:54.524289 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session fa83b7af134b4e3b949ac3b4e4bcb5e7-ffa98a163d7540e3a911a39334657138 on tablet ffa98a163d7540e3a911a39334657138 with peer fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:53:54.543489 13011 ts_tablet_manager.cc:1929] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:53:54.546060 13011 log.cc:1199] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal/wals/966ebd287fc14e498e5bd3e6542194ca
I20260807 13:53:54.547163 13011 tablet_replica.cc:333] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179: stopping tablet replica
I20260807 13:53:54.547354 4506 catalog_manager.cc:5028] TS edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): tablet 966ebd287fc14e498e5bd3e6542194ca (table rebalance_test_table_6 [id=6008038c907645199b055dacb5772621]) successfully deleted
I20260807 13:53:54.548902 13011 raft_consensus.cc:2243] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:53:54.549849 13011 raft_consensus.cc:2272] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:53:54.551223 13011 ts_tablet_manager.cc:1916] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:53:54.571095 13011 ts_tablet_manager.cc:1929] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:53:54.583225 13011 log.cc:1199] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal/wals/04dac80fea124c25b34af8cc290c0d7f
I20260807 13:53:54.590801 4506 catalog_manager.cc:5028] TS edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): tablet 04dac80fea124c25b34af8cc290c0d7f (table rebalance_test_table_8 [id=91303cf8b9064e06b8c4165942b287f2]) successfully deleted
I20260807 13:53:54.724347 4717 raft_consensus.cc:1217] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260807 13:53:54.765133 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:54.776266 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:53:54.935853 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:54.988034 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:55.001937 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:55.003237 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:55.056067 4688 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:53:55.221974 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:55.287894 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:55.288733 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:55.326685 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:53:55.356550 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:55.383383 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:55.438392 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:55.451453 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:55.486182 4688 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:53:55.678350 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:55.678977 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:53:55.692056 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:55.717483 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:55.762104 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:55.776794 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:55.780791 4688 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:53:55.820785 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:56.073307 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:53:56.083066 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:56.132570 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:56.159806 4715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04dac80fea124c25b34af8cc290c0d7f"
dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:46704
I20260807 13:53:56.160038 4715 raft_consensus.cc:606] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Received request to transfer leadership
I20260807 13:53:56.162037 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:56.169036 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:53:56.186236 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:56.206135 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:56.213433 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:53:56.233222 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:56.260566 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:56.261869 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:56.294042 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:56.295257 4688 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:53:56.316108 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:56.406157 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:56.410300 4688 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:53:56.496232 4892 consensus_queue.cc:237] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:56.516389 7180 raft_consensus.cc:1275] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:56.517472 12182 consensus_queue.cc:1048] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:56.523775 5245 raft_consensus.cc:1275] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:56.524745 12182 consensus_queue.cc:1048] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:56.583122 12182 raft_consensus.cc:2955] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:56.590651 7180 raft_consensus.cc:2955] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:56.599539 13330 raft_consensus.cc:993] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: : Instructing follower 01adf83af3e04875b5fac9470d4da915 to start an election
I20260807 13:53:56.599979 12396 raft_consensus.cc:1081] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Signalling peer 01adf83af3e04875b5fac9470d4da915 to start an election
I20260807 13:53:56.601415 5068 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04dac80fea124c25b34af8cc290c0d7f"
dest_uuid: "01adf83af3e04875b5fac9470d4da915"
from {username='slave'} at 127.23.107.129:37907
I20260807 13:53:56.601954 5068 raft_consensus.cc:493] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:53:56.602187 5068 raft_consensus.cc:3060] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:53:56.608428 4510 catalog_manager.cc:5697] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:56.612033 5068 raft_consensus.cc:515] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:56.614219 4715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04dac80fea124c25b34af8cc290c0d7f" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: true dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
I20260807 13:53:56.614501 4715 raft_consensus.cc:3055] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:53:56.614586 4715 raft_consensus.cc:740] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Running, Role: LEADER
I20260807 13:53:56.614913 4715 consensus_queue.cc:260] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:56.615403 4715 raft_consensus.cc:3060] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:53:56.622970 4715 raft_consensus.cc:2468] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 2.
I20260807 13:53:56.623852 4982 leader_election.cc:304] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:53:56.624502 11870 raft_consensus.cc:2804] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:53:56.691584 5068 leader_election.cc:290] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 2 election: Requested vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075)
I20260807 13:53:56.837025 11870 raft_consensus.cc:697] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [term 2 LEADER]: Becoming Leader. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Running, Role: LEADER
I20260807 13:53:56.837533 11870 consensus_queue.cc:237] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:56.849695 5245 raft_consensus.cc:2955] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:56.903985 4513 catalog_manager.cc:5697] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 reported cstate change: term changed from 1 to 2, leader changed from fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) to 01adf83af3e04875b5fac9470d4da915 (127.23.107.131). New cstate: current_term: 2 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:56.912807 5039 tablet_service.cc:1558] Processing DeleteTablet for tablet 312c7ed04e334b08b506c8908224a7da with delete_type TABLET_DATA_TOMBSTONED (TS 01adf83af3e04875b5fac9470d4da915 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36810
I20260807 13:53:56.959540 7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04dac80fea124c25b34af8cc290c0d7f" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: true dest_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd"
I20260807 13:53:56.960404 7180 raft_consensus.cc:3060] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:53:56.972781 7180 raft_consensus.cc:2468] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 2.
I20260807 13:53:57.005232 13362 tablet_replica.cc:333] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915: stopping tablet replica
I20260807 13:53:57.006671 13362 raft_consensus.cc:2243] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:53:57.007020 13362 raft_consensus.cc:2272] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:53:57.008000 13362 ts_tablet_manager.cc:1916] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:53:57.106770 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:53:57.108623 13362 ts_tablet_manager.cc:1929] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:53:57.108774 13362 log.cc:1199] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/wals/312c7ed04e334b08b506c8908224a7da
I20260807 13:53:57.109722 4504 catalog_manager.cc:5028] TS 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): tablet 312c7ed04e334b08b506c8908224a7da (table rebalance_test_table_5 [id=b6c061acc30c4e5aa6bee1f054e3a59a]) successfully deleted
I20260807 13:53:57.180783 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:57.211584 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:57.238829 7180 raft_consensus.cc:1275] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20260807 13:53:57.246430 13345 consensus_queue.cc:1048] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:53:57.247399 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:57.275905 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:57.296746 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:57.369122 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:57.410975 4715 raft_consensus.cc:1275] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20260807 13:53:57.412664 13345 consensus_queue.cc:1048] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:53:57.449787 4717 consensus_queue.cc:237] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:57.483098 7522 raft_consensus.cc:1275] T 0c1327c8461e44f2ac5d77f10c390eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:57.483927 13330 consensus_queue.cc:1048] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:57.489086 4896 raft_consensus.cc:1275] T 0c1327c8461e44f2ac5d77f10c390eeb P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:57.521148 7522 raft_consensus.cc:2955] T 0c1327c8461e44f2ac5d77f10c390eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:57.520763 13460 consensus_queue.cc:1048] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260807 13:53:57.518775 13452 raft_consensus.cc:2955] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
W20260807 13:53:57.537838 4631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.130:37489, user_credentials={real_user=slave}} blocked reactor thread for 43554.2us
I20260807 13:53:57.548133 4515 catalog_manager.cc:5697] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:57.550350 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:53:57.592130 4896 raft_consensus.cc:2955] T 0c1327c8461e44f2ac5d77f10c390eeb P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:57.664558 5039 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c1327c8461e44f2ac5d77f10c390eeb with delete_type TABLET_DATA_TOMBSTONED (TS 01adf83af3e04875b5fac9470d4da915 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36810
I20260807 13:53:57.687940 13499 tablet_replica.cc:333] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915: stopping tablet replica
I20260807 13:53:57.688534 13499 raft_consensus.cc:2243] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:53:57.689709 13499 raft_consensus.cc:2272] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:53:57.691045 13499 ts_tablet_manager.cc:1916] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:53:57.704809 13499 ts_tablet_manager.cc:1929] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:53:57.707098 13499 log.cc:1199] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/wals/0c1327c8461e44f2ac5d77f10c390eeb
I20260807 13:53:57.708627 4504 catalog_manager.cc:5028] TS 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): tablet 0c1327c8461e44f2ac5d77f10c390eeb (table rebalance_test_table_3 [id=c2c7db1795a1414c8299bebbeaf60404]) successfully deleted
I20260807 13:53:57.735386 4896 consensus_queue.cc:237] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:57.770831 7180 raft_consensus.cc:1275] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:53:57.772068 7522 raft_consensus.cc:1275] T 541201ddfdf041ed87b3d0e731763a37 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:53:57.772190 5245 raft_consensus.cc:1275] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:53:57.772540 13332 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:53:57.772974 12182 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:53:57.774485 12182 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:53:57.814064 13332 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:57.814877 5248 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:57.839455 4513 catalog_manager.cc:5697] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index 5 to 6, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:57.843669 4688 tablet_service.cc:1558] Processing DeleteTablet for tablet 541201ddfdf041ed87b3d0e731763a37 with delete_type TABLET_DATA_TOMBSTONED (TS fa83b7af134b4e3b949ac3b4e4bcb5e7 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:56314
I20260807 13:53:57.852485 7522 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:57.881294 13560 tablet_replica.cc:333] T 541201ddfdf041ed87b3d0e731763a37 P fa83b7af134b4e3b949ac3b4e4bcb5e7: stopping tablet replica
I20260807 13:53:57.883265 13560 raft_consensus.cc:2243] T 541201ddfdf041ed87b3d0e731763a37 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:53:57.884307 7180 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:53:57.885855 13560 raft_consensus.cc:2272] T 541201ddfdf041ed87b3d0e731763a37 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:53:57.886773 13560 ts_tablet_manager.cc:1916] T 541201ddfdf041ed87b3d0e731763a37 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:53:57.903108 13560 ts_tablet_manager.cc:1929] T 541201ddfdf041ed87b3d0e731763a37 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260807 13:53:57.903411 13560 log.cc:1199] T 541201ddfdf041ed87b3d0e731763a37 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/wals/541201ddfdf041ed87b3d0e731763a37
I20260807 13:53:57.904474 4506 catalog_manager.cc:5028] TS fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): tablet 541201ddfdf041ed87b3d0e731763a37 (table rebalance_test_table_4 [id=e242e42da20d4458a49a269a9569307a]) successfully deleted
I20260807 13:53:58.086814 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:58.130699 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:53:58.144426 5068 consensus_queue.cc:237] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 2.6, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:58.146647 7180 raft_consensus.cc:1275] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 2 index: 6. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20260807 13:53:58.148671 13345 consensus_queue.cc:1048] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:53:58.151546 13345 raft_consensus.cc:2955] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [term 2 LEADER]: Committing config change with OpId 2.7: config changed from index 5 to 7, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:58.156656 7180 raft_consensus.cc:2955] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Committing config change with OpId 2.7: config changed from index 5 to 7, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:58.163839 4517 catalog_manager.cc:5697] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: config changed from index 5 to 7, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New cstate: current_term: 2 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:58.177409 4688 tablet_service.cc:1558] Processing DeleteTablet for tablet 04dac80fea124c25b34af8cc290c0d7f with delete_type TABLET_DATA_TOMBSTONED (TS fa83b7af134b4e3b949ac3b4e4bcb5e7 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:56314
I20260807 13:53:58.177807 13560 tablet_replica.cc:333] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: stopping tablet replica
I20260807 13:53:58.178164 13560 raft_consensus.cc:2243] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:53:58.178438 13560 raft_consensus.cc:2272] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:53:58.180928 5068 consensus_queue.cc:237] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 2.7, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
W20260807 13:53:58.183770 4982 consensus_peers.cc:597] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:53:58.184296 13560 ts_tablet_manager.cc:1916] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:53:58.185982 7180 raft_consensus.cc:1275] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 2 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260807 13:53:58.186830 13345 consensus_queue.cc:1048] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:53:58.194635 13345 raft_consensus.cc:2955] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [term 2 LEADER]: Committing config change with OpId 2.8: config changed from index 7 to 8, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:53:58.198243 7180 raft_consensus.cc:2955] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Committing config change with OpId 2.8: config changed from index 7 to 8, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:53:58.203193 4504 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet 04dac80fea124c25b34af8cc290c0d7f with cas_config_opid_index 7: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260807 13:53:58.207715 4515 catalog_manager.cc:5697] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: config changed from index 7 to 8, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New cstate: current_term: 2 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:53:58.224123 13560 ts_tablet_manager.cc:1929] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.6
I20260807 13:53:58.228760 13560 log.cc:1199] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/wals/04dac80fea124c25b34af8cc290c0d7f
I20260807 13:53:58.233255 4506 catalog_manager.cc:5028] TS fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): tablet 04dac80fea124c25b34af8cc290c0d7f (table rebalance_test_table_8 [id=91303cf8b9064e06b8c4165942b287f2]) successfully deleted
I20260807 13:53:58.260133 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:58.289925 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:58.319000 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:58.331213 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:53:58.343837 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:58.365620 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:58.536960 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:58.541779 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:58.551079 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:53:58.581060 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:58.592598 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:58.643419 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:53:58.700120 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:58.701004 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:59.028203 13783 ts_tablet_manager.cc:933] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:53:59.050112 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:59.058490 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:59.061261 13783 tablet_copy_client.cc:323] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:53:59.062105 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet 04dac80fea124c25b34af8cc290c0d7f from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 ({username='slave'} at 127.23.107.129:37907)
I20260807 13:53:59.062259 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet 04dac80fea124c25b34af8cc290c0d7f from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 at {username='slave'} at 127.23.107.129:37907: session id = fa83b7af134b4e3b949ac3b4e4bcb5e7-04dac80fea124c25b34af8cc290c0d7f
I20260807 13:53:59.066663 5101 tablet_copy_source_session.cc:215] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:53:59.066965 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:59.082259 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:53:59.105479 13783 ts_tablet_manager.cc:1916] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:53:59.116660 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:53:59.122896 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:59.143380 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:59.157507 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:59.162241 4715 consensus_queue.cc:237] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:53:59.177625 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:59.186801 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:59.190356 5068 raft_consensus.cc:1275] T 68717842b14e4f06b528c08a65acd3b7 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:53:59.191617 13669 consensus_queue.cc:1048] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:53:59.191838 7180 raft_consensus.cc:1275] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:53:59.198086 13669 consensus_queue.cc:1048] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:53:59.202823 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:53:59.250937 13823 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
W20260807 13:53:59.303036 7274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.135:40385, user_credentials={real_user=slave}} blocked reactor thread for 164775us
I20260807 13:53:59.304653 7353 raft_consensus.cc:1275] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:53:59.306818 5068 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:59.315550 4515 catalog_manager.cc:5697] T 68717842b14e4f06b528c08a65acd3b7 P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:59.315881 7180 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:59.315271 13832 consensus_queue.cc:1048] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:53:59.387209 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:59.399766 13783 ts_tablet_manager.cc:1929] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 2.6
I20260807 13:53:59.400203 13783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04dac80fea124c25b34af8cc290c0d7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:53:59.414531 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:53:59.427860 4865 tablet_service.cc:1558] Processing DeleteTablet for tablet 68717842b14e4f06b528c08a65acd3b7 with delete_type TABLET_DATA_TOMBSTONED (TS c9d2944272bc447dafce7620ac2dbd4b not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:36624
I20260807 13:53:59.452234 7353 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:53:59.453382 4866 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:53:59.473867 13850 tablet_replica.cc:333] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b: stopping tablet replica
I20260807 13:53:59.474206 13850 raft_consensus.cc:2243] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:53:59.474640 13850 raft_consensus.cc:2272] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:53:59.475756 13850 ts_tablet_manager.cc:1916] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:53:59.505743 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:53:59.507663 13783 tablet_copy_client.cc:806] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Starting download of 0 data blocks...
I20260807 13:53:59.507916 13783 tablet_copy_client.cc:670] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Starting download of 1 WAL segments...
I20260807 13:53:59.504710 13850 ts_tablet_manager.cc:1929] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260807 13:53:59.517812 13850 log.cc:1199] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/68717842b14e4f06b528c08a65acd3b7
I20260807 13:53:59.533674 13783 tablet_copy_client.cc:538] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:53:59.561657 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:53:59.562567 4505 catalog_manager.cc:5028] TS c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): tablet 68717842b14e4f06b528c08a65acd3b7 (table rebalance_test_table_1 [id=7f1d26639edd4cb398339b2b0d3659a3]) successfully deleted
I20260807 13:53:59.583393 13783 tablet_bootstrap.cc:492] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:53:59.889501 5245 consensus_queue.cc:237] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:53:59.911645 5068 raft_consensus.cc:1275] T e22d4edb78d24783bae07928b6c95fc2 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:59.912709 7688 raft_consensus.cc:1275] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:53:59.912638 13646 consensus_queue.cc:1048] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:59.913689 13646 consensus_queue.cc:1048] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:53:59.932749 13900 raft_consensus.cc:2955] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:59.933867 7691 raft_consensus.cc:2955] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:59.934540 5072 raft_consensus.cc:2955] T e22d4edb78d24783bae07928b6c95fc2 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:59.942930 4515 catalog_manager.cc:5697] T e22d4edb78d24783bae07928b6c95fc2 P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:53:59.994333 13783 tablet_bootstrap.cc:492] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:53:59.994971 13783 tablet_bootstrap.cc:492] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap complete.
I20260807 13:53:59.996060 13783 ts_tablet_manager.cc:1403] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.413s user 0.063s sys 0.003s
I20260807 13:53:59.997586 13783 raft_consensus.cc:359] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:53:59.999750 13783 raft_consensus.cc:740] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:54:00.000504 13783 consensus_queue.cc:260] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 2.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:00.003082 13783 ts_tablet_manager.cc:1434] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260807 13:54:00.008028 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session fa83b7af134b4e3b949ac3b4e4bcb5e7-04dac80fea124c25b34af8cc290c0d7f received from {username='slave'} at 127.23.107.129:37907
I20260807 13:54:00.008189 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session fa83b7af134b4e3b949ac3b4e4bcb5e7-04dac80fea124c25b34af8cc290c0d7f on tablet 04dac80fea124c25b34af8cc290c0d7f with peer fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:54:00.016657 4688 tablet_service.cc:1558] Processing DeleteTablet for tablet e22d4edb78d24783bae07928b6c95fc2 with delete_type TABLET_DATA_TOMBSTONED (TS fa83b7af134b4e3b949ac3b4e4bcb5e7 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:56314
I20260807 13:54:00.030767 13964 tablet_replica.cc:333] T e22d4edb78d24783bae07928b6c95fc2 P fa83b7af134b4e3b949ac3b4e4bcb5e7: stopping tablet replica
I20260807 13:54:00.031123 13964 raft_consensus.cc:2243] T e22d4edb78d24783bae07928b6c95fc2 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:00.041646 13964 raft_consensus.cc:2272] T e22d4edb78d24783bae07928b6c95fc2 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:00.044047 13964 ts_tablet_manager.cc:1916] T e22d4edb78d24783bae07928b6c95fc2 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:00.054083 13964 ts_tablet_manager.cc:1929] T e22d4edb78d24783bae07928b6c95fc2 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:54:00.054371 13964 log.cc:1199] T e22d4edb78d24783bae07928b6c95fc2 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/wals/e22d4edb78d24783bae07928b6c95fc2
I20260807 13:54:00.055536 4506 catalog_manager.cc:5028] TS fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): tablet e22d4edb78d24783bae07928b6c95fc2 (table rebalance_test_table_0 [id=14867b014aab43119171102f60bb134d]) successfully deleted
I20260807 13:54:00.159709 4717 raft_consensus.cc:1217] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 2.7->[2.8-2.8] Dedup: 2.8->[]
I20260807 13:54:00.241781 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:00.285604 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:00.299052 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:00.317440 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:00.390583 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:00.392517 5072 consensus_queue.cc:237] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:00.409533 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:00.410634 7353 raft_consensus.cc:1275] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:54:00.411309 13985 consensus_queue.cc:1048] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:54:00.426512 4717 raft_consensus.cc:1275] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:54:00.427328 13985 consensus_queue.cc:1048] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:54:00.431421 13985 raft_consensus.cc:2955] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:00.435814 7354 raft_consensus.cc:2955] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:00.455622 4517 catalog_manager.cc:5697] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: config changed from index 4 to 5, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:00.457670 4717 raft_consensus.cc:2955] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:00.463358 4865 tablet_service.cc:1558] Processing DeleteTablet for tablet 81cbb42cd4954383976169ec16ef2416 with delete_type TABLET_DATA_TOMBSTONED (TS c9d2944272bc447dafce7620ac2dbd4b not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36624
I20260807 13:54:00.471215 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:00.472666 14056 tablet_replica.cc:333] T 81cbb42cd4954383976169ec16ef2416 P c9d2944272bc447dafce7620ac2dbd4b: stopping tablet replica
I20260807 13:54:00.473876 14056 raft_consensus.cc:2243] T 81cbb42cd4954383976169ec16ef2416 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:00.474850 14056 raft_consensus.cc:2272] T 81cbb42cd4954383976169ec16ef2416 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:00.476524 14056 ts_tablet_manager.cc:1916] T 81cbb42cd4954383976169ec16ef2416 P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:00.502580 14056 ts_tablet_manager.cc:1929] T 81cbb42cd4954383976169ec16ef2416 P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:54:00.504259 14056 log.cc:1199] T 81cbb42cd4954383976169ec16ef2416 P c9d2944272bc447dafce7620ac2dbd4b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/81cbb42cd4954383976169ec16ef2416
I20260807 13:54:00.506494 4505 catalog_manager.cc:5028] TS c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): tablet 81cbb42cd4954383976169ec16ef2416 (table rebalance_test_table_9 [id=96e83925faa542ffa4808b01a5adbbb3]) successfully deleted
I20260807 13:54:00.530223 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:00.848718 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:00.889529 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:00.931094 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:00.949481 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:00.958889 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:00.971141 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:01.005519 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:01.047724 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:01.167611 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:01.185256 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:01.203382 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:01.225675 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:01.236402 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:01.248209 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:01.270972 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:01.284921 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:01.288322 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:01.328207 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:01.349867 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:01.353459 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:01.393219 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:01.400866 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:54:01.466986 5153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.130:37489, user_credentials={real_user=slave}} blocked reactor thread for 76743.7us
I20260807 13:54:01.480378 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:01.499516 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:01.647894 5248 consensus_queue.cc:237] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:01.667827 7180 raft_consensus.cc:1275] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:54:01.668591 13900 consensus_queue.cc:1048] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:54:01.677399 4896 raft_consensus.cc:1275] T c10b910e9f354933b60ae70f1baa9b6f P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:54:01.678160 13900 consensus_queue.cc:1048] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:54:01.689487 14217 raft_consensus.cc:2955] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:01.694905 7180 raft_consensus.cc:2955] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:01.700055 4516 catalog_manager.cc:5697] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:01.725817 4892 raft_consensus.cc:2955] T c10b910e9f354933b60ae70f1baa9b6f P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:01.881408 5039 tablet_service.cc:1558] Processing DeleteTablet for tablet c10b910e9f354933b60ae70f1baa9b6f with delete_type TABLET_DATA_TOMBSTONED (TS 01adf83af3e04875b5fac9470d4da915 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36810
I20260807 13:54:01.891300 14260 tablet_replica.cc:333] T c10b910e9f354933b60ae70f1baa9b6f P 01adf83af3e04875b5fac9470d4da915: stopping tablet replica
I20260807 13:54:01.892867 14260 raft_consensus.cc:2243] T c10b910e9f354933b60ae70f1baa9b6f P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:01.894099 14260 raft_consensus.cc:2272] T c10b910e9f354933b60ae70f1baa9b6f P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:01.934939 14260 ts_tablet_manager.cc:1916] T c10b910e9f354933b60ae70f1baa9b6f P 01adf83af3e04875b5fac9470d4da915: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260807 13:54:01.968487 4806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:41217, user_credentials={real_user=slave}} blocked reactor thread for 71275.6us
I20260807 13:54:01.979786 14260 ts_tablet_manager.cc:1929] T c10b910e9f354933b60ae70f1baa9b6f P 01adf83af3e04875b5fac9470d4da915: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:54:01.979977 14260 log.cc:1199] T c10b910e9f354933b60ae70f1baa9b6f P 01adf83af3e04875b5fac9470d4da915: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/wals/c10b910e9f354933b60ae70f1baa9b6f
I20260807 13:54:01.981218 4504 catalog_manager.cc:5028] TS 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): tablet c10b910e9f354933b60ae70f1baa9b6f (table rebalance_test_table_3 [id=c2c7db1795a1414c8299bebbeaf60404]) successfully deleted
I20260807 13:54:02.045010 5072 consensus_queue.cc:237] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:02.064975 7354 raft_consensus.cc:1275] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:54:02.065853 13985 consensus_queue.cc:1048] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:54:02.076326 5248 raft_consensus.cc:1275] T d27ce55f2acc4513a9fd90a338098eeb P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:54:02.077104 13985 consensus_queue.cc:1048] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:54:02.093324 14278 raft_consensus.cc:2955] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:02.094789 5248 raft_consensus.cc:2955] T d27ce55f2acc4513a9fd90a338098eeb P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:02.098443 7354 raft_consensus.cc:2955] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:02.106232 4510 catalog_manager.cc:5697] T d27ce55f2acc4513a9fd90a338098eeb P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index 4 to 5, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:02.152241 4865 tablet_service.cc:1558] Processing DeleteTablet for tablet d27ce55f2acc4513a9fd90a338098eeb with delete_type TABLET_DATA_TOMBSTONED (TS c9d2944272bc447dafce7620ac2dbd4b not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36624
I20260807 13:54:02.153116 14382 tablet_replica.cc:333] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b: stopping tablet replica
I20260807 13:54:02.153523 14382 raft_consensus.cc:2243] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:02.154312 14382 raft_consensus.cc:2272] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:02.155435 14382 ts_tablet_manager.cc:1916] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:02.158776 5072 consensus_queue.cc:237] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:02.170459 7354 raft_consensus.cc:1275] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:54:02.172358 14278 consensus_queue.cc:1048] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:54:02.179247 4896 raft_consensus.cc:1275] T eab259b597a64c04869543ccb1d9038c P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:54:02.180100 14278 consensus_queue.cc:1048] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:54:02.198716 14382 ts_tablet_manager.cc:1929] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:54:02.199922 14278 raft_consensus.cc:2955] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:02.200426 14382 log.cc:1199] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/d27ce55f2acc4513a9fd90a338098eeb
I20260807 13:54:02.201442 4505 catalog_manager.cc:5028] TS c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): tablet d27ce55f2acc4513a9fd90a338098eeb (table rebalance_test_table_9 [id=96e83925faa542ffa4808b01a5adbbb3]) successfully deleted
I20260807 13:54:02.206319 4892 consensus_queue.cc:237] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:02.220204 4510 catalog_manager.cc:5697] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 4 to 5, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:02.219523 4896 raft_consensus.cc:2955] T eab259b597a64c04869543ccb1d9038c P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:02.226009 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet eab259b597a64c04869543ccb1d9038c with delete_type TABLET_DATA_TOMBSTONED (TS edf940ebcc1140cfa0c23214e0c0f179 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:53540
I20260807 13:54:02.230237 14404 tablet_replica.cc:333] T eab259b597a64c04869543ccb1d9038c P edf940ebcc1140cfa0c23214e0c0f179: stopping tablet replica
I20260807 13:54:02.232923 7353 raft_consensus.cc:1275] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:54:02.233815 14268 consensus_queue.cc:1048] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:54:02.234984 7353 raft_consensus.cc:2955] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:02.235523 4717 raft_consensus.cc:1275] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:54:02.236182 14055 consensus_queue.cc:1048] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:54:02.259265 14404 raft_consensus.cc:2243] T eab259b597a64c04869543ccb1d9038c P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:02.260244 14404 raft_consensus.cc:2272] T eab259b597a64c04869543ccb1d9038c P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:02.263566 14404 ts_tablet_manager.cc:1916] T eab259b597a64c04869543ccb1d9038c P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:02.289219 14055 raft_consensus.cc:2955] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:02.293618 4715 raft_consensus.cc:2955] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:02.293653 7354 raft_consensus.cc:2955] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:02.299824 4510 catalog_manager.cc:5697] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: config changed from index 4 to 5, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:02.311760 5039 tablet_service.cc:1558] Processing DeleteTablet for tablet 069a5f0089b24a609b27d4a07a3c4353 with delete_type TABLET_DATA_TOMBSTONED (TS 01adf83af3e04875b5fac9470d4da915 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36810
I20260807 13:54:02.312234 14260 tablet_replica.cc:333] T 069a5f0089b24a609b27d4a07a3c4353 P 01adf83af3e04875b5fac9470d4da915: stopping tablet replica
I20260807 13:54:02.312429 14260 raft_consensus.cc:2243] T 069a5f0089b24a609b27d4a07a3c4353 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:02.312642 14260 raft_consensus.cc:2272] T 069a5f0089b24a609b27d4a07a3c4353 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:02.313889 14260 ts_tablet_manager.cc:1916] T 069a5f0089b24a609b27d4a07a3c4353 P 01adf83af3e04875b5fac9470d4da915: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:02.322647 14260 ts_tablet_manager.cc:1929] T 069a5f0089b24a609b27d4a07a3c4353 P 01adf83af3e04875b5fac9470d4da915: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:54:02.322965 14260 log.cc:1199] T 069a5f0089b24a609b27d4a07a3c4353 P 01adf83af3e04875b5fac9470d4da915: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/wals/069a5f0089b24a609b27d4a07a3c4353
I20260807 13:54:02.324062 4504 catalog_manager.cc:5028] TS 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): tablet 069a5f0089b24a609b27d4a07a3c4353 (table rebalance_test_table_5 [id=b6c061acc30c4e5aa6bee1f054e3a59a]) successfully deleted
I20260807 13:54:02.360926 14404 ts_tablet_manager.cc:1929] T eab259b597a64c04869543ccb1d9038c P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:54:02.361219 14404 log.cc:1199] T eab259b597a64c04869543ccb1d9038c P edf940ebcc1140cfa0c23214e0c0f179: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal/wals/eab259b597a64c04869543ccb1d9038c
I20260807 13:54:02.377211 4506 catalog_manager.cc:5028] TS edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): tablet eab259b597a64c04869543ccb1d9038c (table rebalance_test_table_7 [id=2ff801ea568346e096cc895a279c109c]) successfully deleted
I20260807 13:54:02.508478 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:02.529211 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:02.542908 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:02.657056 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:02.683845 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:02.728214 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:02.760530 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:02.808342 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:03.319458 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:03.330879 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:03.332859 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:03.353152 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:03.419306 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:03.498585 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:03.505928 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:03.519704 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:03.562184 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:03.573904 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:03.579900 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:03.603626 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:03.603897 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
W20260807 13:54:03.606809 4982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.134:35975, user_credentials={real_user=slave}} blocked reactor thread for 86516.3us
I20260807 13:54:03.625569 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:03.627897 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:03.631111 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:03.645836 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:03.651314 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:03.669659 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:03.679570 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:03.691421 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:03.698036 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:03.786309 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:03.796542 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:03.831641 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:03.841229 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260807 13:54:03.873606 4632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.134:35975, user_credentials={real_user=slave}} blocked reactor thread for 139615us
I20260807 13:54:03.882937 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:03.884326 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:03.912830 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:03.931917 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:03.969167 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:04.002529 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:04.287926 5248 consensus_queue.cc:237] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:04.302785 7687 raft_consensus.cc:1275] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:54:04.303028 5072 raft_consensus.cc:1275] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:54:04.303622 14667 consensus_queue.cc:1048] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:54:04.303954 14378 consensus_queue.cc:1048] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:54:04.338248 14378 raft_consensus.cc:2955] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:04.338975 7690 raft_consensus.cc:2955] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:04.348601 4510 catalog_manager.cc:5697] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
W20260807 13:54:04.371598 4806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.134:35975, user_credentials={real_user=slave}} blocked reactor thread for 58825.6us
I20260807 13:54:04.375285 5068 raft_consensus.cc:2955] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:04.407989 4688 tablet_service.cc:1558] Processing DeleteTablet for tablet b414c896ad884facb339e5e4a0329065 with delete_type TABLET_DATA_TOMBSTONED (TS fa83b7af134b4e3b949ac3b4e4bcb5e7 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:56314
I20260807 13:54:04.411501 14757 tablet_replica.cc:333] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7: stopping tablet replica
I20260807 13:54:04.411823 14757 raft_consensus.cc:2243] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:04.412081 14757 raft_consensus.cc:2272] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:04.413107 14757 ts_tablet_manager.cc:1916] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:04.442153 14757 ts_tablet_manager.cc:1929] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:54:04.442464 14757 log.cc:1199] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/wals/b414c896ad884facb339e5e4a0329065
I20260807 13:54:04.443660 4506 catalog_manager.cc:5028] TS fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): tablet b414c896ad884facb339e5e4a0329065 (table rebalance_test_table_2 [id=35d13981f3a742dd9369d1e7bf18498c]) successfully deleted
I20260807 13:54:04.558583 4717 consensus_queue.cc:237] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:04.572930 7353 raft_consensus.cc:1275] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:54:04.573757 14685 consensus_queue.cc:1048] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:54:04.578999 5248 raft_consensus.cc:1275] T d06f352d0ff34b45b753a2c20f65574f P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:54:04.579807 14685 consensus_queue.cc:1048] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:54:04.581625 5245 consensus_queue.cc:237] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:04.594274 14685 raft_consensus.cc:2955] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:04.598565 7354 raft_consensus.cc:2955] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:04.609300 4516 catalog_manager.cc:5697] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index 4 to 5, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:04.619608 7690 raft_consensus.cc:1275] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:54:04.623060 4865 tablet_service.cc:1558] Processing DeleteTablet for tablet d06f352d0ff34b45b753a2c20f65574f with delete_type TABLET_DATA_TOMBSTONED (TS c9d2944272bc447dafce7620ac2dbd4b not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36624
I20260807 13:54:04.625619 14725 consensus_queue.cc:1048] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:54:04.632185 5246 raft_consensus.cc:2955] T d06f352d0ff34b45b753a2c20f65574f P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:04.649375 5072 consensus_queue.cc:237] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:04.657193 14845 tablet_replica.cc:333] T d06f352d0ff34b45b753a2c20f65574f P c9d2944272bc447dafce7620ac2dbd4b: stopping tablet replica
I20260807 13:54:04.657524 14845 raft_consensus.cc:2243] T d06f352d0ff34b45b753a2c20f65574f P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:04.657790 14845 raft_consensus.cc:2272] T d06f352d0ff34b45b753a2c20f65574f P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:04.658639 14845 ts_tablet_manager.cc:1916] T d06f352d0ff34b45b753a2c20f65574f P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:04.662878 7524 raft_consensus.cc:1275] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:04.663928 14810 consensus_queue.cc:1048] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:04.672082 14845 ts_tablet_manager.cc:1929] T d06f352d0ff34b45b753a2c20f65574f P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:54:04.673041 14845 log.cc:1199] T d06f352d0ff34b45b753a2c20f65574f P c9d2944272bc447dafce7620ac2dbd4b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/d06f352d0ff34b45b753a2c20f65574f
I20260807 13:54:04.674121 4505 catalog_manager.cc:5028] TS c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): tablet d06f352d0ff34b45b753a2c20f65574f (table rebalance_test_table_0 [id=14867b014aab43119171102f60bb134d]) successfully deleted
I20260807 13:54:04.679203 14378 raft_consensus.cc:2955] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:04.680721 14810 raft_consensus.cc:2955] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:04.686080 7690 raft_consensus.cc:2955] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:04.687657 4516 catalog_manager.cc:5697] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index 5 to 6, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:04.693415 7521 raft_consensus.cc:2955] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:04.694072 4688 tablet_service.cc:1558] Processing DeleteTablet for tablet 242a68df09cb4c7d9522a33d259ebf78 with delete_type TABLET_DATA_TOMBSTONED (TS fa83b7af134b4e3b949ac3b4e4bcb5e7 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:56314
I20260807 13:54:04.694747 14757 tablet_replica.cc:333] T 242a68df09cb4c7d9522a33d259ebf78 P fa83b7af134b4e3b949ac3b4e4bcb5e7: stopping tablet replica
I20260807 13:54:04.694981 14757 raft_consensus.cc:2243] T 242a68df09cb4c7d9522a33d259ebf78 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:04.695281 14757 raft_consensus.cc:2272] T 242a68df09cb4c7d9522a33d259ebf78 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:04.696106 14757 ts_tablet_manager.cc:1916] T 242a68df09cb4c7d9522a33d259ebf78 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:04.699049 5248 consensus_queue.cc:237] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:54:04.705128 14757 ts_tablet_manager.cc:1929] T 242a68df09cb4c7d9522a33d259ebf78 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260807 13:54:04.705549 14757 log.cc:1199] T 242a68df09cb4c7d9522a33d259ebf78 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/wals/242a68df09cb4c7d9522a33d259ebf78
I20260807 13:54:04.706667 4506 catalog_manager.cc:5028] TS fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): tablet 242a68df09cb4c7d9522a33d259ebf78 (table rebalance_test_table_6 [id=6008038c907645199b055dacb5772621]) successfully deleted
I20260807 13:54:04.710129 7690 raft_consensus.cc:1275] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20260807 13:54:04.710799 5152 consensus_peers.cc:597] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 242a68df09cb4c7d9522a33d259ebf78. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:04.711365 14667 consensus_queue.cc:1048] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:04.721359 4516 catalog_manager.cc:5697] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 reported cstate change: config changed from index 7 to 8, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:04.727129 4688 tablet_service.cc:1558] Processing DeleteTablet for tablet ffa98a163d7540e3a911a39334657138 with delete_type TABLET_DATA_TOMBSTONED (TS fa83b7af134b4e3b949ac3b4e4bcb5e7 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:56314
I20260807 13:54:04.727591 14757 tablet_replica.cc:333] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: stopping tablet replica
I20260807 13:54:04.727856 14757 raft_consensus.cc:2243] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:04.728081 14757 raft_consensus.cc:2272] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:04.729076 14757 ts_tablet_manager.cc:1916] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:04.730319 5072 consensus_queue.cc:237] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:54:04.737427 14725 raft_consensus.cc:2955] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:04.741809 14757 ts_tablet_manager.cc:1929] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.7
I20260807 13:54:04.742059 14757 log.cc:1199] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/wals/ffa98a163d7540e3a911a39334657138
I20260807 13:54:04.742592 7690 raft_consensus.cc:2955] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:04.743029 4506 catalog_manager.cc:5028] TS fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): tablet ffa98a163d7540e3a911a39334657138 (table rebalance_test_table_6 [id=6008038c907645199b055dacb5772621]) successfully deleted
I20260807 13:54:04.749853 4516 catalog_manager.cc:5697] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879 reported cstate change: config changed from index 6 to 7, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:04.751566 4506 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet 242a68df09cb4c7d9522a33d259ebf78 with cas_config_opid_index 6: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
W20260807 13:54:04.756886 4982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.129:32841, user_credentials={real_user=slave}} blocked reactor thread for 44230.3us
I20260807 13:54:04.762666 7521 raft_consensus.cc:1275] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:04.767436 14862 consensus_queue.cc:1048] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260807 13:54:04.771085 4982 consensus_peers.cc:597] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:04.773211 14862 raft_consensus.cc:2955] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:54:04.773887 7521 raft_consensus.cc:2955] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:54:04.778004 4504 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet ffa98a163d7540e3a911a39334657138 with cas_config_opid_index 8: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260807 13:54:04.779924 4515 catalog_manager.cc:5697] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 reported cstate change: config changed from index 8 to 9, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:54:05.268550 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:05.280686 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:05.336614 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:05.373944 15077 ts_tablet_manager.cc:933] T 242a68df09cb4c7d9522a33d259ebf78 P 01adf83af3e04875b5fac9470d4da915: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:54:05.384557 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:05.398308 15077 tablet_copy_client.cc:323] T 242a68df09cb4c7d9522a33d259ebf78 P 01adf83af3e04875b5fac9470d4da915: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:54:05.400698 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet 242a68df09cb4c7d9522a33d259ebf78 from peer 01adf83af3e04875b5fac9470d4da915 ({username='slave'} at 127.23.107.131:56855)
I20260807 13:54:05.400919 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet 242a68df09cb4c7d9522a33d259ebf78 from peer 01adf83af3e04875b5fac9470d4da915 at {username='slave'} at 127.23.107.131:56855: session id = 01adf83af3e04875b5fac9470d4da915-242a68df09cb4c7d9522a33d259ebf78
I20260807 13:54:05.402796 15082 ts_tablet_manager.cc:933] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:54:05.404321 5272 tablet_copy_source_session.cc:215] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:05.413738 15077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242a68df09cb4c7d9522a33d259ebf78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:05.418582 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:05.423712 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:05.431592 15082 tablet_copy_client.cc:323] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:54:05.432603 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet ffa98a163d7540e3a911a39334657138 from peer edf940ebcc1140cfa0c23214e0c0f179 ({username='slave'} at 127.23.107.132:53723)
I20260807 13:54:05.432767 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet ffa98a163d7540e3a911a39334657138 from peer edf940ebcc1140cfa0c23214e0c0f179 at {username='slave'} at 127.23.107.132:53723: session id = edf940ebcc1140cfa0c23214e0c0f179-ffa98a163d7540e3a911a39334657138
I20260807 13:54:05.436017 5101 tablet_copy_source_session.cc:215] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:05.437824 15082 ts_tablet_manager.cc:1916] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:54:05.468357 15082 ts_tablet_manager.cc:1929] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.5
I20260807 13:54:05.469681 15082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa98a163d7540e3a911a39334657138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:05.490643 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:05.521767 15077 tablet_copy_client.cc:806] T 242a68df09cb4c7d9522a33d259ebf78 P 01adf83af3e04875b5fac9470d4da915: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:05.522169 15077 tablet_copy_client.cc:670] T 242a68df09cb4c7d9522a33d259ebf78 P 01adf83af3e04875b5fac9470d4da915: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:05.523448 15082 tablet_copy_client.cc:806] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:05.523978 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:05.530081 15082 tablet_copy_client.cc:670] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:05.537535 15082 tablet_copy_client.cc:538] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:05.576505 15082 tablet_bootstrap.cc:492] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:54:05.577540 15077 tablet_copy_client.cc:538] T 242a68df09cb4c7d9522a33d259ebf78 P 01adf83af3e04875b5fac9470d4da915: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:05.604303 15077 tablet_bootstrap.cc:492] T 242a68df09cb4c7d9522a33d259ebf78 P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:54:05.686311 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:05.713064 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:05.744851 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:05.746851 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:05.760167 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:05.781970 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:05.784220 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:05.816551 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:06.129138 15077 tablet_bootstrap.cc:492] T 242a68df09cb4c7d9522a33d259ebf78 P 01adf83af3e04875b5fac9470d4da915: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:06.129753 15077 tablet_bootstrap.cc:492] T 242a68df09cb4c7d9522a33d259ebf78 P 01adf83af3e04875b5fac9470d4da915: Bootstrap complete.
I20260807 13:54:06.131083 15077 ts_tablet_manager.cc:1403] T 242a68df09cb4c7d9522a33d259ebf78 P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.527s user 0.080s sys 0.029s
I20260807 13:54:06.131933 15077 raft_consensus.cc:359] T 242a68df09cb4c7d9522a33d259ebf78 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:54:06.132144 15077 raft_consensus.cc:740] T 242a68df09cb4c7d9522a33d259ebf78 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:54:06.132370 15077 consensus_queue.cc:260] T 242a68df09cb4c7d9522a33d259ebf78 P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:54:06.133910 15077 ts_tablet_manager.cc:1434] T 242a68df09cb4c7d9522a33d259ebf78 P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260807 13:54:06.136268 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session 01adf83af3e04875b5fac9470d4da915-242a68df09cb4c7d9522a33d259ebf78 received from {username='slave'} at 127.23.107.131:56855
I20260807 13:54:06.136402 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session 01adf83af3e04875b5fac9470d4da915-242a68df09cb4c7d9522a33d259ebf78 on tablet 242a68df09cb4c7d9522a33d259ebf78 with peer 01adf83af3e04875b5fac9470d4da915
I20260807 13:54:06.211642 15082 tablet_bootstrap.cc:492] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:06.212188 15082 tablet_bootstrap.cc:492] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap complete.
I20260807 13:54:06.212493 15082 ts_tablet_manager.cc:1403] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.636s user 0.087s sys 0.037s
I20260807 13:54:06.216277 15082 raft_consensus.cc:359] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:54:06.216477 15082 raft_consensus.cc:740] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:54:06.217612 15082 consensus_queue.cc:260] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:54:06.218693 15082 ts_tablet_manager.cc:1434] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260807 13:54:06.220829 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session edf940ebcc1140cfa0c23214e0c0f179-ffa98a163d7540e3a911a39334657138 received from {username='slave'} at 127.23.107.132:53723
I20260807 13:54:06.221001 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session edf940ebcc1140cfa0c23214e0c0f179-ffa98a163d7540e3a911a39334657138 on tablet ffa98a163d7540e3a911a39334657138 with peer edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:54:06.324640 5248 raft_consensus.cc:1217] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.8->[1.9-1.9] Dedup: 1.9->[]
I20260807 13:54:06.333666 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:06.358398 5072 raft_consensus.cc:1217] T 242a68df09cb4c7d9522a33d259ebf78 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260807 13:54:06.376888 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:06.450970 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
W20260807 13:54:06.543197 4806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.134:35975, user_credentials={real_user=slave}} blocked reactor thread for 57567.8us
I20260807 13:54:06.548877 4896 consensus_queue.cc:237] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:06.566054 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:06.590126 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:06.664151 7690 raft_consensus.cc:1275] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:54:06.666224 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:06.666886 14721 consensus_queue.cc:1048] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:54:06.669546 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:06.670202 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:06.672541 15329 raft_consensus.cc:2955] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:06.677105 7690 raft_consensus.cc:2955] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:06.695142 4516 catalog_manager.cc:5697] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index 5 to 6, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:06.762494 5248 consensus_queue.cc:237] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:06.765009 4892 consensus_queue.cc:237] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:06.767575 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet a29bfc37eabb411f845203c281444086 with delete_type TABLET_DATA_TOMBSTONED (TS edf940ebcc1140cfa0c23214e0c0f179 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:53540
W20260807 13:54:06.767726 4806 consensus_peers.cc:597] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b -> Peer 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): Couldn't send request to peer 8a9903f009ff46b4a6875490823076c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a29bfc37eabb411f845203c281444086. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:06.768684 7690 raft_consensus.cc:1275] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:54:06.769388 14721 consensus_queue.cc:1048] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:06.771914 14721 raft_consensus.cc:2955] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:06.775501 7690 raft_consensus.cc:2955] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:06.779639 4505 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet a29bfc37eabb411f845203c281444086 with cas_config_opid_index 6: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260807 13:54:06.785777 4515 catalog_manager.cc:5697] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 reported cstate change: config changed from index 6 to 7, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:06.796000 15370 tablet_replica.cc:333] T a29bfc37eabb411f845203c281444086 P edf940ebcc1140cfa0c23214e0c0f179: stopping tablet replica
I20260807 13:54:06.797091 15370 raft_consensus.cc:2243] T a29bfc37eabb411f845203c281444086 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:06.797463 15370 raft_consensus.cc:2272] T a29bfc37eabb411f845203c281444086 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:06.797958 7180 raft_consensus.cc:1275] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:54:06.798414 15370 ts_tablet_manager.cc:1916] T a29bfc37eabb411f845203c281444086 P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:06.798645 15173 consensus_queue.cc:1048] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:54:06.805016 15173 raft_consensus.cc:2955] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:06.806800 15370 ts_tablet_manager.cc:1929] T a29bfc37eabb411f845203c281444086 P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260807 13:54:06.806949 15370 log.cc:1199] T a29bfc37eabb411f845203c281444086 P edf940ebcc1140cfa0c23214e0c0f179: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal/wals/a29bfc37eabb411f845203c281444086
I20260807 13:54:06.810751 4506 catalog_manager.cc:5028] TS edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): tablet a29bfc37eabb411f845203c281444086 (table rebalance_test_table_5 [id=b6c061acc30c4e5aa6bee1f054e3a59a]) successfully deleted
I20260807 13:54:06.818032 7180 raft_consensus.cc:2955] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:06.834087 4516 catalog_manager.cc:5697] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:06.845265 4865 tablet_service.cc:1558] Processing DeleteTablet for tablet c10b910e9f354933b60ae70f1baa9b6f with delete_type TABLET_DATA_TOMBSTONED (TS c9d2944272bc447dafce7620ac2dbd4b not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:36624
I20260807 13:54:06.845196 5246 consensus_queue.cc:237] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
W20260807 13:54:06.848444 5154 consensus_peers.cc:597] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c10b910e9f354933b60ae70f1baa9b6f. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:06.852064 7179 raft_consensus.cc:1275] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:54:06.853222 14667 consensus_queue.cc:1048] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:06.858508 15387 tablet_replica.cc:333] T c10b910e9f354933b60ae70f1baa9b6f P c9d2944272bc447dafce7620ac2dbd4b: stopping tablet replica
I20260807 13:54:06.858276 14667 raft_consensus.cc:2955] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:06.860052 15387 raft_consensus.cc:2243] T c10b910e9f354933b60ae70f1baa9b6f P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:06.863628 15387 raft_consensus.cc:2272] T c10b910e9f354933b60ae70f1baa9b6f P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:06.865561 7179 raft_consensus.cc:2955] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:06.868295 15387 ts_tablet_manager.cc:1916] T c10b910e9f354933b60ae70f1baa9b6f P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:06.878552 4515 catalog_manager.cc:5697] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: config changed from index 6 to 7, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:06.889165 4506 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet c10b910e9f354933b60ae70f1baa9b6f with cas_config_opid_index 6: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260807 13:54:06.903231 15387 ts_tablet_manager.cc:1929] T c10b910e9f354933b60ae70f1baa9b6f P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260807 13:54:06.913491 15387 log.cc:1199] T c10b910e9f354933b60ae70f1baa9b6f P c9d2944272bc447dafce7620ac2dbd4b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/c10b910e9f354933b60ae70f1baa9b6f
I20260807 13:54:06.921429 4505 catalog_manager.cc:5028] TS c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): tablet c10b910e9f354933b60ae70f1baa9b6f (table rebalance_test_table_3 [id=c2c7db1795a1414c8299bebbeaf60404]) successfully deleted
I20260807 13:54:07.204890 15470 ts_tablet_manager.cc:933] T a29bfc37eabb411f845203c281444086 P 8a9903f009ff46b4a6875490823076c4: Initiating tablet copy from peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:54:07.211781 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:07.221426 15470 tablet_copy_client.cc:323] T a29bfc37eabb411f845203c281444086 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.130:37489
I20260807 13:54:07.232084 4921 tablet_copy_service.cc:140] P c9d2944272bc447dafce7620ac2dbd4b: Received BeginTabletCopySession request for tablet a29bfc37eabb411f845203c281444086 from peer 8a9903f009ff46b4a6875490823076c4 ({username='slave'} at 127.23.107.135:57651)
I20260807 13:54:07.232280 4921 tablet_copy_service.cc:161] P c9d2944272bc447dafce7620ac2dbd4b: Beginning new tablet copy session on tablet a29bfc37eabb411f845203c281444086 from peer 8a9903f009ff46b4a6875490823076c4 at {username='slave'} at 127.23.107.135:57651: session id = 8a9903f009ff46b4a6875490823076c4-a29bfc37eabb411f845203c281444086
I20260807 13:54:07.236603 4921 tablet_copy_source_session.cc:215] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:07.243624 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:07.250545 15470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a29bfc37eabb411f845203c281444086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:07.265578 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:07.285413 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:07.285457 4865 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:07.294449 15470 tablet_copy_client.cc:806] T a29bfc37eabb411f845203c281444086 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:07.294900 15470 tablet_copy_client.cc:670] T a29bfc37eabb411f845203c281444086 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:07.308806 15470 tablet_copy_client.cc:538] T a29bfc37eabb411f845203c281444086 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:07.313017 15470 tablet_bootstrap.cc:492] T a29bfc37eabb411f845203c281444086 P 8a9903f009ff46b4a6875490823076c4: Bootstrap starting.
I20260807 13:54:07.317356 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:07.333439 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:07.402823 4892 consensus_queue.cc:237] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:07.415675 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:07.464783 7521 raft_consensus.cc:1275] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:54:07.465605 15371 consensus_queue.cc:1048] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:54:07.475474 15505 ts_tablet_manager.cc:933] T c10b910e9f354933b60ae70f1baa9b6f P 12ab71778f2f4b378765aaed1a0676a5: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:54:07.475467 5072 raft_consensus.cc:1275] T bdac11c33b2b486eb34bc93def74489c P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:54:07.476317 15371 consensus_queue.cc:1048] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:54:07.494190 15514 raft_consensus.cc:2955] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:07.495342 7521 raft_consensus.cc:2955] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:07.518569 4516 catalog_manager.cc:5697] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 reported cstate change: config changed from index 4 to 5, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:07.519126 15505 tablet_copy_client.cc:323] T c10b910e9f354933b60ae70f1baa9b6f P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:54:07.519905 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet c10b910e9f354933b60ae70f1baa9b6f from peer 12ab71778f2f4b378765aaed1a0676a5 ({username='slave'} at 127.23.107.134:42065)
I20260807 13:54:07.520076 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet c10b910e9f354933b60ae70f1baa9b6f from peer 12ab71778f2f4b378765aaed1a0676a5 at {username='slave'} at 127.23.107.134:42065: session id = 12ab71778f2f4b378765aaed1a0676a5-c10b910e9f354933b60ae70f1baa9b6f
I20260807 13:54:07.523259 5272 tablet_copy_source_session.cc:215] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:07.525753 15505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c10b910e9f354933b60ae70f1baa9b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:07.543380 15505 tablet_copy_client.cc:806] T c10b910e9f354933b60ae70f1baa9b6f P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:07.543977 15505 tablet_copy_client.cc:670] T c10b910e9f354933b60ae70f1baa9b6f P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:07.548461 15505 tablet_copy_client.cc:538] T c10b910e9f354933b60ae70f1baa9b6f P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:07.555733 15505 tablet_bootstrap.cc:492] T c10b910e9f354933b60ae70f1baa9b6f P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap starting.
I20260807 13:54:07.577097 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet bdac11c33b2b486eb34bc93def74489c with delete_type TABLET_DATA_TOMBSTONED (TS edf940ebcc1140cfa0c23214e0c0f179 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:53540
W20260807 13:54:07.578439 4804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.131:40441, user_credentials={real_user=slave}} blocked reactor thread for 60790.9us
I20260807 13:54:07.581034 15470 tablet_bootstrap.cc:492] T a29bfc37eabb411f845203c281444086 P 8a9903f009ff46b4a6875490823076c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:07.581646 15470 tablet_bootstrap.cc:492] T a29bfc37eabb411f845203c281444086 P 8a9903f009ff46b4a6875490823076c4: Bootstrap complete.
I20260807 13:54:07.582348 15470 ts_tablet_manager.cc:1403] T a29bfc37eabb411f845203c281444086 P 8a9903f009ff46b4a6875490823076c4: Time spent bootstrapping tablet: real 0.269s user 0.059s sys 0.008s
I20260807 13:54:07.583621 15470 raft_consensus.cc:359] T a29bfc37eabb411f845203c281444086 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:07.583981 15470 raft_consensus.cc:740] T a29bfc37eabb411f845203c281444086 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a9903f009ff46b4a6875490823076c4, State: Initialized, Role: FOLLOWER
I20260807 13:54:07.585227 15470 consensus_queue.cc:260] T a29bfc37eabb411f845203c281444086 P 8a9903f009ff46b4a6875490823076c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:07.586743 15470 ts_tablet_manager.cc:1434] T a29bfc37eabb411f845203c281444086 P 8a9903f009ff46b4a6875490823076c4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260807 13:54:07.590739 5072 raft_consensus.cc:2955] T bdac11c33b2b486eb34bc93def74489c P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:07.594805 4921 tablet_copy_service.cc:342] P c9d2944272bc447dafce7620ac2dbd4b: Request end of tablet copy session 8a9903f009ff46b4a6875490823076c4-a29bfc37eabb411f845203c281444086 received from {username='slave'} at 127.23.107.135:57651
I20260807 13:54:07.594980 4921 tablet_copy_service.cc:434] P c9d2944272bc447dafce7620ac2dbd4b: ending tablet copy session 8a9903f009ff46b4a6875490823076c4-a29bfc37eabb411f845203c281444086 on tablet a29bfc37eabb411f845203c281444086 with peer 8a9903f009ff46b4a6875490823076c4
I20260807 13:54:07.600016 15543 tablet_replica.cc:333] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: stopping tablet replica
I20260807 13:54:07.600831 15543 raft_consensus.cc:2243] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:07.601955 15543 raft_consensus.cc:2272] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:07.603138 15543 ts_tablet_manager.cc:1916] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:07.621685 15543 ts_tablet_manager.cc:1929] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:54:07.621831 15543 log.cc:1199] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal/wals/bdac11c33b2b486eb34bc93def74489c
I20260807 13:54:07.622805 4506 catalog_manager.cc:5028] TS edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): tablet bdac11c33b2b486eb34bc93def74489c (table rebalance_test_table_1 [id=7f1d26639edd4cb398339b2b0d3659a3]) successfully deleted
I20260807 13:54:07.704106 15505 tablet_bootstrap.cc:492] T c10b910e9f354933b60ae70f1baa9b6f P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:07.704909 15505 tablet_bootstrap.cc:492] T c10b910e9f354933b60ae70f1baa9b6f P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap complete.
I20260807 13:54:07.705330 15505 ts_tablet_manager.cc:1403] T c10b910e9f354933b60ae70f1baa9b6f P 12ab71778f2f4b378765aaed1a0676a5: Time spent bootstrapping tablet: real 0.150s user 0.086s sys 0.027s
I20260807 13:54:07.706382 15505 raft_consensus.cc:359] T c10b910e9f354933b60ae70f1baa9b6f P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:07.706766 15505 raft_consensus.cc:740] T c10b910e9f354933b60ae70f1baa9b6f P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Initialized, Role: FOLLOWER
I20260807 13:54:07.707144 15505 consensus_queue.cc:260] T c10b910e9f354933b60ae70f1baa9b6f P 12ab71778f2f4b378765aaed1a0676a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:07.708015 15505 ts_tablet_manager.cc:1434] T c10b910e9f354933b60ae70f1baa9b6f P 12ab71778f2f4b378765aaed1a0676a5: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:54:07.709463 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session 12ab71778f2f4b378765aaed1a0676a5-c10b910e9f354933b60ae70f1baa9b6f received from {username='slave'} at 127.23.107.134:42065
I20260807 13:54:07.709594 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session 12ab71778f2f4b378765aaed1a0676a5-c10b910e9f354933b60ae70f1baa9b6f on tablet c10b910e9f354933b60ae70f1baa9b6f with peer 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:54:07.731752 4892 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "069a5f0089b24a609b27d4a07a3c4353"
dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:53068
I20260807 13:54:07.732095 4892 raft_consensus.cc:606] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Received request to transfer leadership
I20260807 13:54:07.767616 7521 raft_consensus.cc:1217] T a29bfc37eabb411f845203c281444086 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260807 13:54:07.776517 15537 raft_consensus.cc:993] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: : Instructing follower 12ab71778f2f4b378765aaed1a0676a5 to start an election
I20260807 13:54:07.776733 15537 raft_consensus.cc:1081] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Signalling peer 12ab71778f2f4b378765aaed1a0676a5 to start an election
I20260807 13:54:07.777828 7354 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "069a5f0089b24a609b27d4a07a3c4353"
dest_uuid: "12ab71778f2f4b378765aaed1a0676a5"
from {username='slave'} at 127.23.107.130:58277
I20260807 13:54:07.778050 7354 raft_consensus.cc:493] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:54:07.778177 7354 raft_consensus.cc:3060] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:54:07.781876 7354 raft_consensus.cc:515] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:07.786549 4717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a5f0089b24a609b27d4a07a3c4353" candidate_uuid: "12ab71778f2f4b378765aaed1a0676a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: true dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
I20260807 13:54:07.786757 4717 raft_consensus.cc:3060] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:54:07.787954 7354 leader_election.cc:290] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 election: Requested vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:54:07.790627 4892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a5f0089b24a609b27d4a07a3c4353" candidate_uuid: "12ab71778f2f4b378765aaed1a0676a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: true dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
I20260807 13:54:07.790855 4892 raft_consensus.cc:3055] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:54:07.790936 4892 raft_consensus.cc:740] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Running, Role: LEADER
I20260807 13:54:07.791278 4892 consensus_queue.cc:260] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:07.791692 4892 raft_consensus.cc:3060] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:54:07.804335 4717 raft_consensus.cc:2468] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12ab71778f2f4b378765aaed1a0676a5 in term 2.
I20260807 13:54:07.805066 7274 leader_election.cc:304] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:54:07.805701 12156 raft_consensus.cc:2804] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:54:07.806360 4892 raft_consensus.cc:2468] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12ab71778f2f4b378765aaed1a0676a5 in term 2.
I20260807 13:54:07.865312 12156 raft_consensus.cc:697] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 LEADER]: Becoming Leader. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Running, Role: LEADER
I20260807 13:54:07.866132 12156 consensus_queue.cc:237] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:07.880527 4519 catalog_manager.cc:5697] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: term changed from 1 to 2, leader changed from c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) to 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134). New cstate: current_term: 2 leader_uuid: "12ab71778f2f4b378765aaed1a0676a5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:07.967188 7354 raft_consensus.cc:1217] T c10b910e9f354933b60ae70f1baa9b6f P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260807 13:54:07.970072 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:07.983417 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:08.015189 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:08.024598 7328 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:08.037458 4865 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:08.039412 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:08.083580 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:08.109328 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:08.130120 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:08.136654 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:08.173489 4865 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:08.191762 7328 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:08.215833 7328 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:08.222221 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:08.226684 4865 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:08.245729 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:08.254567 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:08.258657 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:08.270757 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:08.289098 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:08.298156 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:08.301614 4717 raft_consensus.cc:1275] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20260807 13:54:08.302399 12156 consensus_queue.cc:1048] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:54:08.357785 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:08.379832 4896 raft_consensus.cc:1275] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20260807 13:54:08.386078 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:08.389436 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:08.415169 15740 consensus_queue.cc:1048] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260807 13:54:08.667730 5152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.131:40441, user_credentials={real_user=slave}} blocked reactor thread for 56169.5us
I20260807 13:54:08.832134 5072 consensus_queue.cc:237] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:08.844219 4896 raft_consensus.cc:1275] T 43f5461808a646c885d593f782538930 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:54:08.844403 7687 raft_consensus.cc:1275] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 13:54:08.844935 15228 consensus_queue.cc:1048] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:54:08.845197 15768 consensus_queue.cc:1048] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:54:08.881124 15228 raft_consensus.cc:2955] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:08.886724 4897 raft_consensus.cc:2955] T 43f5461808a646c885d593f782538930 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:08.895524 4511 catalog_manager.cc:5697] T 43f5461808a646c885d593f782538930 P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:08.934842 7687 raft_consensus.cc:2955] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:08.940388 7328 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:08.971940 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:08.997808 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:09.032356 4688 tablet_service.cc:1558] Processing DeleteTablet for tablet 43f5461808a646c885d593f782538930 with delete_type TABLET_DATA_TOMBSTONED (TS fa83b7af134b4e3b949ac3b4e4bcb5e7 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:56314
I20260807 13:54:09.035140 15886 tablet_replica.cc:333] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7: stopping tablet replica
I20260807 13:54:09.035528 15886 raft_consensus.cc:2243] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:09.042147 15886 raft_consensus.cc:2272] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:09.043341 15886 ts_tablet_manager.cc:1916] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:09.087810 4715 consensus_queue.cc:237] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:09.091111 7179 raft_consensus.cc:1275] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:54:09.092780 7353 raft_consensus.cc:1275] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:54:09.093446 15748 consensus_queue.cc:1048] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:09.094029 15748 consensus_queue.cc:1048] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:09.110667 15748 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:09.113785 7179 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:09.122489 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:09.148272 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:09.190062 15886 ts_tablet_manager.cc:1929] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:54:09.193014 4515 catalog_manager.cc:5697] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: config changed from index 6 to 7, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:09.199050 5039 tablet_service.cc:1558] Processing DeleteTablet for tablet 68717842b14e4f06b528c08a65acd3b7 with delete_type TABLET_DATA_TOMBSTONED (TS 01adf83af3e04875b5fac9470d4da915 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:36810
I20260807 13:54:09.199473 15886 log.cc:1199] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/wals/43f5461808a646c885d593f782538930
I20260807 13:54:09.194133 7353 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:09.204210 4506 catalog_manager.cc:5028] TS fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): tablet 43f5461808a646c885d593f782538930 (table rebalance_test_table_4 [id=e242e42da20d4458a49a269a9569307a]) successfully deleted
I20260807 13:54:09.226289 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:09.255097 15924 tablet_replica.cc:333] T 68717842b14e4f06b528c08a65acd3b7 P 01adf83af3e04875b5fac9470d4da915: stopping tablet replica
I20260807 13:54:09.255470 15924 raft_consensus.cc:2243] T 68717842b14e4f06b528c08a65acd3b7 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:09.255769 15924 raft_consensus.cc:2272] T 68717842b14e4f06b528c08a65acd3b7 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:09.257491 15924 ts_tablet_manager.cc:1916] T 68717842b14e4f06b528c08a65acd3b7 P 01adf83af3e04875b5fac9470d4da915: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:09.262580 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:09.265828 4865 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:09.335788 15924 ts_tablet_manager.cc:1929] T 68717842b14e4f06b528c08a65acd3b7 P 01adf83af3e04875b5fac9470d4da915: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20260807 13:54:09.341075 15924 log.cc:1199] T 68717842b14e4f06b528c08a65acd3b7 P 01adf83af3e04875b5fac9470d4da915: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/wals/68717842b14e4f06b528c08a65acd3b7
I20260807 13:54:09.342902 4504 catalog_manager.cc:5028] TS 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): tablet 68717842b14e4f06b528c08a65acd3b7 (table rebalance_test_table_1 [id=7f1d26639edd4cb398339b2b0d3659a3]) successfully deleted
I20260807 13:54:09.506199 7328 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:09.557451 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:09.566773 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:09.589354 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:09.593281 4865 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:09.627959 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:09.630295 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:09.676625 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:09.992445 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:09.995075 7328 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:10.090516 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:10.101667 4865 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:10.107833 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:10.124807 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:10.141377 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:10.198798 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:10.242102 7354 consensus_queue.cc:237] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 2.6, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:10.256440 4715 raft_consensus.cc:1275] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 6. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20260807 13:54:10.257135 15740 consensus_queue.cc:1048] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:10.327409 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:10.349752 16187 raft_consensus.cc:2955] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 LEADER]: Committing config change with OpId 2.7: config changed from index 5 to 7, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:10.352610 4715 raft_consensus.cc:2955] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Committing config change with OpId 2.7: config changed from index 5 to 7, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:10.360699 4515 catalog_manager.cc:5697] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index 5 to 7, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New cstate: current_term: 2 leader_uuid: "12ab71778f2f4b378765aaed1a0676a5" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:10.420127 7328 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:10.462662 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:10.479182 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:10.507923 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:10.524287 4865 tablet_service.cc:1558] Processing DeleteTablet for tablet 069a5f0089b24a609b27d4a07a3c4353 with delete_type TABLET_DATA_TOMBSTONED (TS c9d2944272bc447dafce7620ac2dbd4b not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:36624
I20260807 13:54:10.613907 4866 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
W20260807 13:54:10.658870 5153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.130:37489, user_credentials={real_user=slave}} blocked reactor thread for 144935us
I20260807 13:54:10.663717 16215 tablet_replica.cc:333] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: stopping tablet replica
I20260807 13:54:10.664894 16215 raft_consensus.cc:2243] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:10.665189 16215 raft_consensus.cc:2272] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:10.668053 16215 ts_tablet_manager.cc:1916] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:10.674652 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:10.675315 7354 consensus_queue.cc:237] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 2.7, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:10.677858 4715 raft_consensus.cc:1275] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260807 13:54:10.678556 16187 consensus_queue.cc:1048] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260807 13:54:10.680135 7271 consensus_peers.cc:597] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729): Couldn't send request to peer 31d7630573c8475a9f84978d4ebfb879. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 069a5f0089b24a609b27d4a07a3c4353. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:10.683205 16187 raft_consensus.cc:2955] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 LEADER]: Committing config change with OpId 2.8: config changed from index 7 to 8, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:10.688313 4715 raft_consensus.cc:2955] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Committing config change with OpId 2.8: config changed from index 7 to 8, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:10.693100 4510 catalog_manager.cc:5697] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: config changed from index 7 to 8, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New cstate: current_term: 2 leader_uuid: "12ab71778f2f4b378765aaed1a0676a5" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:10.698940 4506 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet 069a5f0089b24a609b27d4a07a3c4353 with cas_config_opid_index 7: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260807 13:54:10.713364 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:10.804262 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:10.851450 16215 ts_tablet_manager.cc:1929] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.6
I20260807 13:54:10.864133 16215 log.cc:1199] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/069a5f0089b24a609b27d4a07a3c4353
I20260807 13:54:10.868791 7328 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:10.870188 4505 catalog_manager.cc:5028] TS c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): tablet 069a5f0089b24a609b27d4a07a3c4353 (table rebalance_test_table_5 [id=b6c061acc30c4e5aa6bee1f054e3a59a]) successfully deleted
I20260807 13:54:10.910059 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:10.910535 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:10.928242 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:10.957122 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:10.992131 4865 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:11.041548 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:11.164237 4897 consensus_queue.cc:237] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:11.181493 7524 raft_consensus.cc:1275] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:54:11.182755 16009 consensus_queue.cc:1048] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:54:11.207280 16336 raft_consensus.cc:2955] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:11.208709 7524 raft_consensus.cc:2955] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:11.228042 4513 catalog_manager.cc:5697] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index 5 to 6, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:11.277720 16347 ts_tablet_manager.cc:933] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879: Initiating tablet copy from peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975)
I20260807 13:54:11.292640 16347 tablet_copy_client.cc:323] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.134:35975
I20260807 13:54:11.300390 4897 consensus_queue.cc:237] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
W20260807 13:54:11.303459 4806 consensus_peers.cc:597] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bdac11c33b2b486eb34bc93def74489c. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:11.303833 5039 tablet_service.cc:1558] Processing DeleteTablet for tablet bdac11c33b2b486eb34bc93def74489c with delete_type TABLET_DATA_TOMBSTONED (TS 01adf83af3e04875b5fac9470d4da915 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:36810
I20260807 13:54:11.305027 7521 raft_consensus.cc:1275] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:54:11.305859 16336 consensus_queue.cc:1048] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:11.310240 7521 raft_consensus.cc:2955] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:11.309100 16336 raft_consensus.cc:2955] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:11.322450 4505 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet bdac11c33b2b486eb34bc93def74489c with cas_config_opid_index 6: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260807 13:54:11.325592 4511 catalog_manager.cc:5697] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 reported cstate change: config changed from index 6 to 7, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:11.345458 16386 tablet_replica.cc:333] T bdac11c33b2b486eb34bc93def74489c P 01adf83af3e04875b5fac9470d4da915: stopping tablet replica
I20260807 13:54:11.345817 16386 raft_consensus.cc:2243] T bdac11c33b2b486eb34bc93def74489c P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:11.346136 16386 raft_consensus.cc:2272] T bdac11c33b2b486eb34bc93def74489c P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:11.347170 16386 ts_tablet_manager.cc:1916] T bdac11c33b2b486eb34bc93def74489c P 01adf83af3e04875b5fac9470d4da915: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:11.363008 7386 tablet_copy_service.cc:140] P 12ab71778f2f4b378765aaed1a0676a5: Received BeginTabletCopySession request for tablet 069a5f0089b24a609b27d4a07a3c4353 from peer 31d7630573c8475a9f84978d4ebfb879 ({username='slave'} at 127.23.107.136:48879)
I20260807 13:54:11.363206 7386 tablet_copy_service.cc:161] P 12ab71778f2f4b378765aaed1a0676a5: Beginning new tablet copy session on tablet 069a5f0089b24a609b27d4a07a3c4353 from peer 31d7630573c8475a9f84978d4ebfb879 at {username='slave'} at 127.23.107.136:48879: session id = 31d7630573c8475a9f84978d4ebfb879-069a5f0089b24a609b27d4a07a3c4353
I20260807 13:54:11.366997 7386 tablet_copy_source_session.cc:215] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:11.369093 16347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 069a5f0089b24a609b27d4a07a3c4353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:11.377897 16347 tablet_copy_client.cc:806] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:11.378253 16347 tablet_copy_client.cc:670] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:11.381044 16347 tablet_copy_client.cc:538] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:11.385389 16347 tablet_bootstrap.cc:492] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap starting.
I20260807 13:54:11.392913 16386 ts_tablet_manager.cc:1929] T bdac11c33b2b486eb34bc93def74489c P 01adf83af3e04875b5fac9470d4da915: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260807 13:54:11.393060 16386 log.cc:1199] T bdac11c33b2b486eb34bc93def74489c P 01adf83af3e04875b5fac9470d4da915: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/wals/bdac11c33b2b486eb34bc93def74489c
I20260807 13:54:11.394308 4504 catalog_manager.cc:5028] TS 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): tablet bdac11c33b2b486eb34bc93def74489c (table rebalance_test_table_1 [id=7f1d26639edd4cb398339b2b0d3659a3]) successfully deleted
I20260807 13:54:11.568809 16347 tablet_bootstrap.cc:492] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:11.569515 16347 tablet_bootstrap.cc:492] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap complete.
I20260807 13:54:11.569939 16347 ts_tablet_manager.cc:1403] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879: Time spent bootstrapping tablet: real 0.185s user 0.071s sys 0.001s
I20260807 13:54:11.571053 16347 raft_consensus.cc:359] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:11.576773 16347 raft_consensus.cc:740] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d7630573c8475a9f84978d4ebfb879, State: Initialized, Role: FOLLOWER
I20260807 13:54:11.577181 16347 consensus_queue.cc:260] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 2.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:11.583441 16347 ts_tablet_manager.cc:1434] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879: Time spent starting tablet: real 0.013s user 0.002s sys 0.002s
I20260807 13:54:11.589324 7386 tablet_copy_service.cc:342] P 12ab71778f2f4b378765aaed1a0676a5: Request end of tablet copy session 31d7630573c8475a9f84978d4ebfb879-069a5f0089b24a609b27d4a07a3c4353 received from {username='slave'} at 127.23.107.136:48879
I20260807 13:54:11.589584 7386 tablet_copy_service.cc:434] P 12ab71778f2f4b378765aaed1a0676a5: ending tablet copy session 31d7630573c8475a9f84978d4ebfb879-069a5f0089b24a609b27d4a07a3c4353 on tablet 069a5f0089b24a609b27d4a07a3c4353 with peer 31d7630573c8475a9f84978d4ebfb879
I20260807 13:54:11.653949 7687 raft_consensus.cc:1217] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 2.7->[2.8-2.8] Dedup: 2.8->[]
I20260807 13:54:11.719475 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:11.738288 7328 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:11.771781 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:11.814901 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:11.830073 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:11.843086 4865 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:11.893859 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:11.934738 16518 ts_tablet_manager.cc:933] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7: Initiating tablet copy from peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:54:11.939437 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:11.976531 16518 tablet_copy_client.cc:323] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.130:37489
I20260807 13:54:11.977473 4921 tablet_copy_service.cc:140] P c9d2944272bc447dafce7620ac2dbd4b: Received BeginTabletCopySession request for tablet bdac11c33b2b486eb34bc93def74489c from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 ({username='slave'} at 127.23.107.129:37809)
I20260807 13:54:11.977641 4921 tablet_copy_service.cc:161] P c9d2944272bc447dafce7620ac2dbd4b: Beginning new tablet copy session on tablet bdac11c33b2b486eb34bc93def74489c from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 at {username='slave'} at 127.23.107.129:37809: session id = fa83b7af134b4e3b949ac3b4e4bcb5e7-bdac11c33b2b486eb34bc93def74489c
I20260807 13:54:11.985100 4921 tablet_copy_source_session.cc:215] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:11.986970 16518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdac11c33b2b486eb34bc93def74489c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:12.070385 16518 tablet_copy_client.cc:806] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:12.080930 16518 tablet_copy_client.cc:670] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:12.089432 16518 tablet_copy_client.cc:538] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:12.095271 16518 tablet_bootstrap.cc:492] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:54:12.289698 16518 tablet_bootstrap.cc:492] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:12.290380 16518 tablet_bootstrap.cc:492] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap complete.
I20260807 13:54:12.290791 16518 ts_tablet_manager.cc:1403] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.196s user 0.051s sys 0.026s
I20260807 13:54:12.291963 16518 raft_consensus.cc:359] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:12.292280 16518 raft_consensus.cc:740] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:54:12.292621 16518 consensus_queue.cc:260] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:12.296929 16518 ts_tablet_manager.cc:1434] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260807 13:54:12.298650 4921 tablet_copy_service.cc:342] P c9d2944272bc447dafce7620ac2dbd4b: Request end of tablet copy session fa83b7af134b4e3b949ac3b4e4bcb5e7-bdac11c33b2b486eb34bc93def74489c received from {username='slave'} at 127.23.107.129:37809
I20260807 13:54:12.298790 4921 tablet_copy_service.cc:434] P c9d2944272bc447dafce7620ac2dbd4b: ending tablet copy session fa83b7af134b4e3b949ac3b4e4bcb5e7-bdac11c33b2b486eb34bc93def74489c on tablet bdac11c33b2b486eb34bc93def74489c with peer fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:54:12.321449 4715 raft_consensus.cc:1217] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260807 13:54:12.395514 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:12.489509 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:12.500574 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:12.525995 4865 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:12.535254 4865 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:12.542831 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:12.545004 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:12.552080 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:12.560467 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:12.579317 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:12.631316 4865 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:12.648722 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:12.675279 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:12.692312 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:12.693622 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:12.699347 7326 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:12.699637 7328 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:12.699368 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:12.722460 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:12.737973 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:12.765075 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:12.811003 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:12.827332 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:54:12.902467 4982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.134:35975, user_credentials={real_user=slave}} blocked reactor thread for 206724us
W20260807 13:54:12.918002 4805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.133:38075, user_credentials={real_user=slave}} blocked reactor thread for 46922.4us
I20260807 13:54:13.038331 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:13.208886 4715 consensus_queue.cc:237] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:13.216559 7354 raft_consensus.cc:1275] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:54:13.217514 16627 consensus_queue.cc:1048] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:54:13.285674 16757 raft_consensus.cc:2955] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:13.286819 7353 raft_consensus.cc:2955] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:13.294384 4515 catalog_manager.cc:5697] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: config changed from index 5 to 6, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:13.391579 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet d06f352d0ff34b45b753a2c20f65574f with delete_type TABLET_DATA_TOMBSTONED (TS edf940ebcc1140cfa0c23214e0c0f179 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:53540
I20260807 13:54:13.393728 4715 consensus_queue.cc:237] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:13.396217 7353 raft_consensus.cc:1275] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:54:13.396888 16757 consensus_queue.cc:1048] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:13.402092 16757 raft_consensus.cc:2955] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:13.406073 7353 raft_consensus.cc:2955] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:13.410684 4506 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet d06f352d0ff34b45b753a2c20f65574f with cas_config_opid_index 6: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260807 13:54:13.413475 4513 catalog_manager.cc:5697] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index 6 to 7, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:13.419123 16806 tablet_replica.cc:333] T d06f352d0ff34b45b753a2c20f65574f P edf940ebcc1140cfa0c23214e0c0f179: stopping tablet replica
I20260807 13:54:13.419341 16806 raft_consensus.cc:2243] T d06f352d0ff34b45b753a2c20f65574f P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:13.419591 16806 raft_consensus.cc:2272] T d06f352d0ff34b45b753a2c20f65574f P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:13.420414 16806 ts_tablet_manager.cc:1916] T d06f352d0ff34b45b753a2c20f65574f P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260807 13:54:13.432094 4631 consensus_peers.cc:597] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): Couldn't send request to peer b77f2b2eade540c6bfd4f75e5229a3cd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d06f352d0ff34b45b753a2c20f65574f. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:13.441520 16806 ts_tablet_manager.cc:1929] T d06f352d0ff34b45b753a2c20f65574f P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260807 13:54:13.441751 16806 log.cc:1199] T d06f352d0ff34b45b753a2c20f65574f P edf940ebcc1140cfa0c23214e0c0f179: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal/wals/d06f352d0ff34b45b753a2c20f65574f
I20260807 13:54:13.442742 4506 catalog_manager.cc:5028] TS edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): tablet d06f352d0ff34b45b753a2c20f65574f (table rebalance_test_table_0 [id=14867b014aab43119171102f60bb134d]) successfully deleted
I20260807 13:54:13.471885 5248 consensus_queue.cc:237] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:13.492905 7521 raft_consensus.cc:1275] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:54:13.495291 16586 consensus_queue.cc:1048] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:54:13.500757 5068 consensus_queue.cc:237] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:13.511116 16853 raft_consensus.cc:2955] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:13.512290 7521 raft_consensus.cc:2955] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:13.520744 7687 raft_consensus.cc:1275] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:54:13.521874 16703 consensus_queue.cc:1048] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:54:13.524178 4516 catalog_manager.cc:5697] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:13.539543 4865 tablet_service.cc:1558] Processing DeleteTablet for tablet 1715828a5d96455abecae985d1dca004 with delete_type TABLET_DATA_TOMBSTONED (TS c9d2944272bc447dafce7620ac2dbd4b not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:36624
I20260807 13:54:13.543735 5248 consensus_queue.cc:237] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
W20260807 13:54:13.547508 5153 consensus_peers.cc:597] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 -> Peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): Couldn't send request to peer b77f2b2eade540c6bfd4f75e5229a3cd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1715828a5d96455abecae985d1dca004. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:13.549045 16703 raft_consensus.cc:2955] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:13.552268 7690 raft_consensus.cc:2955] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:13.559504 7521 raft_consensus.cc:1275] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:54:13.563964 16853 consensus_queue.cc:1048] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:13.566771 16853 raft_consensus.cc:2955] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:13.569767 4516 catalog_manager.cc:5697] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:13.572434 7524 raft_consensus.cc:2955] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:13.575430 4865 tablet_service.cc:1558] Processing DeleteTablet for tablet 43f5461808a646c885d593f782538930 with delete_type TABLET_DATA_TOMBSTONED (TS c9d2944272bc447dafce7620ac2dbd4b not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:36624
I20260807 13:54:13.577939 5068 consensus_queue.cc:237] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
W20260807 13:54:13.580848 4982 consensus_peers.cc:597] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 -> Peer 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): Couldn't send request to peer 8a9903f009ff46b4a6875490823076c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 43f5461808a646c885d593f782538930. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:13.583634 4506 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet 1715828a5d96455abecae985d1dca004 with cas_config_opid_index 6: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260807 13:54:13.585924 4513 catalog_manager.cc:5697] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index 6 to 7, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:13.595517 16864 tablet_replica.cc:333] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b: stopping tablet replica
I20260807 13:54:13.596180 16864 raft_consensus.cc:2243] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:13.596542 16864 raft_consensus.cc:2272] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:13.597565 16864 ts_tablet_manager.cc:1916] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:13.609166 7687 raft_consensus.cc:1275] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:54:13.612162 16713 consensus_queue.cc:1048] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:13.618615 16713 raft_consensus.cc:2955] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:13.625254 7690 raft_consensus.cc:2955] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:13.639034 4516 catalog_manager.cc:5697] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879 reported cstate change: config changed from index 6 to 7, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:13.645208 4504 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet 43f5461808a646c885d593f782538930 with cas_config_opid_index 6: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260807 13:54:13.683511 4715 consensus_queue.cc:237] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:13.694054 16864 ts_tablet_manager.cc:1929] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260807 13:54:13.694638 7179 raft_consensus.cc:1275] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:54:13.695426 16864 log.cc:1199] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/1715828a5d96455abecae985d1dca004
I20260807 13:54:13.695616 16757 consensus_queue.cc:1048] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:54:13.696336 4505 catalog_manager.cc:5028] TS c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): tablet 1715828a5d96455abecae985d1dca004 (table rebalance_test_table_2 [id=35d13981f3a742dd9369d1e7bf18498c]) successfully deleted
I20260807 13:54:13.697588 16864 tablet_replica.cc:333] T 43f5461808a646c885d593f782538930 P c9d2944272bc447dafce7620ac2dbd4b: stopping tablet replica
I20260807 13:54:13.697806 16864 raft_consensus.cc:2243] T 43f5461808a646c885d593f782538930 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:13.698020 16864 raft_consensus.cc:2272] T 43f5461808a646c885d593f782538930 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:13.698833 16864 ts_tablet_manager.cc:1916] T 43f5461808a646c885d593f782538930 P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:13.710913 16757 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:13.714385 7180 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:13.726933 4516 catalog_manager.cc:5697] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:13.737466 4865 tablet_service.cc:1558] Processing DeleteTablet for tablet 966ebd287fc14e498e5bd3e6542194ca with delete_type TABLET_DATA_TOMBSTONED (TS c9d2944272bc447dafce7620ac2dbd4b not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:36624
I20260807 13:54:13.745684 4715 consensus_queue.cc:237] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
W20260807 13:54:13.749095 4630 consensus_peers.cc:597] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 966ebd287fc14e498e5bd3e6542194ca. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:13.749869 7180 raft_consensus.cc:1275] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:54:13.750497 16757 consensus_queue.cc:1048] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:13.753558 16773 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:13.759773 4506 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet 966ebd287fc14e498e5bd3e6542194ca with cas_config_opid_index 6: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260807 13:54:13.760363 7180 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:13.762063 4513 catalog_manager.cc:5697] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index 6 to 7, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) added. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:13.774197 16864 ts_tablet_manager.cc:1929] T 43f5461808a646c885d593f782538930 P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260807 13:54:13.775466 16864 log.cc:1199] T 43f5461808a646c885d593f782538930 P c9d2944272bc447dafce7620ac2dbd4b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/43f5461808a646c885d593f782538930
I20260807 13:54:13.782924 4505 catalog_manager.cc:5028] TS c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): tablet 43f5461808a646c885d593f782538930 (table rebalance_test_table_4 [id=e242e42da20d4458a49a269a9569307a]) successfully deleted
I20260807 13:54:13.784868 16864 tablet_replica.cc:333] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: stopping tablet replica
I20260807 13:54:13.785816 16864 raft_consensus.cc:2243] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:13.786723 16864 raft_consensus.cc:2272] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:13.788172 16864 ts_tablet_manager.cc:1916] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:13.811882 16864 ts_tablet_manager.cc:1929] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260807 13:54:13.815444 16864 log.cc:1199] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/966ebd287fc14e498e5bd3e6542194ca
I20260807 13:54:13.816570 4505 catalog_manager.cc:5028] TS c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): tablet 966ebd287fc14e498e5bd3e6542194ca (table rebalance_test_table_6 [id=6008038c907645199b055dacb5772621]) successfully deleted
I20260807 13:54:13.974924 17007 ts_tablet_manager.cc:933] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:54:13.983884 17007 tablet_copy_client.cc:323] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:54:13.984854 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet 1715828a5d96455abecae985d1dca004 from peer b77f2b2eade540c6bfd4f75e5229a3cd ({username='slave'} at 127.23.107.133:38087)
I20260807 13:54:13.985049 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet 1715828a5d96455abecae985d1dca004 from peer b77f2b2eade540c6bfd4f75e5229a3cd at {username='slave'} at 127.23.107.133:38087: session id = b77f2b2eade540c6bfd4f75e5229a3cd-1715828a5d96455abecae985d1dca004
I20260807 13:54:13.988056 17024 ts_tablet_manager.cc:933] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:54:13.993141 5272 tablet_copy_source_session.cc:215] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:14.010171 17007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1715828a5d96455abecae985d1dca004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:14.023240 17027 ts_tablet_manager.cc:933] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:54:14.033210 17024 tablet_copy_client.cc:323] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:54:14.034220 17007 tablet_copy_client.cc:806] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:14.035032 4748 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet d06f352d0ff34b45b753a2c20f65574f from peer b77f2b2eade540c6bfd4f75e5229a3cd ({username='slave'} at 127.23.107.133:40143)
I20260807 13:54:14.035239 4748 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet d06f352d0ff34b45b753a2c20f65574f from peer b77f2b2eade540c6bfd4f75e5229a3cd at {username='slave'} at 127.23.107.133:40143: session id = b77f2b2eade540c6bfd4f75e5229a3cd-d06f352d0ff34b45b753a2c20f65574f
I20260807 13:54:14.039721 4748 tablet_copy_source_session.cc:215] T d06f352d0ff34b45b753a2c20f65574f P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:14.041999 17007 tablet_copy_client.cc:670] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:14.042028 17024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06f352d0ff34b45b753a2c20f65574f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:14.046072 17007 tablet_copy_client.cc:538] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:14.056676 17027 tablet_copy_client.cc:323] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:54:14.057626 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet 43f5461808a646c885d593f782538930 from peer 8a9903f009ff46b4a6875490823076c4 ({username='slave'} at 127.23.107.135:53271)
I20260807 13:54:14.057830 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet 43f5461808a646c885d593f782538930 from peer 8a9903f009ff46b4a6875490823076c4 at {username='slave'} at 127.23.107.135:53271: session id = 8a9903f009ff46b4a6875490823076c4-43f5461808a646c885d593f782538930
I20260807 13:54:14.058662 17007 tablet_bootstrap.cc:492] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap starting.
I20260807 13:54:14.062372 5101 tablet_copy_source_session.cc:215] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:14.063958 17027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f5461808a646c885d593f782538930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:14.070005 17024 tablet_copy_client.cc:806] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:14.070320 17024 tablet_copy_client.cc:670] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:14.081404 17024 tablet_copy_client.cc:538] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:14.119617 17024 tablet_bootstrap.cc:492] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap starting.
I20260807 13:54:14.138290 17027 tablet_copy_client.cc:806] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:14.138567 17027 tablet_copy_client.cc:670] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:14.148782 17027 tablet_copy_client.cc:538] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:14.163048 17027 tablet_bootstrap.cc:492] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4: Bootstrap starting.
I20260807 13:54:14.200322 17078 ts_tablet_manager.cc:933] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:54:14.205263 17078 tablet_copy_client.cc:323] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:54:14.206718 4748 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet 966ebd287fc14e498e5bd3e6542194ca from peer 01adf83af3e04875b5fac9470d4da915 ({username='slave'} at 127.23.107.131:50563)
I20260807 13:54:14.206967 4748 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet 966ebd287fc14e498e5bd3e6542194ca from peer 01adf83af3e04875b5fac9470d4da915 at {username='slave'} at 127.23.107.131:50563: session id = 01adf83af3e04875b5fac9470d4da915-966ebd287fc14e498e5bd3e6542194ca
I20260807 13:54:14.216543 4748 tablet_copy_source_session.cc:215] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:14.230458 17078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 966ebd287fc14e498e5bd3e6542194ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:14.294000 17024 tablet_bootstrap.cc:492] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:14.294499 17024 tablet_bootstrap.cc:492] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap complete.
I20260807 13:54:14.294837 17024 ts_tablet_manager.cc:1403] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent bootstrapping tablet: real 0.175s user 0.085s sys 0.067s
I20260807 13:54:14.295717 17024 raft_consensus.cc:359] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:14.295955 17024 raft_consensus.cc:740] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77f2b2eade540c6bfd4f75e5229a3cd, State: Initialized, Role: FOLLOWER
I20260807 13:54:14.296242 17024 consensus_queue.cc:260] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:14.306363 17078 tablet_copy_client.cc:806] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:14.307003 17078 tablet_copy_client.cc:670] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:14.314658 17078 tablet_copy_client.cc:538] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:14.343559 17078 tablet_bootstrap.cc:492] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:54:14.392463 17024 ts_tablet_manager.cc:1434] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent starting tablet: real 0.097s user 0.023s sys 0.041s
I20260807 13:54:14.393409 4748 tablet_copy_service.cc:342] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Request end of tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-d06f352d0ff34b45b753a2c20f65574f received from {username='slave'} at 127.23.107.133:40143
I20260807 13:54:14.393625 4748 tablet_copy_service.cc:434] P fa83b7af134b4e3b949ac3b4e4bcb5e7: ending tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-d06f352d0ff34b45b753a2c20f65574f on tablet d06f352d0ff34b45b753a2c20f65574f with peer b77f2b2eade540c6bfd4f75e5229a3cd
I20260807 13:54:14.401299 17007 tablet_bootstrap.cc:492] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:14.401908 17007 tablet_bootstrap.cc:492] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap complete.
I20260807 13:54:14.402276 17007 ts_tablet_manager.cc:1403] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent bootstrapping tablet: real 0.344s user 0.069s sys 0.019s
I20260807 13:54:14.403251 17007 raft_consensus.cc:359] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:14.406121 17007 raft_consensus.cc:740] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77f2b2eade540c6bfd4f75e5229a3cd, State: Initialized, Role: FOLLOWER
I20260807 13:54:14.407522 17007 consensus_queue.cc:260] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:14.411854 17007 ts_tablet_manager.cc:1434] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260807 13:54:14.415238 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-1715828a5d96455abecae985d1dca004 received from {username='slave'} at 127.23.107.133:38087
I20260807 13:54:14.415406 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-1715828a5d96455abecae985d1dca004 on tablet 1715828a5d96455abecae985d1dca004 with peer b77f2b2eade540c6bfd4f75e5229a3cd
I20260807 13:54:14.427802 7180 raft_consensus.cc:1217] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260807 13:54:14.480640 7180 raft_consensus.cc:1217] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260807 13:54:14.616057 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:14.626987 17027 tablet_bootstrap.cc:492] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:14.627455 17027 tablet_bootstrap.cc:492] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4: Bootstrap complete.
I20260807 13:54:14.627621 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:14.627718 17027 ts_tablet_manager.cc:1403] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4: Time spent bootstrapping tablet: real 0.466s user 0.073s sys 0.000s
I20260807 13:54:14.628521 17027 raft_consensus.cc:359] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:14.628729 17027 raft_consensus.cc:740] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a9903f009ff46b4a6875490823076c4, State: Initialized, Role: FOLLOWER
I20260807 13:54:14.629634 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:14.636338 17027 consensus_queue.cc:260] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:14.643529 4865 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:14.648553 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:14.650727 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:14.679383 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:14.689055 17027 ts_tablet_manager.cc:1434] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4: Time spent starting tablet: real 0.060s user 0.004s sys 0.000s
I20260807 13:54:14.690393 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session 8a9903f009ff46b4a6875490823076c4-43f5461808a646c885d593f782538930 received from {username='slave'} at 127.23.107.135:53271
I20260807 13:54:14.690577 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session 8a9903f009ff46b4a6875490823076c4-43f5461808a646c885d593f782538930 on tablet 43f5461808a646c885d593f782538930 with peer 8a9903f009ff46b4a6875490823076c4
I20260807 13:54:14.701924 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:14.716375 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:14.743350 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:14.750928 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:14.770622 4865 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:14.774276 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:14.774822 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:14.788600 17078 tablet_bootstrap.cc:492] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:14.789093 17078 tablet_bootstrap.cc:492] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915: Bootstrap complete.
I20260807 13:54:14.789417 17078 ts_tablet_manager.cc:1403] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.446s user 0.063s sys 0.005s
I20260807 13:54:14.805328 17078 raft_consensus.cc:359] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:54:14.813087 17078 raft_consensus.cc:740] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:54:14.813727 17078 consensus_queue.cc:260] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:54:14.834213 17078 ts_tablet_manager.cc:1434] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.045s user 0.002s sys 0.000s
I20260807 13:54:14.837934 4748 tablet_copy_service.cc:342] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Request end of tablet copy session 01adf83af3e04875b5fac9470d4da915-966ebd287fc14e498e5bd3e6542194ca received from {username='slave'} at 127.23.107.131:50563
I20260807 13:54:14.838085 4748 tablet_copy_service.cc:434] P fa83b7af134b4e3b949ac3b4e4bcb5e7: ending tablet copy session 01adf83af3e04875b5fac9470d4da915-966ebd287fc14e498e5bd3e6542194ca on tablet 966ebd287fc14e498e5bd3e6542194ca with peer 01adf83af3e04875b5fac9470d4da915
I20260807 13:54:14.876965 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:14.911829 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:15.014467 7524 raft_consensus.cc:1217] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260807 13:54:15.166246 5068 raft_consensus.cc:1217] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260807 13:54:15.190311 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:15.215659 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:15.240579 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:15.253188 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:15.264765 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:15.296828 4865 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:15.374374 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:15.383776 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:15.444767 5039 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:15.454281 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:15.480654 7669 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:15.516551 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:15.542758 7158 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:15.572052 4865 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:15.597802 5214 tablet_service.cc:1467] Tablet server has 9 leaders and 0 scanners
I20260807 13:54:15.602542 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:15.758697 5068 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04dac80fea124c25b34af8cc290c0d7f"
dest_uuid: "01adf83af3e04875b5fac9470d4da915"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:59618
I20260807 13:54:15.759040 5068 raft_consensus.cc:606] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [term 2 LEADER]: Received request to transfer leadership
I20260807 13:54:15.809544 5068 consensus_queue.cc:237] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:15.827107 7524 raft_consensus.cc:1275] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260807 13:54:15.827970 16713 consensus_queue.cc:1048] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:15.839850 16713 raft_consensus.cc:2955] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:15.844246 7522 raft_consensus.cc:2955] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:15.853114 4513 catalog_manager.cc:5697] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 9 to 10, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:15.888242 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet ffa98a163d7540e3a911a39334657138 with delete_type TABLET_DATA_TOMBSTONED (TS edf940ebcc1140cfa0c23214e0c0f179 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:53540
I20260807 13:54:15.898388 5068 consensus_queue.cc:237] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
W20260807 13:54:15.907047 4982 consensus_peers.cc:597] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:15.910029 17414 tablet_replica.cc:333] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179: stopping tablet replica
I20260807 13:54:15.910566 17414 raft_consensus.cc:2243] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:15.911001 17414 raft_consensus.cc:2272] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:15.911980 17414 ts_tablet_manager.cc:1916] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:15.926628 16713 raft_consensus.cc:993] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915: : Instructing follower b77f2b2eade540c6bfd4f75e5229a3cd to start an election
I20260807 13:54:15.926909 16713 raft_consensus.cc:1081] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [term 2 LEADER]: Signalling peer b77f2b2eade540c6bfd4f75e5229a3cd to start an election
I20260807 13:54:15.928309 7180 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04dac80fea124c25b34af8cc290c0d7f"
dest_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd"
from {username='slave'} at 127.23.107.131:46299
I20260807 13:54:15.928720 7180 raft_consensus.cc:493] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:54:15.928951 7180 raft_consensus.cc:3060] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:54:15.932909 17414 ts_tablet_manager.cc:1929] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20260807 13:54:15.933022 7180 raft_consensus.cc:515] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:15.938062 7524 raft_consensus.cc:1275] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260807 13:54:15.939317 16713 consensus_queue.cc:1048] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:54:15.942790 17416 raft_consensus.cc:2955] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:15.943470 7524 raft_consensus.cc:2955] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:15.950614 17414 log.cc:1199] T ffa98a163d7540e3a911a39334657138 P edf940ebcc1140cfa0c23214e0c0f179: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal/wals/ffa98a163d7540e3a911a39334657138
I20260807 13:54:15.951958 4506 catalog_manager.cc:5028] TS edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): tablet ffa98a163d7540e3a911a39334657138 (table rebalance_test_table_6 [id=6008038c907645199b055dacb5772621]) successfully deleted
I20260807 13:54:15.955497 4504 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet ffa98a163d7540e3a911a39334657138 with cas_config_opid_index 10: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260807 13:54:15.957634 4513 catalog_manager.cc:5697] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 reported cstate change: config changed from index 10 to 11, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:15.983213 7180 leader_election.cc:290] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 3 election: Requested vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:54:15.985759 4715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04dac80fea124c25b34af8cc290c0d7f" candidate_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 8 } } ignore_live_leader: true dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
I20260807 13:54:15.986038 4715 raft_consensus.cc:3060] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:54:15.995054 4715 raft_consensus.cc:2468] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77f2b2eade540c6bfd4f75e5229a3cd in term 3.
I20260807 13:54:15.995321 4717 raft_consensus.cc:1240] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 3 FOLLOWER]: Rejecting Update request from peer 01adf83af3e04875b5fac9470d4da915 for earlier term 2. Current term is 3. Ops: []
I20260807 13:54:15.995916 7102 leader_election.cc:304] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b77f2b2eade540c6bfd4f75e5229a3cd, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:54:15.997051 17419 consensus_queue.cc:1059] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: INVALID_TERM, Last received: 2.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:15.997485 17407 raft_consensus.cc:3055] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:54:15.997597 17407 raft_consensus.cc:740] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Running, Role: LEADER
I20260807 13:54:15.997943 17407 consensus_queue.cc:260] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 2.8, Last appended by leader: 8, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:15.998469 17407 raft_consensus.cc:3060] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:54:16.048617 17431 raft_consensus.cc:2804] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [term 3 FOLLOWER]: Leader election won for term 3
W20260807 13:54:16.048496 7102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.107.129:32841, user_credentials={real_user=slave}} blocked reactor thread for 52670.8us
I20260807 13:54:16.061259 17431 raft_consensus.cc:697] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [term 3 LEADER]: Becoming Leader. State: Replica: b77f2b2eade540c6bfd4f75e5229a3cd, State: Running, Role: LEADER
I20260807 13:54:16.073997 17431 consensus_queue.cc:237] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 2.8, Last appended by leader: 8, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:16.104234 5248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b414c896ad884facb339e5e4a0329065"
dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:53818
I20260807 13:54:16.104651 5248 raft_consensus.cc:606] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Received request to transfer leadership
I20260807 13:54:16.109792 5068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04dac80fea124c25b34af8cc290c0d7f" candidate_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 8 } } ignore_live_leader: true dest_uuid: "01adf83af3e04875b5fac9470d4da915"
I20260807 13:54:16.115013 5068 raft_consensus.cc:2468] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77f2b2eade540c6bfd4f75e5229a3cd in term 3.
I20260807 13:54:16.130458 17415 raft_consensus.cc:993] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179: : Instructing follower 31d7630573c8475a9f84978d4ebfb879 to start an election
I20260807 13:54:16.130661 17415 raft_consensus.cc:1081] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Signalling peer 31d7630573c8475a9f84978d4ebfb879 to start an election
I20260807 13:54:16.131770 7690 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b414c896ad884facb339e5e4a0329065"
dest_uuid: "31d7630573c8475a9f84978d4ebfb879"
from {username='slave'} at 127.23.107.132:49667
I20260807 13:54:16.132143 7690 raft_consensus.cc:493] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:54:16.132300 7690 raft_consensus.cc:3060] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:54:16.137136 4516 catalog_manager.cc:5697] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: term changed from 2 to 3, leader changed from 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) to b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133). New cstate: current_term: 3 leader_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:16.143195 7690 raft_consensus.cc:515] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:16.145865 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b414c896ad884facb339e5e4a0329065" candidate_uuid: "31d7630573c8475a9f84978d4ebfb879" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: true dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179"
I20260807 13:54:16.146099 5248 raft_consensus.cc:3055] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:54:16.146211 5248 raft_consensus.cc:740] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Running, Role: LEADER
I20260807 13:54:16.146656 7690 leader_election.cc:290] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 election: Requested vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:54:16.146561 5248 consensus_queue.cc:260] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:16.147017 5248 raft_consensus.cc:3060] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:54:16.147440 5068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b414c896ad884facb339e5e4a0329065" candidate_uuid: "31d7630573c8475a9f84978d4ebfb879" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: true dest_uuid: "01adf83af3e04875b5fac9470d4da915"
I20260807 13:54:16.147719 5068 raft_consensus.cc:3060] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:54:16.152607 5068 raft_consensus.cc:2468] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31d7630573c8475a9f84978d4ebfb879 in term 2.
I20260807 13:54:16.152705 5248 raft_consensus.cc:2468] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31d7630573c8475a9f84978d4ebfb879 in term 2.
I20260807 13:54:16.153530 7613 leader_election.cc:304] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31d7630573c8475a9f84978d4ebfb879, edf940ebcc1140cfa0c23214e0c0f179; no voters:
I20260807 13:54:16.189754 17470 raft_consensus.cc:2804] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:54:16.204952 17470 raft_consensus.cc:697] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [term 2 LEADER]: Becoming Leader. State: Replica: 31d7630573c8475a9f84978d4ebfb879, State: Running, Role: LEADER
I20260807 13:54:16.209136 17470 consensus_queue.cc:237] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:16.264724 4516 catalog_manager.cc:5697] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 reported cstate change: term changed from 1 to 2, leader changed from edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) to 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136). New cstate: current_term: 2 leader_uuid: "31d7630573c8475a9f84978d4ebfb879" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
W20260807 13:54:16.338109 4806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.129:32841, user_credentials={real_user=slave}} blocked reactor thread for 50642.7us
I20260807 13:54:16.398049 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:16.416667 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:16.453167 17536 ts_tablet_manager.cc:933] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:54:16.479313 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:16.493511 7669 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:16.525640 4865 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:16.536614 5068 raft_consensus.cc:1275] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [term 3 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 3 index: 9. (index mismatch)
I20260807 13:54:16.540205 17431 consensus_queue.cc:1048] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:16.595613 4892 consensus_queue.cc:237] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:16.615170 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:16.630125 4715 raft_consensus.cc:1275] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 3 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 3 index: 9. (index mismatch)
I20260807 13:54:16.631029 17431 consensus_queue.cc:1048] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:16.644770 17536 tablet_copy_client.cc:323] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:54:16.645519 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet ffa98a163d7540e3a911a39334657138 from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 ({username='slave'} at 127.23.107.129:37907)
I20260807 13:54:16.645669 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet ffa98a163d7540e3a911a39334657138 from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 at {username='slave'} at 127.23.107.129:37907: session id = fa83b7af134b4e3b949ac3b4e4bcb5e7-ffa98a163d7540e3a911a39334657138
I20260807 13:54:16.648711 5101 tablet_copy_source_session.cc:215] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:16.651183 17536 ts_tablet_manager.cc:1916] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:54:16.663489 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:16.665171 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:16.667838 17536 ts_tablet_manager.cc:1929] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.7
I20260807 13:54:16.668123 17536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa98a163d7540e3a911a39334657138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:16.678674 17536 tablet_copy_client.cc:806] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:16.678942 17536 tablet_copy_client.cc:670] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:16.682389 17536 tablet_copy_client.cc:538] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:16.687518 17536 tablet_bootstrap.cc:492] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
W20260807 13:54:16.711376 7102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.129:32841, user_credentials={real_user=slave}} blocked reactor thread for 80559.2us
I20260807 13:54:16.712209 5246 raft_consensus.cc:1275] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Refusing update from remote peer 31d7630573c8475a9f84978d4ebfb879: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20260807 13:54:16.713058 17470 consensus_queue.cc:1048] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:54:16.719445 7179 raft_consensus.cc:1275] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:54:16.721285 16336 consensus_queue.cc:1048] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:54:16.745091 16336 raft_consensus.cc:2955] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:16.762362 7179 raft_consensus.cc:2955] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:16.768556 4515 catalog_manager.cc:5697] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index 5 to 6, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:16.776448 5068 raft_consensus.cc:1275] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Refusing update from remote peer 31d7630573c8475a9f84978d4ebfb879: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20260807 13:54:16.777889 17470 consensus_queue.cc:1048] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:54:16.810971 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:16.824783 7669 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:16.853539 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:16.873878 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:16.876732 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 312c7ed04e334b08b506c8908224a7da with delete_type TABLET_DATA_TOMBSTONED (TS edf940ebcc1140cfa0c23214e0c0f179 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:53540
I20260807 13:54:16.879932 4892 consensus_queue.cc:237] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
W20260807 13:54:16.885914 4806 consensus_peers.cc:597] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 312c7ed04e334b08b506c8908224a7da. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:16.897980 7179 raft_consensus.cc:1275] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:54:16.898948 17496 consensus_queue.cc:1048] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:16.902143 16336 raft_consensus.cc:2955] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:16.903064 4865 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:16.908854 7178 raft_consensus.cc:2955] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:16.913014 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:16.916496 4505 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet 312c7ed04e334b08b506c8908224a7da with cas_config_opid_index 6: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260807 13:54:16.920935 4515 catalog_manager.cc:5697] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: config changed from index 6 to 7, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:16.928416 17636 tablet_replica.cc:333] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179: stopping tablet replica
I20260807 13:54:16.931424 17636 raft_consensus.cc:2243] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:16.937477 17636 raft_consensus.cc:2272] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:16.943357 17636 ts_tablet_manager.cc:1916] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:16.958961 17636 ts_tablet_manager.cc:1929] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260807 13:54:16.959273 17636 log.cc:1199] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal/wals/312c7ed04e334b08b506c8908224a7da
I20260807 13:54:16.962260 4506 catalog_manager.cc:5028] TS edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): tablet 312c7ed04e334b08b506c8908224a7da (table rebalance_test_table_5 [id=b6c061acc30c4e5aa6bee1f054e3a59a]) successfully deleted
I20260807 13:54:16.965929 17536 tablet_bootstrap.cc:492] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:16.966566 17536 tablet_bootstrap.cc:492] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap complete.
I20260807 13:54:16.966979 17536 ts_tablet_manager.cc:1403] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.280s user 0.052s sys 0.009s
I20260807 13:54:16.968036 17536 raft_consensus.cc:359] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:16.968492 17536 raft_consensus.cc:740] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:54:16.969008 17536 consensus_queue.cc:260] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:16.969915 17536 ts_tablet_manager.cc:1434] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:54:16.970764 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session fa83b7af134b4e3b949ac3b4e4bcb5e7-ffa98a163d7540e3a911a39334657138 received from {username='slave'} at 127.23.107.129:37907
I20260807 13:54:16.970937 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session fa83b7af134b4e3b949ac3b4e4bcb5e7-ffa98a163d7540e3a911a39334657138 on tablet ffa98a163d7540e3a911a39334657138 with peer fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:54:16.984681 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:17.012704 4715 raft_consensus.cc:1217] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.10->[1.11-1.11] Dedup: 1.11->[]
I20260807 13:54:17.033268 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:17.120785 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:17.137952 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:17.202239 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:17.206207 7669 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:17.250236 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:17.262699 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:17.281642 4865 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:17.282547 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:17.317144 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:17.323005 7669 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:17.347805 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:17.426229 17698 ts_tablet_manager.cc:933] T 312c7ed04e334b08b506c8908224a7da P 12ab71778f2f4b378765aaed1a0676a5: Initiating tablet copy from peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:54:17.430269 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:17.448477 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:17.453493 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:17.462823 4865 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:17.483085 17698 tablet_copy_client.cc:323] T 312c7ed04e334b08b506c8908224a7da P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.130:37489
I20260807 13:54:17.483990 4921 tablet_copy_service.cc:140] P c9d2944272bc447dafce7620ac2dbd4b: Received BeginTabletCopySession request for tablet 312c7ed04e334b08b506c8908224a7da from peer 12ab71778f2f4b378765aaed1a0676a5 ({username='slave'} at 127.23.107.134:40561)
I20260807 13:54:17.484189 4921 tablet_copy_service.cc:161] P c9d2944272bc447dafce7620ac2dbd4b: Beginning new tablet copy session on tablet 312c7ed04e334b08b506c8908224a7da from peer 12ab71778f2f4b378765aaed1a0676a5 at {username='slave'} at 127.23.107.134:40561: session id = 12ab71778f2f4b378765aaed1a0676a5-312c7ed04e334b08b506c8908224a7da
I20260807 13:54:17.487335 4921 tablet_copy_source_session.cc:215] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:17.488845 17698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 312c7ed04e334b08b506c8908224a7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:17.499668 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:17.581017 17698 tablet_copy_client.cc:806] T 312c7ed04e334b08b506c8908224a7da P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:17.581362 17698 tablet_copy_client.cc:670] T 312c7ed04e334b08b506c8908224a7da P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:17.621767 17698 tablet_copy_client.cc:538] T 312c7ed04e334b08b506c8908224a7da P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:17.625880 17698 tablet_bootstrap.cc:492] T 312c7ed04e334b08b506c8908224a7da P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap starting.
I20260807 13:54:17.671446 5068 consensus_queue.cc:237] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:17.687492 7353 raft_consensus.cc:1275] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:54:17.688416 17623 consensus_queue.cc:1048] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:54:17.721892 7352 raft_consensus.cc:2955] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:17.720937 17773 raft_consensus.cc:2955] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:17.731493 4515 catalog_manager.cc:5697] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:17.752853 17698 tablet_bootstrap.cc:492] T 312c7ed04e334b08b506c8908224a7da P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:17.754069 17698 tablet_bootstrap.cc:492] T 312c7ed04e334b08b506c8908224a7da P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap complete.
I20260807 13:54:17.754416 17698 ts_tablet_manager.cc:1403] T 312c7ed04e334b08b506c8908224a7da P 12ab71778f2f4b378765aaed1a0676a5: Time spent bootstrapping tablet: real 0.129s user 0.058s sys 0.000s
I20260807 13:54:17.755129 17698 raft_consensus.cc:359] T 312c7ed04e334b08b506c8908224a7da P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:17.755304 17698 raft_consensus.cc:740] T 312c7ed04e334b08b506c8908224a7da P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Initialized, Role: FOLLOWER
I20260807 13:54:17.755517 17698 consensus_queue.cc:260] T 312c7ed04e334b08b506c8908224a7da P 12ab71778f2f4b378765aaed1a0676a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:17.755957 17698 ts_tablet_manager.cc:1434] T 312c7ed04e334b08b506c8908224a7da P 12ab71778f2f4b378765aaed1a0676a5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 13:54:17.756881 4921 tablet_copy_service.cc:342] P c9d2944272bc447dafce7620ac2dbd4b: Request end of tablet copy session 12ab71778f2f4b378765aaed1a0676a5-312c7ed04e334b08b506c8908224a7da received from {username='slave'} at 127.23.107.134:40561
I20260807 13:54:17.757037 4921 tablet_copy_service.cc:434] P c9d2944272bc447dafce7620ac2dbd4b: ending tablet copy session 12ab71778f2f4b378765aaed1a0676a5-312c7ed04e334b08b506c8908224a7da on tablet 312c7ed04e334b08b506c8908224a7da with peer 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:54:17.785892 4865 tablet_service.cc:1558] Processing DeleteTablet for tablet eab259b597a64c04869543ccb1d9038c with delete_type TABLET_DATA_TOMBSTONED (TS c9d2944272bc447dafce7620ac2dbd4b not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:36624
I20260807 13:54:17.787832 5068 consensus_queue.cc:237] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:17.798491 7352 raft_consensus.cc:1275] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20260807 13:54:17.798781 4981 consensus_peers.cc:597] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 -> Peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): Couldn't send request to peer b77f2b2eade540c6bfd4f75e5229a3cd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eab259b597a64c04869543ccb1d9038c. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:17.799798 17623 consensus_queue.cc:1048] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:17.803369 17623 raft_consensus.cc:2955] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:17.806722 17790 tablet_replica.cc:333] T eab259b597a64c04869543ccb1d9038c P c9d2944272bc447dafce7620ac2dbd4b: stopping tablet replica
I20260807 13:54:17.806948 17790 raft_consensus.cc:2243] T eab259b597a64c04869543ccb1d9038c P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:17.807168 17790 raft_consensus.cc:2272] T eab259b597a64c04869543ccb1d9038c P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:17.808043 17790 ts_tablet_manager.cc:1916] T eab259b597a64c04869543ccb1d9038c P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:17.818879 7352 raft_consensus.cc:2955] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:17.823040 17790 ts_tablet_manager.cc:1929] T eab259b597a64c04869543ccb1d9038c P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260807 13:54:17.823184 17790 log.cc:1199] T eab259b597a64c04869543ccb1d9038c P c9d2944272bc447dafce7620ac2dbd4b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/eab259b597a64c04869543ccb1d9038c
I20260807 13:54:17.824536 4505 catalog_manager.cc:5028] TS c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): tablet eab259b597a64c04869543ccb1d9038c (table rebalance_test_table_7 [id=2ff801ea568346e096cc895a279c109c]) successfully deleted
I20260807 13:54:17.840782 4504 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet eab259b597a64c04869543ccb1d9038c with cas_config_opid_index 6: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260807 13:54:17.845003 4513 catalog_manager.cc:5697] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: config changed from index 6 to 7, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:17.901144 7179 consensus_queue.cc:237] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 3.9, Last appended by leader: 8, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:17.914158 7352 raft_consensus.cc:1217] T 312c7ed04e334b08b506c8908224a7da P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260807 13:54:17.939538 4715 raft_consensus.cc:1275] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 3 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 9. Preceding OpId from leader: term: 3 index: 10. (index mismatch)
I20260807 13:54:17.940400 17431 consensus_queue.cc:1048] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:17.971786 17838 raft_consensus.cc:2955] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [term 3 LEADER]: Committing config change with OpId 3.10: config changed from index 8 to 10, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:17.975860 4715 raft_consensus.cc:2955] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 3 FOLLOWER]: Committing config change with OpId 3.10: config changed from index 8 to 10, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:17.982314 4515 catalog_manager.cc:5697] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: config changed from index 8 to 10, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New cstate: current_term: 3 leader_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:18.015344 5039 tablet_service.cc:1558] Processing DeleteTablet for tablet 04dac80fea124c25b34af8cc290c0d7f with delete_type TABLET_DATA_TOMBSTONED (TS 01adf83af3e04875b5fac9470d4da915 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:36810
I20260807 13:54:18.040903 17856 tablet_replica.cc:333] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915: stopping tablet replica
I20260807 13:54:18.045581 17856 raft_consensus.cc:2243] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:18.046026 17856 raft_consensus.cc:2272] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:18.047250 17856 ts_tablet_manager.cc:1916] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:18.065747 7179 consensus_queue.cc:237] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 3.10, Last appended by leader: 8, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:18.071682 4715 raft_consensus.cc:1275] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 3 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 10. Preceding OpId from leader: term: 3 index: 11. (index mismatch)
I20260807 13:54:18.072570 17431 consensus_queue.cc:1048] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:54:18.076658 17856 ts_tablet_manager.cc:1929] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.9
I20260807 13:54:18.076885 17856 log.cc:1199] T 04dac80fea124c25b34af8cc290c0d7f P 01adf83af3e04875b5fac9470d4da915: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/wals/04dac80fea124c25b34af8cc290c0d7f
I20260807 13:54:18.076704 4715 raft_consensus.cc:2955] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 3 FOLLOWER]: Committing config change with OpId 3.11: config changed from index 10 to 11, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:18.078123 4504 catalog_manager.cc:5028] TS 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): tablet 04dac80fea124c25b34af8cc290c0d7f (table rebalance_test_table_8 [id=91303cf8b9064e06b8c4165942b287f2]) successfully deleted
I20260807 13:54:18.075883 17431 raft_consensus.cc:2955] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [term 3 LEADER]: Committing config change with OpId 3.11: config changed from index 10 to 11, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:18.091099 4515 catalog_manager.cc:5697] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index 10 to 11, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New cstate: current_term: 3 leader_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
W20260807 13:54:18.110893 7102 consensus_peers.cc:597] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 04dac80fea124c25b34af8cc290c0d7f. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:18.113682 4505 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet 04dac80fea124c25b34af8cc290c0d7f with cas_config_opid_index 10: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260807 13:54:18.256776 7690 consensus_queue.cc:237] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 2.6, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:18.262902 5068 raft_consensus.cc:1275] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Refusing update from remote peer 31d7630573c8475a9f84978d4ebfb879: Log matching property violated. Preceding OpId in replica: term: 2 index: 6. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20260807 13:54:18.265470 17470 consensus_queue.cc:1048] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:18.270483 17924 raft_consensus.cc:2955] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [term 2 LEADER]: Committing config change with OpId 2.7: config changed from index 5 to 7, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:18.271135 5068 raft_consensus.cc:2955] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Committing config change with OpId 2.7: config changed from index 5 to 7, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:18.287209 4513 catalog_manager.cc:5697] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 reported cstate change: config changed from index 5 to 7, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New cstate: current_term: 2 leader_uuid: "31d7630573c8475a9f84978d4ebfb879" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:18.293238 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet b414c896ad884facb339e5e4a0329065 with delete_type TABLET_DATA_TOMBSTONED (TS edf940ebcc1140cfa0c23214e0c0f179 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:53540
I20260807 13:54:18.307824 17938 tablet_replica.cc:333] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179: stopping tablet replica
I20260807 13:54:18.311286 17938 raft_consensus.cc:2243] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:18.313045 7690 consensus_queue.cc:237] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 2.7, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
W20260807 13:54:18.318248 7613 consensus_peers.cc:597] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b414c896ad884facb339e5e4a0329065. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:18.320365 5068 raft_consensus.cc:1275] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Refusing update from remote peer 31d7630573c8475a9f84978d4ebfb879: Log matching property violated. Preceding OpId in replica: term: 2 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260807 13:54:18.321543 17470 consensus_queue.cc:1048] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:18.325047 17470 raft_consensus.cc:2955] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [term 2 LEADER]: Committing config change with OpId 2.8: config changed from index 7 to 8, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:18.332727 5068 raft_consensus.cc:2955] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Committing config change with OpId 2.8: config changed from index 7 to 8, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:18.349025 4503 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet b414c896ad884facb339e5e4a0329065 with cas_config_opid_index 7: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260807 13:54:18.352334 4513 catalog_manager.cc:5697] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 reported cstate change: config changed from index 7 to 8, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New cstate: current_term: 2 leader_uuid: "31d7630573c8475a9f84978d4ebfb879" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:18.384559 17938 raft_consensus.cc:2272] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:18.385910 17938 ts_tablet_manager.cc:1916] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260807 13:54:18.416899 4806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:41217, user_credentials={real_user=slave}} blocked reactor thread for 101997us
I20260807 13:54:18.480657 17966 ts_tablet_manager.cc:933] T eab259b597a64c04869543ccb1d9038c P b77f2b2eade540c6bfd4f75e5229a3cd: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:54:18.488946 17938 ts_tablet_manager.cc:1929] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.6
I20260807 13:54:18.493409 17938 log.cc:1199] T b414c896ad884facb339e5e4a0329065 P edf940ebcc1140cfa0c23214e0c0f179: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal/wals/b414c896ad884facb339e5e4a0329065
I20260807 13:54:18.495205 4506 catalog_manager.cc:5028] TS edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): tablet b414c896ad884facb339e5e4a0329065 (table rebalance_test_table_2 [id=35d13981f3a742dd9369d1e7bf18498c]) successfully deleted
I20260807 13:54:18.500092 17966 tablet_copy_client.cc:323] T eab259b597a64c04869543ccb1d9038c P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:54:18.500995 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet eab259b597a64c04869543ccb1d9038c from peer b77f2b2eade540c6bfd4f75e5229a3cd ({username='slave'} at 127.23.107.133:50357)
I20260807 13:54:18.501200 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet eab259b597a64c04869543ccb1d9038c from peer b77f2b2eade540c6bfd4f75e5229a3cd at {username='slave'} at 127.23.107.133:50357: session id = b77f2b2eade540c6bfd4f75e5229a3cd-eab259b597a64c04869543ccb1d9038c
I20260807 13:54:18.505231 5101 tablet_copy_source_session.cc:215] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:18.509140 17966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eab259b597a64c04869543ccb1d9038c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:18.513751 17986 ts_tablet_manager.cc:933] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5: Initiating tablet copy from peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075)
I20260807 13:54:18.544044 17966 tablet_copy_client.cc:806] T eab259b597a64c04869543ccb1d9038c P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:18.544409 17966 tablet_copy_client.cc:670] T eab259b597a64c04869543ccb1d9038c P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:18.546803 17966 tablet_copy_client.cc:538] T eab259b597a64c04869543ccb1d9038c P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:18.551044 17986 tablet_copy_client.cc:323] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.133:38075
I20260807 13:54:18.555162 17966 tablet_bootstrap.cc:492] T eab259b597a64c04869543ccb1d9038c P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap starting.
I20260807 13:54:18.581594 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:18.608034 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:18.630687 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:18.635334 7213 tablet_copy_service.cc:140] P b77f2b2eade540c6bfd4f75e5229a3cd: Received BeginTabletCopySession request for tablet 04dac80fea124c25b34af8cc290c0d7f from peer 12ab71778f2f4b378765aaed1a0676a5 ({username='slave'} at 127.23.107.134:47571)
I20260807 13:54:18.635564 7213 tablet_copy_service.cc:161] P b77f2b2eade540c6bfd4f75e5229a3cd: Beginning new tablet copy session on tablet 04dac80fea124c25b34af8cc290c0d7f from peer 12ab71778f2f4b378765aaed1a0676a5 at {username='slave'} at 127.23.107.134:47571: session id = 12ab71778f2f4b378765aaed1a0676a5-04dac80fea124c25b34af8cc290c0d7f
I20260807 13:54:18.639415 7213 tablet_copy_source_session.cc:215] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:18.641937 17986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04dac80fea124c25b34af8cc290c0d7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:18.651377 17986 tablet_copy_client.cc:806] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:18.652230 17986 tablet_copy_client.cc:670] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:18.656522 17986 tablet_copy_client.cc:538] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:18.661062 7669 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:18.695955 17986 tablet_bootstrap.cc:492] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap starting.
I20260807 13:54:18.726090 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:18.738576 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:18.740556 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:18.751220 4865 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:18.757508 17966 tablet_bootstrap.cc:492] T eab259b597a64c04869543ccb1d9038c P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:18.758373 17966 tablet_bootstrap.cc:492] T eab259b597a64c04869543ccb1d9038c P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap complete.
I20260807 13:54:18.758643 17966 ts_tablet_manager.cc:1403] T eab259b597a64c04869543ccb1d9038c P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent bootstrapping tablet: real 0.204s user 0.073s sys 0.042s
I20260807 13:54:18.759424 17966 raft_consensus.cc:359] T eab259b597a64c04869543ccb1d9038c P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:18.759601 17966 raft_consensus.cc:740] T eab259b597a64c04869543ccb1d9038c P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77f2b2eade540c6bfd4f75e5229a3cd, State: Initialized, Role: FOLLOWER
I20260807 13:54:18.759804 17966 consensus_queue.cc:260] T eab259b597a64c04869543ccb1d9038c P b77f2b2eade540c6bfd4f75e5229a3cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:18.761942 17966 ts_tablet_manager.cc:1434] T eab259b597a64c04869543ccb1d9038c P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:54:18.763374 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-eab259b597a64c04869543ccb1d9038c received from {username='slave'} at 127.23.107.133:50357
I20260807 13:54:18.763505 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-eab259b597a64c04869543ccb1d9038c on tablet eab259b597a64c04869543ccb1d9038c with peer b77f2b2eade540c6bfd4f75e5229a3cd
I20260807 13:54:18.785921 18054 ts_tablet_manager.cc:933] T b414c896ad884facb339e5e4a0329065 P 12ab71778f2f4b378765aaed1a0676a5: Initiating tablet copy from peer 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729)
I20260807 13:54:18.796442 18054 tablet_copy_client.cc:323] T b414c896ad884facb339e5e4a0329065 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.136:43729
I20260807 13:54:18.797819 7712 tablet_copy_service.cc:140] P 31d7630573c8475a9f84978d4ebfb879: Received BeginTabletCopySession request for tablet b414c896ad884facb339e5e4a0329065 from peer 12ab71778f2f4b378765aaed1a0676a5 ({username='slave'} at 127.23.107.134:54195)
I20260807 13:54:18.798053 7712 tablet_copy_service.cc:161] P 31d7630573c8475a9f84978d4ebfb879: Beginning new tablet copy session on tablet b414c896ad884facb339e5e4a0329065 from peer 12ab71778f2f4b378765aaed1a0676a5 at {username='slave'} at 127.23.107.134:54195: session id = 12ab71778f2f4b378765aaed1a0676a5-b414c896ad884facb339e5e4a0329065
I20260807 13:54:18.805152 7712 tablet_copy_source_session.cc:215] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:18.808478 18054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b414c896ad884facb339e5e4a0329065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:18.827760 7178 raft_consensus.cc:1217] T eab259b597a64c04869543ccb1d9038c P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260807 13:54:18.830590 18054 tablet_copy_client.cc:806] T b414c896ad884facb339e5e4a0329065 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:18.830888 18054 tablet_copy_client.cc:670] T b414c896ad884facb339e5e4a0329065 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:18.833715 18054 tablet_copy_client.cc:538] T b414c896ad884facb339e5e4a0329065 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:18.838027 18054 tablet_bootstrap.cc:492] T b414c896ad884facb339e5e4a0329065 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap starting.
I20260807 13:54:18.989790 18054 tablet_bootstrap.cc:492] T b414c896ad884facb339e5e4a0329065 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:18.990360 18054 tablet_bootstrap.cc:492] T b414c896ad884facb339e5e4a0329065 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap complete.
I20260807 13:54:18.990733 18054 ts_tablet_manager.cc:1403] T b414c896ad884facb339e5e4a0329065 P 12ab71778f2f4b378765aaed1a0676a5: Time spent bootstrapping tablet: real 0.153s user 0.058s sys 0.004s
I20260807 13:54:18.991798 18054 raft_consensus.cc:359] T b414c896ad884facb339e5e4a0329065 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:18.992069 18054 raft_consensus.cc:740] T b414c896ad884facb339e5e4a0329065 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Initialized, Role: FOLLOWER
I20260807 13:54:18.995555 18054 consensus_queue.cc:260] T b414c896ad884facb339e5e4a0329065 P 12ab71778f2f4b378765aaed1a0676a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 2.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:19.000661 18054 ts_tablet_manager.cc:1434] T b414c896ad884facb339e5e4a0329065 P 12ab71778f2f4b378765aaed1a0676a5: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260807 13:54:19.001680 7712 tablet_copy_service.cc:342] P 31d7630573c8475a9f84978d4ebfb879: Request end of tablet copy session 12ab71778f2f4b378765aaed1a0676a5-b414c896ad884facb339e5e4a0329065 received from {username='slave'} at 127.23.107.134:54195
I20260807 13:54:19.001885 7712 tablet_copy_service.cc:434] P 31d7630573c8475a9f84978d4ebfb879: ending tablet copy session 12ab71778f2f4b378765aaed1a0676a5-b414c896ad884facb339e5e4a0329065 on tablet b414c896ad884facb339e5e4a0329065 with peer 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:54:19.028738 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:19.032317 17986 tablet_bootstrap.cc:492] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:19.032801 17986 tablet_bootstrap.cc:492] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap complete.
I20260807 13:54:19.033120 17986 ts_tablet_manager.cc:1403] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5: Time spent bootstrapping tablet: real 0.337s user 0.054s sys 0.002s
I20260807 13:54:19.033948 17986 raft_consensus.cc:359] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:19.034161 17986 raft_consensus.cc:740] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Initialized, Role: FOLLOWER
I20260807 13:54:19.034466 17986 consensus_queue.cc:260] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 3.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:19.038009 17986 ts_tablet_manager.cc:1434] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260807 13:54:19.041363 7213 tablet_copy_service.cc:342] P b77f2b2eade540c6bfd4f75e5229a3cd: Request end of tablet copy session 12ab71778f2f4b378765aaed1a0676a5-04dac80fea124c25b34af8cc290c0d7f received from {username='slave'} at 127.23.107.134:47571
I20260807 13:54:19.041577 7213 tablet_copy_service.cc:434] P b77f2b2eade540c6bfd4f75e5229a3cd: ending tablet copy session 12ab71778f2f4b378765aaed1a0676a5-04dac80fea124c25b34af8cc290c0d7f on tablet 04dac80fea124c25b34af8cc290c0d7f with peer 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:54:19.070246 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:19.080325 7669 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:19.137995 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:19.138293 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:19.179441 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:19.197641 4865 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:19.223389 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:19.224632 7352 raft_consensus.cc:1217] T b414c896ad884facb339e5e4a0329065 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 2.7->[2.8-2.8] Dedup: 2.8->[]
I20260807 13:54:19.327482 4892 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a29bfc37eabb411f845203c281444086"
dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:34618
I20260807 13:54:19.327695 4892 raft_consensus.cc:606] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Received request to transfer leadership
I20260807 13:54:19.405285 17954 raft_consensus.cc:993] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b: : Instructing follower 31d7630573c8475a9f84978d4ebfb879 to start an election
I20260807 13:54:19.405472 17954 raft_consensus.cc:1081] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Signalling peer 31d7630573c8475a9f84978d4ebfb879 to start an election
I20260807 13:54:19.406760 7687 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a29bfc37eabb411f845203c281444086"
dest_uuid: "31d7630573c8475a9f84978d4ebfb879"
from {username='slave'} at 127.23.107.130:42829
I20260807 13:54:19.406946 7687 raft_consensus.cc:493] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:54:19.407050 7687 raft_consensus.cc:3060] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:54:19.410569 7687 raft_consensus.cc:515] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:19.413655 4892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29bfc37eabb411f845203c281444086" candidate_uuid: "31d7630573c8475a9f84978d4ebfb879" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: true dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
I20260807 13:54:19.413893 4892 raft_consensus.cc:3055] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:54:19.413967 4892 raft_consensus.cc:740] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Running, Role: LEADER
I20260807 13:54:19.414305 4892 consensus_queue.cc:260] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:19.414620 4892 raft_consensus.cc:3060] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:54:19.415043 7687 leader_election.cc:290] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 election: Requested vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385)
I20260807 13:54:19.418246 4892 raft_consensus.cc:2468] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31d7630573c8475a9f84978d4ebfb879 in term 2.
I20260807 13:54:19.418805 7612 leader_election.cc:304] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31d7630573c8475a9f84978d4ebfb879, c9d2944272bc447dafce7620ac2dbd4b; no voters:
I20260807 13:54:19.419147 17470 raft_consensus.cc:2804] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:54:19.426401 7522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29bfc37eabb411f845203c281444086" candidate_uuid: "31d7630573c8475a9f84978d4ebfb879" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: true dest_uuid: "8a9903f009ff46b4a6875490823076c4"
I20260807 13:54:19.426628 7522 raft_consensus.cc:3060] T a29bfc37eabb411f845203c281444086 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:54:19.430992 7522 raft_consensus.cc:2468] T a29bfc37eabb411f845203c281444086 P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31d7630573c8475a9f84978d4ebfb879 in term 2.
I20260807 13:54:19.447126 7352 raft_consensus.cc:1217] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Deduplicated request from leader. Original: 3.10->[3.11-3.11] Dedup: 3.11->[]
I20260807 13:54:19.460433 17470 raft_consensus.cc:697] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [term 2 LEADER]: Becoming Leader. State: Replica: 31d7630573c8475a9f84978d4ebfb879, State: Running, Role: LEADER
I20260807 13:54:19.461040 17470 consensus_queue.cc:237] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:19.477393 4515 catalog_manager.cc:5697] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 reported cstate change: term changed from 1 to 2, leader changed from c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) to 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136). New cstate: current_term: 2 leader_uuid: "31d7630573c8475a9f84978d4ebfb879" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:19.731278 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:19.877292 7522 raft_consensus.cc:1275] T a29bfc37eabb411f845203c281444086 P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Refusing update from remote peer 31d7630573c8475a9f84978d4ebfb879: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260807 13:54:19.879372 17470 consensus_queue.cc:1048] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:19.880105 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:19.883930 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:19.922178 4892 raft_consensus.cc:1275] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Refusing update from remote peer 31d7630573c8475a9f84978d4ebfb879: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260807 13:54:19.923049 17470 consensus_queue.cc:1048] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:19.968477 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:19.988004 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:20.015333 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:20.039233 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:20.050041 5068 consensus_queue.cc:237] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:20.092193 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:20.100785 7524 raft_consensus.cc:1275] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:54:20.101698 17958 consensus_queue.cc:1048] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:54:20.115444 18390 raft_consensus.cc:2955] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:20.116923 7522 raft_consensus.cc:2955] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:20.128126 4515 catalog_manager.cc:5697] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 reported cstate change: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:20.148149 4865 tablet_service.cc:1558] Processing DeleteTablet for tablet 16afb6ff06704a8795f1de84ffa81de0 with delete_type TABLET_DATA_TOMBSTONED (TS c9d2944272bc447dafce7620ac2dbd4b not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:36624
I20260807 13:54:20.153017 18397 tablet_replica.cc:333] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b: stopping tablet replica
I20260807 13:54:20.159189 18397 raft_consensus.cc:2243] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:20.160157 18397 raft_consensus.cc:2272] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:20.181811 18397 ts_tablet_manager.cc:1916] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:20.191830 5068 consensus_queue.cc:237] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:20.205246 18397 ts_tablet_manager.cc:1929] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20260807 13:54:20.205523 18397 log.cc:1199] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/16afb6ff06704a8795f1de84ffa81de0
I20260807 13:54:20.206835 4505 catalog_manager.cc:5028] TS c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): tablet 16afb6ff06704a8795f1de84ffa81de0 (table rebalance_test_table_0 [id=14867b014aab43119171102f60bb134d]) successfully deleted
I20260807 13:54:20.217309 7524 raft_consensus.cc:1275] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20260807 13:54:20.220661 4981 consensus_peers.cc:597] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:20.222147 18390 consensus_queue.cc:1048] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:20.229311 18390 raft_consensus.cc:2955] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:20.233254 7524 raft_consensus.cc:2955] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:20.243098 4515 catalog_manager.cc:5697] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 reported cstate change: config changed from index 6 to 7, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:20.244479 4504 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet 16afb6ff06704a8795f1de84ffa81de0 with cas_config_opid_index 6: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260807 13:54:20.298923 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:20.309330 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:20.350821 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:20.403992 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:20.434779 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:20.496259 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:20.499778 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:20.507596 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:20.541778 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:20.555054 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:20.560721 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:20.585489 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:54:20.667490 5153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.133:38075, user_credentials={real_user=slave}} blocked reactor thread for 80607.6us
I20260807 13:54:20.676587 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:20.732465 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:20.746668 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:20.747229 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:20.790880 18474 ts_tablet_manager.cc:933] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:54:20.811362 18474 tablet_copy_client.cc:323] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:54:20.812330 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet 16afb6ff06704a8795f1de84ffa81de0 from peer c9d2944272bc447dafce7620ac2dbd4b ({username='slave'} at 127.23.107.130:47105)
I20260807 13:54:20.812510 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet 16afb6ff06704a8795f1de84ffa81de0 from peer c9d2944272bc447dafce7620ac2dbd4b at {username='slave'} at 127.23.107.130:47105: session id = c9d2944272bc447dafce7620ac2dbd4b-16afb6ff06704a8795f1de84ffa81de0
I20260807 13:54:20.815981 5101 tablet_copy_source_session.cc:215] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:20.819033 18474 ts_tablet_manager.cc:1916] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:54:20.869239 18474 ts_tablet_manager.cc:1929] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.5
I20260807 13:54:20.873620 18474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16afb6ff06704a8795f1de84ffa81de0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:20.887128 18474 tablet_copy_client.cc:806] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:20.887444 18474 tablet_copy_client.cc:670] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:20.889761 18474 tablet_copy_client.cc:538] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:20.898444 18474 tablet_bootstrap.cc:492] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:54:21.083684 18474 tablet_bootstrap.cc:492] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:21.084304 18474 tablet_bootstrap.cc:492] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap complete.
I20260807 13:54:21.084649 18474 ts_tablet_manager.cc:1403] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.186s user 0.064s sys 0.008s
I20260807 13:54:21.085604 18474 raft_consensus.cc:359] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:21.085844 18474 raft_consensus.cc:740] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:54:21.086169 18474 consensus_queue.cc:260] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:21.090152 18474 ts_tablet_manager.cc:1434] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260807 13:54:21.096359 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session c9d2944272bc447dafce7620ac2dbd4b-16afb6ff06704a8795f1de84ffa81de0 received from {username='slave'} at 127.23.107.130:47105
I20260807 13:54:21.096510 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session c9d2944272bc447dafce7620ac2dbd4b-16afb6ff06704a8795f1de84ffa81de0 on tablet 16afb6ff06704a8795f1de84ffa81de0 with peer c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:54:21.140792 4717 consensus_queue.cc:237] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
W20260807 13:54:21.181286 4631 consensus_peers.cc:597] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:21.182799 5068 raft_consensus.cc:1275] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:21.183765 18059 consensus_queue.cc:1048] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:21.200367 7179 raft_consensus.cc:1275] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:21.201252 18059 consensus_queue.cc:1048] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:21.220458 18507 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:21.221310 5072 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:21.227757 4892 raft_consensus.cc:1217] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260807 13:54:21.233892 4515 catalog_manager.cc:5697] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 7 to 8, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:21.234728 7179 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:21.272804 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:21.283143 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:21.307221 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:21.355331 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:21.390626 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:21.500233 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:21.556032 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:21.581931 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:21.584280 18474 ts_tablet_manager.cc:933] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:54:21.601497 18474 tablet_copy_client.cc:323] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:54:21.602378 4748 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet 966ebd287fc14e498e5bd3e6542194ca from peer c9d2944272bc447dafce7620ac2dbd4b ({username='slave'} at 127.23.107.130:51721)
I20260807 13:54:21.602560 4748 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet 966ebd287fc14e498e5bd3e6542194ca from peer c9d2944272bc447dafce7620ac2dbd4b at {username='slave'} at 127.23.107.130:51721: session id = c9d2944272bc447dafce7620ac2dbd4b-966ebd287fc14e498e5bd3e6542194ca
I20260807 13:54:21.606124 4748 tablet_copy_source_session.cc:215] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:21.607637 18474 ts_tablet_manager.cc:1916] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:54:21.650229 18474 ts_tablet_manager.cc:1929] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.5
I20260807 13:54:21.651494 18474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 966ebd287fc14e498e5bd3e6542194ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:21.661813 18474 tablet_copy_client.cc:806] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:21.662330 18474 tablet_copy_client.cc:670] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:21.662741 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:21.665213 18474 tablet_copy_client.cc:538] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:21.699781 18474 tablet_bootstrap.cc:492] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:54:21.704272 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:21.737982 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:21.767849 7687 consensus_queue.cc:237] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 2.8, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:21.782851 7524 raft_consensus.cc:1275] T a29bfc37eabb411f845203c281444086 P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Refusing update from remote peer 31d7630573c8475a9f84978d4ebfb879: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260807 13:54:21.783703 18218 consensus_queue.cc:1048] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:21.809047 18671 raft_consensus.cc:2955] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [term 2 LEADER]: Committing config change with OpId 2.9: config changed from index 7 to 9, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:21.820789 7524 raft_consensus.cc:2955] T a29bfc37eabb411f845203c281444086 P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Committing config change with OpId 2.9: config changed from index 7 to 9, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:21.840775 4520 catalog_manager.cc:5697] T a29bfc37eabb411f845203c281444086 P 8a9903f009ff46b4a6875490823076c4 reported cstate change: config changed from index 7 to 9, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New cstate: current_term: 2 leader_uuid: "31d7630573c8475a9f84978d4ebfb879" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:21.844142 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:21.862370 4865 tablet_service.cc:1558] Processing DeleteTablet for tablet a29bfc37eabb411f845203c281444086 with delete_type TABLET_DATA_TOMBSTONED (TS c9d2944272bc447dafce7620ac2dbd4b not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:36624
I20260807 13:54:21.873294 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:21.876080 4866 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:21.881650 7687 consensus_queue.cc:237] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.9, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:21.895282 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:21.909174 7524 raft_consensus.cc:1275] T a29bfc37eabb411f845203c281444086 P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Refusing update from remote peer 31d7630573c8475a9f84978d4ebfb879: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260807 13:54:21.910852 18671 consensus_queue.cc:1048] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:21.914187 18671 raft_consensus.cc:2955] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [term 2 LEADER]: Committing config change with OpId 2.10: config changed from index 9 to 10, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:21.918203 7522 raft_consensus.cc:2955] T a29bfc37eabb411f845203c281444086 P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 9 to 10, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:21.926139 18683 tablet_replica.cc:333] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b: stopping tablet replica
I20260807 13:54:21.928017 18683 raft_consensus.cc:2243] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:21.929122 18683 raft_consensus.cc:2272] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:21.930725 4516 catalog_manager.cc:5697] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 reported cstate change: config changed from index 9 to 10, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New cstate: current_term: 2 leader_uuid: "31d7630573c8475a9f84978d4ebfb879" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:21.934496 18683 ts_tablet_manager.cc:1916] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:21.946280 4503 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet a29bfc37eabb411f845203c281444086 with cas_config_opid_index 9: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260807 13:54:21.961395 5068 consensus_queue.cc:237] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:21.965322 18683 ts_tablet_manager.cc:1929] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.8
I20260807 13:54:21.965523 18683 log.cc:1199] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/a29bfc37eabb411f845203c281444086
I20260807 13:54:21.966663 4505 catalog_manager.cc:5028] TS c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): tablet a29bfc37eabb411f845203c281444086 (table rebalance_test_table_5 [id=b6c061acc30c4e5aa6bee1f054e3a59a]) successfully deleted
I20260807 13:54:21.972698 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:54:21.977025 4982 consensus_peers.cc:597] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 43f5461808a646c885d593f782538930. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:21.978310 5248 consensus_queue.cc:237] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:21.978493 7524 raft_consensus.cc:1275] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:21.980943 18622 consensus_queue.cc:1048] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:21.997202 18474 tablet_bootstrap.cc:492] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:21.998591 18474 tablet_bootstrap.cc:492] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap complete.
I20260807 13:54:21.998998 18474 ts_tablet_manager.cc:1403] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.299s user 0.059s sys 0.007s
I20260807 13:54:22.000161 18474 raft_consensus.cc:359] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:22.000460 18474 raft_consensus.cc:740] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:54:22.000782 18474 consensus_queue.cc:260] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:22.002799 18474 ts_tablet_manager.cc:1434] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260807 13:54:22.002792 7687 raft_consensus.cc:1275] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:22.003551 4748 tablet_copy_service.cc:342] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Request end of tablet copy session c9d2944272bc447dafce7620ac2dbd4b-966ebd287fc14e498e5bd3e6542194ca received from {username='slave'} at 127.23.107.130:51721
I20260807 13:54:22.003687 4748 tablet_copy_service.cc:434] P fa83b7af134b4e3b949ac3b4e4bcb5e7: ending tablet copy session c9d2944272bc447dafce7620ac2dbd4b-966ebd287fc14e498e5bd3e6542194ca on tablet 966ebd287fc14e498e5bd3e6542194ca with peer c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:54:22.005537 18622 consensus_queue.cc:1048] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260807 13:54:22.016809 7612 consensus_peers.cc:597] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 -> Peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): Couldn't send request to peer b77f2b2eade540c6bfd4f75e5229a3cd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a29bfc37eabb411f845203c281444086. This is attempt 1: this message will repeat every 5th retry.
W20260807 13:54:22.022413 5154 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 96bc42d66fa04fb69afa630969dbb579. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:22.025496 7690 raft_consensus.cc:1275] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:22.026149 18456 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:22.028442 7524 raft_consensus.cc:1275] T 96bc42d66fa04fb69afa630969dbb579 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:22.030121 18456 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:22.100301 18705 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:22.103963 7690 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:22.113298 4520 catalog_manager.cc:5697] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 reported cstate change: config changed from index 7 to 8, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:22.141008 7522 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:22.143136 18710 raft_consensus.cc:2955] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:22.153944 7690 raft_consensus.cc:2955] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:22.160161 4520 catalog_manager.cc:5697] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879 reported cstate change: config changed from index 7 to 8, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:22.187891 7522 raft_consensus.cc:2955] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:22.190912 4892 raft_consensus.cc:1217] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260807 13:54:22.300164 7179 consensus_queue.cc:237] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 3.11, Last appended by leader: 8, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:22.313896 7353 raft_consensus.cc:1275] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 11. Preceding OpId from leader: term: 3 index: 12. (index mismatch)
I20260807 13:54:22.314709 17431 consensus_queue.cc:1048] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260807 13:54:22.354046 17431 raft_consensus.cc:2955] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [term 3 LEADER]: Committing config change with OpId 3.12: config changed from index 11 to 12, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:22.371919 7353 raft_consensus.cc:2955] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Committing config change with OpId 3.12: config changed from index 11 to 12, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:22.378156 4516 catalog_manager.cc:5697] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: config changed from index 11 to 12, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New cstate: current_term: 3 leader_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:22.385573 7178 consensus_queue.cc:237] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 3.12, Last appended by leader: 8, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:22.387300 4688 tablet_service.cc:1558] Processing DeleteTablet for tablet 04dac80fea124c25b34af8cc290c0d7f with delete_type TABLET_DATA_TOMBSTONED (TS fa83b7af134b4e3b949ac3b4e4bcb5e7 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:56314
I20260807 13:54:22.397780 7353 raft_consensus.cc:1275] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 12. Preceding OpId from leader: term: 3 index: 13. (index mismatch)
I20260807 13:54:22.398872 17431 consensus_queue.cc:1048] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260807 13:54:22.403642 17431 raft_consensus.cc:2955] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [term 3 LEADER]: Committing config change with OpId 3.13: config changed from index 12 to 13, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:22.408978 18800 ts_tablet_manager.cc:933] T a29bfc37eabb411f845203c281444086 P b77f2b2eade540c6bfd4f75e5229a3cd: Initiating tablet copy from peer 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729)
I20260807 13:54:22.411512 4505 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet 04dac80fea124c25b34af8cc290c0d7f with cas_config_opid_index 12: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260807 13:54:22.412971 7353 raft_consensus.cc:2955] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Committing config change with OpId 3.13: config changed from index 12 to 13, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:22.414788 18800 tablet_copy_client.cc:323] T a29bfc37eabb411f845203c281444086 P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.136:43729
I20260807 13:54:22.428938 5068 consensus_queue.cc:237] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:22.432825 7687 raft_consensus.cc:1275] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:22.435035 7522 raft_consensus.cc:1275] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:22.436434 18806 tablet_replica.cc:333] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: stopping tablet replica
I20260807 13:54:22.436730 18806 raft_consensus.cc:2243] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:22.437060 18806 raft_consensus.cc:2272] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:22.437516 18622 consensus_queue.cc:1048] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:22.438071 18806 ts_tablet_manager.cc:1916] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260807 13:54:22.438469 4982 consensus_peers.cc:597] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 43f5461808a646c885d593f782538930. This is attempt 1: this message will repeat every 5th retry.
W20260807 13:54:22.438678 4982 consensus_peers.cc:597] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:22.438834 18622 consensus_queue.cc:1048] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:22.445698 4520 catalog_manager.cc:5697] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: config changed from index 12 to 13, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New cstate: current_term: 3 leader_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:22.454043 18622 raft_consensus.cc:2955] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:22.455976 7687 raft_consensus.cc:2955] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:22.482111 7522 raft_consensus.cc:2955] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:22.484169 4513 catalog_manager.cc:5697] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 8 to 9, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:22.487258 18806 ts_tablet_manager.cc:1929] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.11
I20260807 13:54:22.490577 18806 log.cc:1199] T 04dac80fea124c25b34af8cc290c0d7f P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/wals/04dac80fea124c25b34af8cc290c0d7f
I20260807 13:54:22.491611 4506 catalog_manager.cc:5028] TS fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): tablet 04dac80fea124c25b34af8cc290c0d7f (table rebalance_test_table_8 [id=91303cf8b9064e06b8c4165942b287f2]) successfully deleted
I20260807 13:54:22.507337 7712 tablet_copy_service.cc:140] P 31d7630573c8475a9f84978d4ebfb879: Received BeginTabletCopySession request for tablet a29bfc37eabb411f845203c281444086 from peer b77f2b2eade540c6bfd4f75e5229a3cd ({username='slave'} at 127.23.107.133:40853)
I20260807 13:54:22.507540 7712 tablet_copy_service.cc:161] P 31d7630573c8475a9f84978d4ebfb879: Beginning new tablet copy session on tablet a29bfc37eabb411f845203c281444086 from peer b77f2b2eade540c6bfd4f75e5229a3cd at {username='slave'} at 127.23.107.133:40853: session id = b77f2b2eade540c6bfd4f75e5229a3cd-a29bfc37eabb411f845203c281444086
W20260807 13:54:22.510164 7099 consensus_peers.cc:597] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729): Couldn't send request to peer 31d7630573c8475a9f84978d4ebfb879. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 04dac80fea124c25b34af8cc290c0d7f. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:22.511179 7712 tablet_copy_source_session.cc:215] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:22.513456 18800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a29bfc37eabb411f845203c281444086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:22.523120 18800 tablet_copy_client.cc:806] T a29bfc37eabb411f845203c281444086 P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:22.523423 18800 tablet_copy_client.cc:670] T a29bfc37eabb411f845203c281444086 P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:22.527621 18800 tablet_copy_client.cc:538] T a29bfc37eabb411f845203c281444086 P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:22.528429 5068 consensus_queue.cc:237] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:22.532397 18800 tablet_bootstrap.cc:492] T a29bfc37eabb411f845203c281444086 P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap starting.
I20260807 13:54:22.559657 7522 raft_consensus.cc:1275] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:22.560578 18717 consensus_queue.cc:1048] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:22.576880 18717 raft_consensus.cc:2955] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:22.582350 7524 raft_consensus.cc:2955] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:22.591130 4520 catalog_manager.cc:5697] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 reported cstate change: config changed from index 7 to 8, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:22.606981 4865 tablet_service.cc:1558] Processing DeleteTablet for tablet 16afb6ff06704a8795f1de84ffa81de0 with delete_type TABLET_DATA_TOMBSTONED (TS c9d2944272bc447dafce7620ac2dbd4b not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:36624
I20260807 13:54:22.616199 5072 consensus_queue.cc:237] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
W20260807 13:54:22.619226 4981 consensus_peers.cc:597] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 -> Peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): Couldn't send request to peer b77f2b2eade540c6bfd4f75e5229a3cd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 16afb6ff06704a8795f1de84ffa81de0. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:22.621882 7522 raft_consensus.cc:1275] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:22.627508 18863 tablet_replica.cc:333] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b: stopping tablet replica
I20260807 13:54:22.627960 18863 raft_consensus.cc:2243] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:22.628412 18863 raft_consensus.cc:2272] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:22.629531 18863 ts_tablet_manager.cc:1916] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:22.631508 18862 ts_tablet_manager.cc:933] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:54:22.622659 18717 consensus_queue.cc:1048] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260807 13:54:22.641665 18862 tablet_copy_client.cc:323] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:54:22.643118 18622 raft_consensus.cc:2955] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:22.644726 18863 ts_tablet_manager.cc:1929] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.7
I20260807 13:54:22.646010 18863 log.cc:1199] T 16afb6ff06704a8795f1de84ffa81de0 P c9d2944272bc447dafce7620ac2dbd4b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/16afb6ff06704a8795f1de84ffa81de0
I20260807 13:54:22.646296 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet 96bc42d66fa04fb69afa630969dbb579 from peer 12ab71778f2f4b378765aaed1a0676a5 ({username='slave'} at 127.23.107.134:42065)
I20260807 13:54:22.646483 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet 96bc42d66fa04fb69afa630969dbb579 from peer 12ab71778f2f4b378765aaed1a0676a5 at {username='slave'} at 127.23.107.134:42065: session id = 12ab71778f2f4b378765aaed1a0676a5-96bc42d66fa04fb69afa630969dbb579
I20260807 13:54:22.648450 4504 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet 16afb6ff06704a8795f1de84ffa81de0 with cas_config_opid_index 8: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260807 13:54:22.650415 5272 tablet_copy_source_session.cc:215] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:22.651412 4520 catalog_manager.cc:5697] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 8 to 9, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:22.652915 18862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96bc42d66fa04fb69afa630969dbb579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:22.653460 4505 catalog_manager.cc:5028] TS c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): tablet 16afb6ff06704a8795f1de84ffa81de0 (table rebalance_test_table_0 [id=14867b014aab43119171102f60bb134d]) successfully deleted
I20260807 13:54:22.662724 7524 raft_consensus.cc:2955] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:22.728694 18862 tablet_copy_client.cc:806] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:22.729076 18862 tablet_copy_client.cc:670] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:22.733923 18862 tablet_copy_client.cc:538] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:22.751904 18862 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap starting.
I20260807 13:54:22.870616 18929 ts_tablet_manager.cc:933] T 43f5461808a646c885d593f782538930 P 12ab71778f2f4b378765aaed1a0676a5: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:54:22.881702 18933 ts_tablet_manager.cc:933] T 04dac80fea124c25b34af8cc290c0d7f P 31d7630573c8475a9f84978d4ebfb879: Initiating tablet copy from peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075)
I20260807 13:54:22.889873 18929 tablet_copy_client.cc:323] T 43f5461808a646c885d593f782538930 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:54:22.890616 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet 43f5461808a646c885d593f782538930 from peer 12ab71778f2f4b378765aaed1a0676a5 ({username='slave'} at 127.23.107.134:57547)
I20260807 13:54:22.890810 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet 43f5461808a646c885d593f782538930 from peer 12ab71778f2f4b378765aaed1a0676a5 at {username='slave'} at 127.23.107.134:57547: session id = 12ab71778f2f4b378765aaed1a0676a5-43f5461808a646c885d593f782538930
I20260807 13:54:22.893806 5101 tablet_copy_source_session.cc:215] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:22.898833 18929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f5461808a646c885d593f782538930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:22.906479 18933 tablet_copy_client.cc:323] T 04dac80fea124c25b34af8cc290c0d7f P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.133:38075
I20260807 13:54:22.907713 7213 tablet_copy_service.cc:140] P b77f2b2eade540c6bfd4f75e5229a3cd: Received BeginTabletCopySession request for tablet 04dac80fea124c25b34af8cc290c0d7f from peer 31d7630573c8475a9f84978d4ebfb879 ({username='slave'} at 127.23.107.136:41183)
I20260807 13:54:22.907922 7213 tablet_copy_service.cc:161] P b77f2b2eade540c6bfd4f75e5229a3cd: Beginning new tablet copy session on tablet 04dac80fea124c25b34af8cc290c0d7f from peer 31d7630573c8475a9f84978d4ebfb879 at {username='slave'} at 127.23.107.136:41183: session id = 31d7630573c8475a9f84978d4ebfb879-04dac80fea124c25b34af8cc290c0d7f
I20260807 13:54:22.912729 7213 tablet_copy_source_session.cc:215] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:22.916770 18933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04dac80fea124c25b34af8cc290c0d7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:22.929795 18933 tablet_copy_client.cc:806] T 04dac80fea124c25b34af8cc290c0d7f P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:22.938185 18929 tablet_copy_client.cc:806] T 43f5461808a646c885d593f782538930 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:22.938786 18929 tablet_copy_client.cc:670] T 43f5461808a646c885d593f782538930 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:22.941473 18929 tablet_copy_client.cc:538] T 43f5461808a646c885d593f782538930 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:22.945261 18964 ts_tablet_manager.cc:933] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:54:22.945439 18933 tablet_copy_client.cc:670] T 04dac80fea124c25b34af8cc290c0d7f P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:22.948078 18933 tablet_copy_client.cc:538] T 04dac80fea124c25b34af8cc290c0d7f P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:22.959707 18933 tablet_bootstrap.cc:492] T 04dac80fea124c25b34af8cc290c0d7f P 31d7630573c8475a9f84978d4ebfb879: Bootstrap starting.
I20260807 13:54:22.980062 18964 tablet_copy_client.cc:323] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:54:22.998589 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet 43f5461808a646c885d593f782538930 from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 ({username='slave'} at 127.23.107.129:37907)
I20260807 13:54:22.998766 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet 43f5461808a646c885d593f782538930 from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 at {username='slave'} at 127.23.107.129:37907: session id = fa83b7af134b4e3b949ac3b4e4bcb5e7-43f5461808a646c885d593f782538930
I20260807 13:54:23.001878 5101 tablet_copy_source_session.cc:215] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:23.010116 18964 ts_tablet_manager.cc:1916] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:54:23.018510 18929 tablet_bootstrap.cc:492] T 43f5461808a646c885d593f782538930 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap starting.
I20260807 13:54:23.027187 5068 consensus_queue.cc:237] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:23.044015 18978 ts_tablet_manager.cc:933] T 16afb6ff06704a8795f1de84ffa81de0 P b77f2b2eade540c6bfd4f75e5229a3cd: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
W20260807 13:54:23.057803 4981 consensus_peers.cc:597] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 -> Peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): Couldn't send request to peer b77f2b2eade540c6bfd4f75e5229a3cd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d27ce55f2acc4513a9fd90a338098eeb. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:23.063222 18978 tablet_copy_client.cc:323] T 16afb6ff06704a8795f1de84ffa81de0 P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:54:23.068262 5248 raft_consensus.cc:1275] T d27ce55f2acc4513a9fd90a338098eeb P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:54:23.068480 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet 16afb6ff06704a8795f1de84ffa81de0 from peer b77f2b2eade540c6bfd4f75e5229a3cd ({username='slave'} at 127.23.107.133:50357)
I20260807 13:54:23.068634 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet 16afb6ff06704a8795f1de84ffa81de0 from peer b77f2b2eade540c6bfd4f75e5229a3cd at {username='slave'} at 127.23.107.133:50357: session id = b77f2b2eade540c6bfd4f75e5229a3cd-16afb6ff06704a8795f1de84ffa81de0
I20260807 13:54:23.069056 7353 raft_consensus.cc:1275] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:54:23.071581 5101 tablet_copy_source_session.cc:215] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:23.078286 18978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16afb6ff06704a8795f1de84ffa81de0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:23.078517 18710 consensus_queue.cc:1048] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:54:23.086300 18978 tablet_copy_client.cc:806] T 16afb6ff06704a8795f1de84ffa81de0 P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:23.086537 18978 tablet_copy_client.cc:670] T 16afb6ff06704a8795f1de84ffa81de0 P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:23.088251 18978 tablet_copy_client.cc:538] T 16afb6ff06704a8795f1de84ffa81de0 P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:23.093870 18978 tablet_bootstrap.cc:492] T 16afb6ff06704a8795f1de84ffa81de0 P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap starting.
I20260807 13:54:23.096215 18710 consensus_queue.cc:1048] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:54:23.103363 18622 raft_consensus.cc:2955] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:23.106168 5248 raft_consensus.cc:2955] T d27ce55f2acc4513a9fd90a338098eeb P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:23.116036 7353 raft_consensus.cc:2955] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:23.117853 18964 ts_tablet_manager.cc:1929] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.4
I20260807 13:54:23.118247 18964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f5461808a646c885d593f782538930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:23.124960 4513 catalog_manager.cc:5697] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: config changed from index 5 to 6, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:23.133567 18964 tablet_copy_client.cc:806] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:23.133857 18964 tablet_copy_client.cc:670] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:23.136547 18964 tablet_copy_client.cc:538] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:23.153380 18964 tablet_bootstrap.cc:492] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:54:23.160369 18800 tablet_bootstrap.cc:492] T a29bfc37eabb411f845203c281444086 P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:23.176301 18800 tablet_bootstrap.cc:492] T a29bfc37eabb411f845203c281444086 P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap complete.
I20260807 13:54:23.187107 18800 ts_tablet_manager.cc:1403] T a29bfc37eabb411f845203c281444086 P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent bootstrapping tablet: real 0.655s user 0.059s sys 0.037s
I20260807 13:54:23.195106 18800 raft_consensus.cc:359] T a29bfc37eabb411f845203c281444086 P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:23.205960 18800 raft_consensus.cc:740] T a29bfc37eabb411f845203c281444086 P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77f2b2eade540c6bfd4f75e5229a3cd, State: Initialized, Role: FOLLOWER
I20260807 13:54:23.217227 18800 consensus_queue.cc:260] T a29bfc37eabb411f845203c281444086 P b77f2b2eade540c6bfd4f75e5229a3cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 2.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:23.218231 18800 ts_tablet_manager.cc:1434] T a29bfc37eabb411f845203c281444086 P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent starting tablet: real 0.024s user 0.001s sys 0.001s
I20260807 13:54:23.219102 7712 tablet_copy_service.cc:342] P 31d7630573c8475a9f84978d4ebfb879: Request end of tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-a29bfc37eabb411f845203c281444086 received from {username='slave'} at 127.23.107.133:40853
I20260807 13:54:23.219229 7712 tablet_copy_service.cc:434] P 31d7630573c8475a9f84978d4ebfb879: ending tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-a29bfc37eabb411f845203c281444086 on tablet a29bfc37eabb411f845203c281444086 with peer b77f2b2eade540c6bfd4f75e5229a3cd
I20260807 13:54:23.281826 18862 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:23.284682 7179 raft_consensus.cc:1217] T a29bfc37eabb411f845203c281444086 P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Deduplicated request from leader. Original: 2.9->[2.10-2.10] Dedup: 2.10->[]
I20260807 13:54:23.328047 18978 tablet_bootstrap.cc:492] T 16afb6ff06704a8795f1de84ffa81de0 P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:23.334770 18978 tablet_bootstrap.cc:492] T 16afb6ff06704a8795f1de84ffa81de0 P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap complete.
I20260807 13:54:23.335180 18978 ts_tablet_manager.cc:1403] T 16afb6ff06704a8795f1de84ffa81de0 P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent bootstrapping tablet: real 0.241s user 0.059s sys 0.004s
I20260807 13:54:23.336267 18978 raft_consensus.cc:359] T 16afb6ff06704a8795f1de84ffa81de0 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:23.336526 18978 raft_consensus.cc:740] T 16afb6ff06704a8795f1de84ffa81de0 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77f2b2eade540c6bfd4f75e5229a3cd, State: Initialized, Role: FOLLOWER
I20260807 13:54:23.341307 18978 consensus_queue.cc:260] T 16afb6ff06704a8795f1de84ffa81de0 P b77f2b2eade540c6bfd4f75e5229a3cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:23.342037 18978 ts_tablet_manager.cc:1434] T 16afb6ff06704a8795f1de84ffa81de0 P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260807 13:54:23.346359 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-16afb6ff06704a8795f1de84ffa81de0 received from {username='slave'} at 127.23.107.133:50357
I20260807 13:54:23.346547 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-16afb6ff06704a8795f1de84ffa81de0 on tablet 16afb6ff06704a8795f1de84ffa81de0 with peer b77f2b2eade540c6bfd4f75e5229a3cd
I20260807 13:54:23.353178 18862 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap complete.
I20260807 13:54:23.356228 18862 ts_tablet_manager.cc:1403] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5: Time spent bootstrapping tablet: real 0.605s user 0.060s sys 0.004s
I20260807 13:54:23.357784 18862 raft_consensus.cc:359] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:23.377230 18862 raft_consensus.cc:740] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Initialized, Role: FOLLOWER
I20260807 13:54:23.381857 18862 consensus_queue.cc:260] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:23.398567 18862 ts_tablet_manager.cc:1434] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5: Time spent starting tablet: real 0.042s user 0.002s sys 0.000s
I20260807 13:54:23.400377 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session 12ab71778f2f4b378765aaed1a0676a5-96bc42d66fa04fb69afa630969dbb579 received from {username='slave'} at 127.23.107.134:42065
I20260807 13:54:23.400588 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session 12ab71778f2f4b378765aaed1a0676a5-96bc42d66fa04fb69afa630969dbb579 on tablet 96bc42d66fa04fb69afa630969dbb579 with peer 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:54:23.421417 18964 tablet_bootstrap.cc:492] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:23.421960 18964 tablet_bootstrap.cc:492] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap complete.
I20260807 13:54:23.424294 18964 ts_tablet_manager.cc:1403] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.271s user 0.048s sys 0.012s
I20260807 13:54:23.425395 18964 raft_consensus.cc:359] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:23.425681 18964 raft_consensus.cc:740] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:54:23.428330 18964 consensus_queue.cc:260] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:23.429988 18964 ts_tablet_manager.cc:1434] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260807 13:54:23.430734 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session fa83b7af134b4e3b949ac3b4e4bcb5e7-43f5461808a646c885d593f782538930 received from {username='slave'} at 127.23.107.129:37907
I20260807 13:54:23.430928 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session fa83b7af134b4e3b949ac3b4e4bcb5e7-43f5461808a646c885d593f782538930 on tablet 43f5461808a646c885d593f782538930 with peer fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:54:23.504415 7353 raft_consensus.cc:1217] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260807 13:54:23.504961 7179 raft_consensus.cc:1217] T 16afb6ff06704a8795f1de84ffa81de0 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.8->[1.9-1.9] Dedup: 1.9->[]
I20260807 13:54:23.580518 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:23.581862 18929 tablet_bootstrap.cc:492] T 43f5461808a646c885d593f782538930 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:23.582479 18929 tablet_bootstrap.cc:492] T 43f5461808a646c885d593f782538930 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap complete.
I20260807 13:54:23.582792 18929 ts_tablet_manager.cc:1403] T 43f5461808a646c885d593f782538930 P 12ab71778f2f4b378765aaed1a0676a5: Time spent bootstrapping tablet: real 0.564s user 0.064s sys 0.019s
I20260807 13:54:23.583886 18929 raft_consensus.cc:359] T 43f5461808a646c885d593f782538930 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:23.584199 18929 raft_consensus.cc:740] T 43f5461808a646c885d593f782538930 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Initialized, Role: FOLLOWER
I20260807 13:54:23.584491 18929 consensus_queue.cc:260] T 43f5461808a646c885d593f782538930 P 12ab71778f2f4b378765aaed1a0676a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:23.585222 18929 ts_tablet_manager.cc:1434] T 43f5461808a646c885d593f782538930 P 12ab71778f2f4b378765aaed1a0676a5: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 13:54:23.586087 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session 12ab71778f2f4b378765aaed1a0676a5-43f5461808a646c885d593f782538930 received from {username='slave'} at 127.23.107.134:57547
I20260807 13:54:23.586220 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session 12ab71778f2f4b378765aaed1a0676a5-43f5461808a646c885d593f782538930 on tablet 43f5461808a646c885d593f782538930 with peer 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:54:23.641580 18978 ts_tablet_manager.cc:933] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:54:23.669965 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:23.671152 18978 tablet_copy_client.cc:323] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:54:23.672014 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet d27ce55f2acc4513a9fd90a338098eeb from peer b77f2b2eade540c6bfd4f75e5229a3cd ({username='slave'} at 127.23.107.133:50357)
I20260807 13:54:23.672206 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet d27ce55f2acc4513a9fd90a338098eeb from peer b77f2b2eade540c6bfd4f75e5229a3cd at {username='slave'} at 127.23.107.133:50357: session id = b77f2b2eade540c6bfd4f75e5229a3cd-d27ce55f2acc4513a9fd90a338098eeb
I20260807 13:54:23.677081 5101 tablet_copy_source_session.cc:215] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:23.688151 18978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27ce55f2acc4513a9fd90a338098eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:23.689770 7353 raft_consensus.cc:1217] T 43f5461808a646c885d593f782538930 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.8->[1.9-1.9] Dedup: 1.9->[]
I20260807 13:54:23.784919 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:23.792548 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:23.812963 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:23.826406 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:23.828197 18978 tablet_copy_client.cc:806] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:23.828536 18978 tablet_copy_client.cc:670] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:23.848430 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:23.852372 4717 raft_consensus.cc:1217] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.8->[1.9-1.9] Dedup: 1.9->[]
I20260807 13:54:23.861701 18978 tablet_copy_client.cc:538] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:23.866942 18978 tablet_bootstrap.cc:492] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap starting.
I20260807 13:54:23.870539 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:23.875186 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:23.911608 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:23.926949 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:23.949788 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:23.950816 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:23.975984 5068 consensus_queue.cc:237] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:23.984889 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:23.986286 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:23.987972 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:23.994581 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:23.995639 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:24.012683 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:24.018312 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:24.033617 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:24.034194 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:24.044358 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:24.044939 7690 raft_consensus.cc:1275] T 522c3523f2af4eb29e30fa55da2acd3e P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:54:24.045962 18717 consensus_queue.cc:1048] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260807 13:54:24.055088 4982 consensus_peers.cc:597] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 -> Peer 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): Couldn't send request to peer 8a9903f009ff46b4a6875490823076c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 522c3523f2af4eb29e30fa55da2acd3e. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:24.055477 5248 raft_consensus.cc:1275] T 522c3523f2af4eb29e30fa55da2acd3e P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:54:24.056501 18717 consensus_queue.cc:1048] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260807 13:54:24.072780 18933 log.cc:927] Time spent T 04dac80fea124c25b34af8cc290c0d7f P 31d7630573c8475a9f84978d4ebfb879: Append to log took a long time: real 0.106s user 0.001s sys 0.000s
I20260807 13:54:24.092020 18933 tablet_bootstrap.cc:492] T 04dac80fea124c25b34af8cc290c0d7f P 31d7630573c8475a9f84978d4ebfb879: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:24.099114 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:24.112850 18717 raft_consensus.cc:2955] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:24.119098 7690 raft_consensus.cc:2955] T 522c3523f2af4eb29e30fa55da2acd3e P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:24.126379 4515 catalog_manager.cc:5697] T 522c3523f2af4eb29e30fa55da2acd3e P 31d7630573c8475a9f84978d4ebfb879 reported cstate change: config changed from index 5 to 6, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:24.157665 18933 tablet_bootstrap.cc:492] T 04dac80fea124c25b34af8cc290c0d7f P 31d7630573c8475a9f84978d4ebfb879: Bootstrap complete.
I20260807 13:54:24.158080 18933 ts_tablet_manager.cc:1403] T 04dac80fea124c25b34af8cc290c0d7f P 31d7630573c8475a9f84978d4ebfb879: Time spent bootstrapping tablet: real 1.198s user 0.061s sys 0.012s
I20260807 13:54:24.161516 18933 raft_consensus.cc:359] T 04dac80fea124c25b34af8cc290c0d7f P 31d7630573c8475a9f84978d4ebfb879 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:24.161756 18933 raft_consensus.cc:740] T 04dac80fea124c25b34af8cc290c0d7f P 31d7630573c8475a9f84978d4ebfb879 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d7630573c8475a9f84978d4ebfb879, State: Initialized, Role: FOLLOWER
I20260807 13:54:24.162083 18933 consensus_queue.cc:260] T 04dac80fea124c25b34af8cc290c0d7f P 31d7630573c8475a9f84978d4ebfb879 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 3.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:24.162760 18933 ts_tablet_manager.cc:1434] T 04dac80fea124c25b34af8cc290c0d7f P 31d7630573c8475a9f84978d4ebfb879: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260807 13:54:24.166586 5248 raft_consensus.cc:2955] T 522c3523f2af4eb29e30fa55da2acd3e P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:24.169776 7213 tablet_copy_service.cc:342] P b77f2b2eade540c6bfd4f75e5229a3cd: Request end of tablet copy session 31d7630573c8475a9f84978d4ebfb879-04dac80fea124c25b34af8cc290c0d7f received from {username='slave'} at 127.23.107.136:41183
I20260807 13:54:24.169994 7213 tablet_copy_service.cc:434] P b77f2b2eade540c6bfd4f75e5229a3cd: ending tablet copy session 31d7630573c8475a9f84978d4ebfb879-04dac80fea124c25b34af8cc290c0d7f on tablet 04dac80fea124c25b34af8cc290c0d7f with peer 31d7630573c8475a9f84978d4ebfb879
W20260807 13:54:24.241884 5153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.130:37489, user_credentials={real_user=slave}} blocked reactor thread for 49401.3us
I20260807 13:54:24.324015 7690 raft_consensus.cc:1217] T 04dac80fea124c25b34af8cc290c0d7f P 31d7630573c8475a9f84978d4ebfb879 [term 3 FOLLOWER]: Deduplicated request from leader. Original: 3.12->[3.13-3.13] Dedup: 3.13->[]
I20260807 13:54:24.480669 18978 tablet_bootstrap.cc:492] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:24.481135 18978 tablet_bootstrap.cc:492] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap complete.
I20260807 13:54:24.481474 18978 ts_tablet_manager.cc:1403] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent bootstrapping tablet: real 0.615s user 0.045s sys 0.009s
I20260807 13:54:24.482292 18978 raft_consensus.cc:359] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:24.482504 18978 raft_consensus.cc:740] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77f2b2eade540c6bfd4f75e5229a3cd, State: Initialized, Role: FOLLOWER
I20260807 13:54:24.494022 18978 consensus_queue.cc:260] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:24.500422 18978 ts_tablet_manager.cc:1434] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent starting tablet: real 0.019s user 0.000s sys 0.002s
I20260807 13:54:24.507040 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-d27ce55f2acc4513a9fd90a338098eeb received from {username='slave'} at 127.23.107.133:50357
I20260807 13:54:24.507244 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-d27ce55f2acc4513a9fd90a338098eeb on tablet d27ce55f2acc4513a9fd90a338098eeb with peer b77f2b2eade540c6bfd4f75e5229a3cd
I20260807 13:54:24.630813 5248 consensus_queue.cc:237] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:24.662117 7179 raft_consensus.cc:1275] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:24.664956 7522 raft_consensus.cc:1275] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:24.665902 19174 consensus_queue.cc:1048] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260807 13:54:24.667289 5153 consensus_peers.cc:597] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:24.669039 19168 consensus_queue.cc:1048] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:24.678907 7178 raft_consensus.cc:1217] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.5->[1.6-1.6] Dedup: 1.6->[]
I20260807 13:54:24.717754 19240 ts_tablet_manager.cc:933] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:54:24.720852 19168 raft_consensus.cc:2955] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:24.730024 7179 raft_consensus.cc:2955] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:24.749814 7524 raft_consensus.cc:2955] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:24.754467 4515 catalog_manager.cc:5697] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index 7 to 8, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:24.787163 19240 tablet_copy_client.cc:323] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:54:24.793653 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet 522c3523f2af4eb29e30fa55da2acd3e from peer 8a9903f009ff46b4a6875490823076c4 ({username='slave'} at 127.23.107.135:53271)
I20260807 13:54:24.793915 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet 522c3523f2af4eb29e30fa55da2acd3e from peer 8a9903f009ff46b4a6875490823076c4 at {username='slave'} at 127.23.107.135:53271: session id = 8a9903f009ff46b4a6875490823076c4-522c3523f2af4eb29e30fa55da2acd3e
I20260807 13:54:24.804731 5101 tablet_copy_source_session.cc:215] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:24.806784 19240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522c3523f2af4eb29e30fa55da2acd3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:24.813683 19240 tablet_copy_client.cc:806] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:24.813941 19240 tablet_copy_client.cc:670] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:24.818562 19240 tablet_copy_client.cc:538] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:24.826841 19240 tablet_bootstrap.cc:492] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4: Bootstrap starting.
W20260807 13:54:24.870394 4632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.134:35975, user_credentials={real_user=slave}} blocked reactor thread for 143428us
I20260807 13:54:24.966475 19240 tablet_bootstrap.cc:492] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:24.967092 19240 tablet_bootstrap.cc:492] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4: Bootstrap complete.
I20260807 13:54:24.967492 19240 ts_tablet_manager.cc:1403] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4: Time spent bootstrapping tablet: real 0.141s user 0.068s sys 0.036s
I20260807 13:54:24.968621 19240 raft_consensus.cc:359] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:24.969023 19240 raft_consensus.cc:740] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a9903f009ff46b4a6875490823076c4, State: Initialized, Role: FOLLOWER
I20260807 13:54:24.969352 19240 consensus_queue.cc:260] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:24.970078 19240 ts_tablet_manager.cc:1434] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:54:24.971014 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session 8a9903f009ff46b4a6875490823076c4-522c3523f2af4eb29e30fa55da2acd3e received from {username='slave'} at 127.23.107.135:53271
I20260807 13:54:24.971213 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session 8a9903f009ff46b4a6875490823076c4-522c3523f2af4eb29e30fa55da2acd3e on tablet 522c3523f2af4eb29e30fa55da2acd3e with peer 8a9903f009ff46b4a6875490823076c4
I20260807 13:54:25.001991 5248 consensus_queue.cc:237] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
W20260807 13:54:25.016520 5151 consensus_peers.cc:597] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 -> Peer 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729): Couldn't send request to peer 31d7630573c8475a9f84978d4ebfb879. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c10b910e9f354933b60ae70f1baa9b6f. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:25.018249 7353 raft_consensus.cc:1275] T c10b910e9f354933b60ae70f1baa9b6f P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:25.019150 19174 consensus_queue.cc:1048] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:25.024626 7179 raft_consensus.cc:1275] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:25.025357 19174 consensus_queue.cc:1048] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:25.049985 19174 raft_consensus.cc:2955] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:25.057801 7179 raft_consensus.cc:2955] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:25.075476 4520 catalog_manager.cc:5697] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: config changed from index 7 to 8, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:25.080436 7353 raft_consensus.cc:2955] T c10b910e9f354933b60ae70f1baa9b6f P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:25.125733 5248 consensus_queue.cc:237] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
W20260807 13:54:25.143894 5154 consensus_peers.cc:597] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:25.145603 7690 raft_consensus.cc:1275] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:54:25.145964 4892 raft_consensus.cc:1275] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:54:25.146699 19174 consensus_queue.cc:1048] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:54:25.149099 19174 consensus_queue.cc:1048] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:54:25.173517 19174 raft_consensus.cc:2955] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:25.178709 7690 raft_consensus.cc:2955] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:25.196600 4897 raft_consensus.cc:2955] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:25.198645 4520 catalog_manager.cc:5697] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index 5 to 6, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:25.210687 5248 consensus_queue.cc:237] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
W20260807 13:54:25.218187 5153 consensus_peers.cc:597] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e22d4edb78d24783bae07928b6c95fc2. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:25.219591 7690 raft_consensus.cc:1275] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:54:25.220181 19174 consensus_queue.cc:1048] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:54:25.230845 19405 ts_tablet_manager.cc:933] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:54:25.241142 7524 raft_consensus.cc:1217] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.5->[1.6-1.6] Dedup: 1.6->[]
I20260807 13:54:25.242170 19405 tablet_copy_client.cc:323] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:54:25.243044 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet 1715828a5d96455abecae985d1dca004 from peer c9d2944272bc447dafce7620ac2dbd4b ({username='slave'} at 127.23.107.130:56979)
I20260807 13:54:25.243238 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet 1715828a5d96455abecae985d1dca004 from peer c9d2944272bc447dafce7620ac2dbd4b at {username='slave'} at 127.23.107.130:56979: session id = c9d2944272bc447dafce7620ac2dbd4b-1715828a5d96455abecae985d1dca004
I20260807 13:54:25.243952 5068 raft_consensus.cc:1275] T e22d4edb78d24783bae07928b6c95fc2 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:54:25.244880 19174 consensus_queue.cc:1048] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:54:25.246891 5272 tablet_copy_source_session.cc:215] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:25.248495 19405 ts_tablet_manager.cc:1916] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:54:25.260047 19405 ts_tablet_manager.cc:1929] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.5
I20260807 13:54:25.260638 19405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1715828a5d96455abecae985d1dca004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:25.266083 19405 tablet_copy_client.cc:806] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Starting download of 0 data blocks...
W20260807 13:54:25.265944 7613 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.134:35975, user_credentials={real_user=slave}} blocked reactor thread for 56247.4us
I20260807 13:54:25.268218 19405 tablet_copy_client.cc:670] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:25.271515 19405 tablet_copy_client.cc:538] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:25.277055 19405 tablet_bootstrap.cc:492] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:54:25.282598 19174 raft_consensus.cc:2955] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:25.286595 7690 raft_consensus.cc:2955] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:25.295845 5068 raft_consensus.cc:2955] T e22d4edb78d24783bae07928b6c95fc2 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:25.299372 4520 catalog_manager.cc:5697] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 reported cstate change: config changed from index 5 to 6, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:25.448863 19405 tablet_bootstrap.cc:492] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:25.449877 19405 tablet_bootstrap.cc:492] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap complete.
I20260807 13:54:25.450291 19405 ts_tablet_manager.cc:1403] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.173s user 0.064s sys 0.000s
I20260807 13:54:25.451350 19405 raft_consensus.cc:359] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:25.451745 19405 raft_consensus.cc:740] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:54:25.452162 19405 consensus_queue.cc:260] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:25.452898 19405 ts_tablet_manager.cc:1434] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:54:25.454097 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session c9d2944272bc447dafce7620ac2dbd4b-1715828a5d96455abecae985d1dca004 received from {username='slave'} at 127.23.107.130:56979
I20260807 13:54:25.454259 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session c9d2944272bc447dafce7620ac2dbd4b-1715828a5d96455abecae985d1dca004 on tablet 1715828a5d96455abecae985d1dca004 with peer c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:54:25.487263 19483 ts_tablet_manager.cc:933] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:54:25.499068 19483 tablet_copy_client.cc:323] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:54:25.500041 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet c10b910e9f354933b60ae70f1baa9b6f from peer 31d7630573c8475a9f84978d4ebfb879 ({username='slave'} at 127.23.107.136:35045)
I20260807 13:54:25.500236 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet c10b910e9f354933b60ae70f1baa9b6f from peer 31d7630573c8475a9f84978d4ebfb879 at {username='slave'} at 127.23.107.136:35045: session id = 31d7630573c8475a9f84978d4ebfb879-c10b910e9f354933b60ae70f1baa9b6f
I20260807 13:54:25.503356 5272 tablet_copy_source_session.cc:215] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:25.505115 19483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c10b910e9f354933b60ae70f1baa9b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:25.519599 19483 tablet_copy_client.cc:806] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:25.520140 19483 tablet_copy_client.cc:670] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:25.523833 19483 tablet_copy_client.cc:538] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:25.534097 19483 tablet_bootstrap.cc:492] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879: Bootstrap starting.
I20260807 13:54:25.549054 5068 consensus_queue.cc:237] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
W20260807 13:54:25.555229 4982 consensus_peers.cc:597] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 -> Peer 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): Couldn't send request to peer 8a9903f009ff46b4a6875490823076c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eab259b597a64c04869543ccb1d9038c. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:25.556732 7179 raft_consensus.cc:1275] T eab259b597a64c04869543ccb1d9038c P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:25.557698 7353 raft_consensus.cc:1275] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:25.557806 18622 consensus_queue.cc:1048] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:25.558895 18622 consensus_queue.cc:1048] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:25.571193 18622 raft_consensus.cc:2955] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:25.576642 7178 raft_consensus.cc:2955] T eab259b597a64c04869543ccb1d9038c P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:25.585357 4515 catalog_manager.cc:5697] T eab259b597a64c04869543ccb1d9038c P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: config changed from index 7 to 8, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:25.586549 7353 raft_consensus.cc:2955] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:25.590411 5068 consensus_queue.cc:237] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:25.595886 4717 raft_consensus.cc:1275] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:54:25.596742 18622 consensus_queue.cc:1048] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:54:25.597326 7352 raft_consensus.cc:1275] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
W20260807 13:54:25.597435 4979 consensus_peers.cc:597] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 -> Peer 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729): Couldn't send request to peer 31d7630573c8475a9f84978d4ebfb879. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 81cbb42cd4954383976169ec16ef2416. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:25.598623 19245 consensus_queue.cc:1048] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:54:25.605722 19405 ts_tablet_manager.cc:933] T e22d4edb78d24783bae07928b6c95fc2 P c9d2944272bc447dafce7620ac2dbd4b: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:54:25.629041 19405 tablet_copy_client.cc:323] T e22d4edb78d24783bae07928b6c95fc2 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:54:25.630108 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet e22d4edb78d24783bae07928b6c95fc2 from peer c9d2944272bc447dafce7620ac2dbd4b ({username='slave'} at 127.23.107.130:56979)
I20260807 13:54:25.630318 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet e22d4edb78d24783bae07928b6c95fc2 from peer c9d2944272bc447dafce7620ac2dbd4b at {username='slave'} at 127.23.107.130:56979: session id = c9d2944272bc447dafce7620ac2dbd4b-e22d4edb78d24783bae07928b6c95fc2
I20260807 13:54:25.633855 5272 tablet_copy_source_session.cc:215] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:25.636809 19405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e22d4edb78d24783bae07928b6c95fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:25.648325 19525 ts_tablet_manager.cc:933] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:54:25.650717 19245 raft_consensus.cc:2955] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:25.655297 7354 raft_consensus.cc:2955] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:25.661435 19525 tablet_copy_client.cc:323] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:54:25.662436 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet 50a090faa58e4f91961c9251030efacf from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 ({username='slave'} at 127.23.107.129:40357)
I20260807 13:54:25.662631 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet 50a090faa58e4f91961c9251030efacf from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 at {username='slave'} at 127.23.107.129:40357: session id = fa83b7af134b4e3b949ac3b4e4bcb5e7-50a090faa58e4f91961c9251030efacf
I20260807 13:54:25.664029 19483 tablet_bootstrap.cc:492] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:25.664579 19483 tablet_bootstrap.cc:492] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879: Bootstrap complete.
I20260807 13:54:25.664981 19483 ts_tablet_manager.cc:1403] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879: Time spent bootstrapping tablet: real 0.131s user 0.060s sys 0.011s
I20260807 13:54:25.666045 19483 raft_consensus.cc:359] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:25.666383 19483 raft_consensus.cc:740] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d7630573c8475a9f84978d4ebfb879, State: Initialized, Role: FOLLOWER
I20260807 13:54:25.667423 5272 tablet_copy_source_session.cc:215] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:25.668382 19483 consensus_queue.cc:260] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:25.669093 19525 ts_tablet_manager.cc:1916] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:54:25.669299 19483 ts_tablet_manager.cc:1434] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260807 13:54:25.670562 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session 31d7630573c8475a9f84978d4ebfb879-c10b910e9f354933b60ae70f1baa9b6f received from {username='slave'} at 127.23.107.136:35045
I20260807 13:54:25.670792 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session 31d7630573c8475a9f84978d4ebfb879-c10b910e9f354933b60ae70f1baa9b6f on tablet c10b910e9f354933b60ae70f1baa9b6f with peer 31d7630573c8475a9f84978d4ebfb879
I20260807 13:54:25.672602 4520 catalog_manager.cc:5697] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 5 to 6, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:25.674091 19405 tablet_copy_client.cc:806] T e22d4edb78d24783bae07928b6c95fc2 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:25.674378 19405 tablet_copy_client.cc:670] T e22d4edb78d24783bae07928b6c95fc2 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:25.677049 19405 tablet_copy_client.cc:538] T e22d4edb78d24783bae07928b6c95fc2 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:25.682574 4717 raft_consensus.cc:2955] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:25.690671 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:25.694530 19405 tablet_bootstrap.cc:492] T e22d4edb78d24783bae07928b6c95fc2 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:54:25.727070 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:25.733461 19525 ts_tablet_manager.cc:1929] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.4
I20260807 13:54:25.733989 19525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a090faa58e4f91961c9251030efacf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:25.761307 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:25.816922 4892 raft_consensus.cc:1217] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260807 13:54:25.837442 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:25.838759 19525 tablet_copy_client.cc:806] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:25.849167 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:25.839082 19525 tablet_copy_client.cc:670] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:25.861308 19525 tablet_copy_client.cc:538] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:25.865789 19525 tablet_bootstrap.cc:492] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:54:25.884301 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:25.910498 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:25.936061 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:25.973389 19580 ts_tablet_manager.cc:933] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:54:25.985067 4892 consensus_queue.cc:237] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:54:25.993830 19580 tablet_copy_client.cc:323] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:54:25.994853 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet eab259b597a64c04869543ccb1d9038c from peer 8a9903f009ff46b4a6875490823076c4 ({username='slave'} at 127.23.107.135:53271)
I20260807 13:54:25.995009 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet eab259b597a64c04869543ccb1d9038c from peer 8a9903f009ff46b4a6875490823076c4 at {username='slave'} at 127.23.107.135:53271: session id = 8a9903f009ff46b4a6875490823076c4-eab259b597a64c04869543ccb1d9038c
I20260807 13:54:26.003100 5101 tablet_copy_source_session.cc:215] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:26.006625 19580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eab259b597a64c04869543ccb1d9038c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:26.017807 7690 raft_consensus.cc:1217] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260807 13:54:26.022611 19580 tablet_copy_client.cc:806] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:26.022970 19580 tablet_copy_client.cc:670] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:26.037463 19580 tablet_copy_client.cc:538] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260807 13:54:26.040879 4806 consensus_peers.cc:597] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:26.042586 7179 raft_consensus.cc:1275] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:26.043589 7353 raft_consensus.cc:1275] T 312c7ed04e334b08b506c8908224a7da P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:26.043715 19562 consensus_queue.cc:1048] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:26.044325 19116 consensus_queue.cc:1048] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:26.053544 19580 tablet_bootstrap.cc:492] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4: Bootstrap starting.
I20260807 13:54:26.056348 5248 consensus_queue.cc:237] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:54:26.063462 19116 raft_consensus.cc:2955] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:54:26.066097 7178 raft_consensus.cc:2955] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:54:26.074250 19525 tablet_bootstrap.cc:492] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:26.074745 19525 tablet_bootstrap.cc:492] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap complete.
I20260807 13:54:26.075480 19525 ts_tablet_manager.cc:1403] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.210s user 0.054s sys 0.001s
I20260807 13:54:26.076380 19525 raft_consensus.cc:359] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:26.076627 19525 raft_consensus.cc:740] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:54:26.076960 19525 consensus_queue.cc:260] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:26.077795 19525 ts_tablet_manager.cc:1434] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:54:26.078629 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session fa83b7af134b4e3b949ac3b4e4bcb5e7-50a090faa58e4f91961c9251030efacf received from {username='slave'} at 127.23.107.129:40357
I20260807 13:54:26.078850 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session fa83b7af134b4e3b949ac3b4e4bcb5e7-50a090faa58e4f91961c9251030efacf on tablet 50a090faa58e4f91961c9251030efacf with peer fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:54:26.083787 4520 catalog_manager.cc:5697] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: config changed from index 7 to 8, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:54:26.090555 7353 raft_consensus.cc:2955] T 312c7ed04e334b08b506c8908224a7da P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:54:26.103765 7690 raft_consensus.cc:1275] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:26.104755 19423 consensus_queue.cc:1048] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260807 13:54:26.113382 5152 consensus_peers.cc:597] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:26.116894 7353 raft_consensus.cc:1275] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:26.117729 19423 consensus_queue.cc:1048] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:26.123116 19613 raft_consensus.cc:2955] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:26.136191 7690 raft_consensus.cc:2955] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:26.138675 19483 ts_tablet_manager.cc:933] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:54:26.145403 4520 catalog_manager.cc:5697] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 reported cstate change: config changed from index 7 to 8, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:26.156981 19405 tablet_bootstrap.cc:492] T e22d4edb78d24783bae07928b6c95fc2 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:26.157593 19405 tablet_bootstrap.cc:492] T e22d4edb78d24783bae07928b6c95fc2 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap complete.
I20260807 13:54:26.157974 19405 ts_tablet_manager.cc:1403] T e22d4edb78d24783bae07928b6c95fc2 P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.464s user 0.059s sys 0.003s
I20260807 13:54:26.158972 19405 raft_consensus.cc:359] T e22d4edb78d24783bae07928b6c95fc2 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:26.159273 19405 raft_consensus.cc:740] T e22d4edb78d24783bae07928b6c95fc2 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:54:26.159622 19405 consensus_queue.cc:260] T e22d4edb78d24783bae07928b6c95fc2 P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:26.161559 19405 ts_tablet_manager.cc:1434] T e22d4edb78d24783bae07928b6c95fc2 P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:54:26.161466 7353 raft_consensus.cc:2955] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:26.162649 19483 tablet_copy_client.cc:323] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:54:26.164953 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet 81cbb42cd4954383976169ec16ef2416 from peer 31d7630573c8475a9f84978d4ebfb879 ({username='slave'} at 127.23.107.136:39013)
I20260807 13:54:26.165109 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet 81cbb42cd4954383976169ec16ef2416 from peer 31d7630573c8475a9f84978d4ebfb879 at {username='slave'} at 127.23.107.136:39013: session id = 31d7630573c8475a9f84978d4ebfb879-81cbb42cd4954383976169ec16ef2416
I20260807 13:54:26.169677 5101 tablet_copy_source_session.cc:215] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:26.171288 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session c9d2944272bc447dafce7620ac2dbd4b-e22d4edb78d24783bae07928b6c95fc2 received from {username='slave'} at 127.23.107.130:56979
I20260807 13:54:26.171469 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session c9d2944272bc447dafce7620ac2dbd4b-e22d4edb78d24783bae07928b6c95fc2 on tablet e22d4edb78d24783bae07928b6c95fc2 with peer c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:54:26.171890 19483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81cbb42cd4954383976169ec16ef2416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:26.198534 19483 tablet_copy_client.cc:806] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:26.199517 19483 tablet_copy_client.cc:670] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:26.212356 19483 tablet_copy_client.cc:538] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:26.221932 19483 tablet_bootstrap.cc:492] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap starting.
I20260807 13:54:26.222510 4717 raft_consensus.cc:1217] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.5->[1.6-1.6] Dedup: 1.6->[]
I20260807 13:54:26.345289 19483 tablet_bootstrap.cc:492] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:26.345940 19483 tablet_bootstrap.cc:492] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap complete.
I20260807 13:54:26.346284 19483 ts_tablet_manager.cc:1403] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879: Time spent bootstrapping tablet: real 0.124s user 0.067s sys 0.003s
I20260807 13:54:26.347615 19483 raft_consensus.cc:359] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:26.347921 19483 raft_consensus.cc:740] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d7630573c8475a9f84978d4ebfb879, State: Initialized, Role: FOLLOWER
I20260807 13:54:26.348361 19483 consensus_queue.cc:260] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:26.348982 19483 ts_tablet_manager.cc:1434] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260807 13:54:26.349897 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session 31d7630573c8475a9f84978d4ebfb879-81cbb42cd4954383976169ec16ef2416 received from {username='slave'} at 127.23.107.136:39013
I20260807 13:54:26.350045 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session 31d7630573c8475a9f84978d4ebfb879-81cbb42cd4954383976169ec16ef2416 on tablet 81cbb42cd4954383976169ec16ef2416 with peer 31d7630573c8475a9f84978d4ebfb879
I20260807 13:54:26.446305 4897 consensus_queue.cc:237] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
W20260807 13:54:26.449700 4806 consensus_peers.cc:597] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260807 13:54:26.451689 4804 consensus_peers.cc:597] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:26.452780 7353 raft_consensus.cc:1275] T 312c7ed04e334b08b506c8908224a7da P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:26.453835 19611 consensus_queue.cc:1048] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:26.449313 19580 tablet_bootstrap.cc:492] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:26.458348 7179 raft_consensus.cc:1275] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:26.459244 19611 consensus_queue.cc:1048] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:26.460722 19580 tablet_bootstrap.cc:492] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4: Bootstrap complete.
I20260807 13:54:26.461045 19580 ts_tablet_manager.cc:1403] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4: Time spent bootstrapping tablet: real 0.408s user 0.061s sys 0.002s
I20260807 13:54:26.462057 19580 raft_consensus.cc:359] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:26.462280 19580 raft_consensus.cc:740] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a9903f009ff46b4a6875490823076c4, State: Initialized, Role: FOLLOWER
I20260807 13:54:26.462574 19580 consensus_queue.cc:260] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:26.463289 19611 raft_consensus.cc:2955] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:26.465042 7179 raft_consensus.cc:2955] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:26.470511 19580 ts_tablet_manager.cc:1434] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4: Time spent starting tablet: real 0.009s user 0.001s sys 0.002s
I20260807 13:54:26.471771 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session 8a9903f009ff46b4a6875490823076c4-eab259b597a64c04869543ccb1d9038c received from {username='slave'} at 127.23.107.135:53271
I20260807 13:54:26.471926 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session 8a9903f009ff46b4a6875490823076c4-eab259b597a64c04869543ccb1d9038c on tablet eab259b597a64c04869543ccb1d9038c with peer 8a9903f009ff46b4a6875490823076c4
I20260807 13:54:26.492556 4520 catalog_manager.cc:5697] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: config changed from index 8 to 9, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) added. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:26.496919 7353 raft_consensus.cc:2955] T 312c7ed04e334b08b506c8908224a7da P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:26.549002 19756 ts_tablet_manager.cc:933] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:54:26.567481 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:26.575634 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:26.583683 4897 raft_consensus.cc:1217] T e22d4edb78d24783bae07928b6c95fc2 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.5->[1.6-1.6] Dedup: 1.6->[]
I20260807 13:54:26.589448 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:26.596236 19756 tablet_copy_client.cc:323] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:54:26.597090 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet 80898a5a2cf046f1b7344dfceb175bbd from peer 01adf83af3e04875b5fac9470d4da915 ({username='slave'} at 127.23.107.131:56855)
I20260807 13:54:26.597280 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet 80898a5a2cf046f1b7344dfceb175bbd from peer 01adf83af3e04875b5fac9470d4da915 at {username='slave'} at 127.23.107.131:56855: session id = 01adf83af3e04875b5fac9470d4da915-80898a5a2cf046f1b7344dfceb175bbd
I20260807 13:54:26.600656 5272 tablet_copy_source_session.cc:215] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:26.602669 19756 ts_tablet_manager.cc:1916] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:54:26.610467 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:26.622411 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:26.636247 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:26.639667 4717 consensus_queue.cc:237] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:54:26.654773 7179 raft_consensus.cc:1275] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:26.655478 19085 consensus_queue.cc:1048] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:26.659528 5068 raft_consensus.cc:1275] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:26.660279 19085 consensus_queue.cc:1048] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:26.661796 7690 raft_consensus.cc:1217] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.5->[1.6-1.6] Dedup: 1.6->[]
I20260807 13:54:26.669157 19756 ts_tablet_manager.cc:1929] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.4
I20260807 13:54:26.669514 19756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80898a5a2cf046f1b7344dfceb175bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:26.688613 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:26.704756 19790 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:26.708133 7179 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:26.711794 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:26.719983 4520 catalog_manager.cc:5697] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: config changed from index 8 to 9, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:26.720842 19756 tablet_copy_client.cc:806] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:26.721140 19756 tablet_copy_client.cc:670] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:26.724864 4865 tablet_service.cc:1558] Processing DeleteTablet for tablet 966ebd287fc14e498e5bd3e6542194ca with delete_type TABLET_DATA_TOMBSTONED (TS c9d2944272bc447dafce7620ac2dbd4b not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:36624
I20260807 13:54:26.741731 5072 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:26.750365 19796 tablet_replica.cc:333] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: stopping tablet replica
I20260807 13:54:26.750742 19796 raft_consensus.cc:2243] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:26.754590 19796 raft_consensus.cc:2272] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:26.757398 19756 tablet_copy_client.cc:538] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:26.767000 19756 tablet_bootstrap.cc:492] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:54:26.760574 19796 ts_tablet_manager.cc:1916] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:26.853279 19796 ts_tablet_manager.cc:1929] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260807 13:54:26.864212 19796 log.cc:1199] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/966ebd287fc14e498e5bd3e6542194ca
I20260807 13:54:26.866091 4505 catalog_manager.cc:5028] TS c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): tablet 966ebd287fc14e498e5bd3e6542194ca (table rebalance_test_table_6 [id=6008038c907645199b055dacb5772621]) successfully deleted
I20260807 13:54:26.895289 19756 tablet_bootstrap.cc:492] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:26.895768 19756 tablet_bootstrap.cc:492] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915: Bootstrap complete.
I20260807 13:54:26.896181 19756 ts_tablet_manager.cc:1403] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.129s user 0.050s sys 0.001s
I20260807 13:54:26.896951 19756 raft_consensus.cc:359] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:54:26.899142 19756 raft_consensus.cc:740] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:54:26.899432 19756 consensus_queue.cc:260] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:54:26.900046 19756 ts_tablet_manager.cc:1434] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260807 13:54:26.900835 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session 01adf83af3e04875b5fac9470d4da915-80898a5a2cf046f1b7344dfceb175bbd received from {username='slave'} at 127.23.107.131:56855
I20260807 13:54:26.900998 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session 01adf83af3e04875b5fac9470d4da915-80898a5a2cf046f1b7344dfceb175bbd on tablet 80898a5a2cf046f1b7344dfceb175bbd with peer 01adf83af3e04875b5fac9470d4da915
I20260807 13:54:26.924717 7524 raft_consensus.cc:1217] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260807 13:54:26.940253 19756 ts_tablet_manager.cc:933] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915: Initiating tablet copy from peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:54:26.953634 19756 tablet_copy_client.cc:323] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.130:37489
I20260807 13:54:26.954697 4921 tablet_copy_service.cc:140] P c9d2944272bc447dafce7620ac2dbd4b: Received BeginTabletCopySession request for tablet 312c7ed04e334b08b506c8908224a7da from peer 01adf83af3e04875b5fac9470d4da915 ({username='slave'} at 127.23.107.131:58793)
I20260807 13:54:26.954908 4921 tablet_copy_service.cc:161] P c9d2944272bc447dafce7620ac2dbd4b: Beginning new tablet copy session on tablet 312c7ed04e334b08b506c8908224a7da from peer 01adf83af3e04875b5fac9470d4da915 at {username='slave'} at 127.23.107.131:58793: session id = 01adf83af3e04875b5fac9470d4da915-312c7ed04e334b08b506c8908224a7da
I20260807 13:54:26.956862 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:26.960165 4921 tablet_copy_source_session.cc:215] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:26.970384 19756 ts_tablet_manager.cc:1916] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:54:26.976390 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:26.979403 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:26.998695 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:27.036124 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:27.036062 19756 ts_tablet_manager.cc:1929] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.4
I20260807 13:54:27.036633 19756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 312c7ed04e334b08b506c8908224a7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:27.049306 19756 tablet_copy_client.cc:806] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:27.049670 19756 tablet_copy_client.cc:670] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:27.056173 19756 tablet_copy_client.cc:538] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:27.067224 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:27.091173 19756 tablet_bootstrap.cc:492] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:54:27.110195 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:27.130141 5072 raft_consensus.cc:1217] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260807 13:54:27.141780 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:27.213550 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:27.218040 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260807 13:54:27.279594 4805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.133:38075, user_credentials={real_user=slave}} blocked reactor thread for 65047.3us
I20260807 13:54:27.292920 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:27.295742 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:27.301105 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:27.312794 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:27.337066 19839 ts_tablet_manager.cc:933] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179: Initiating tablet copy from peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:54:27.366343 19839 tablet_copy_client.cc:323] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.130:37489
I20260807 13:54:27.368789 4921 tablet_copy_service.cc:140] P c9d2944272bc447dafce7620ac2dbd4b: Received BeginTabletCopySession request for tablet 312c7ed04e334b08b506c8908224a7da from peer edf940ebcc1140cfa0c23214e0c0f179 ({username='slave'} at 127.23.107.132:57871)
I20260807 13:54:27.369091 4921 tablet_copy_service.cc:161] P c9d2944272bc447dafce7620ac2dbd4b: Beginning new tablet copy session on tablet 312c7ed04e334b08b506c8908224a7da from peer edf940ebcc1140cfa0c23214e0c0f179 at {username='slave'} at 127.23.107.132:57871: session id = edf940ebcc1140cfa0c23214e0c0f179-312c7ed04e334b08b506c8908224a7da
I20260807 13:54:27.372902 4921 tablet_copy_source_session.cc:215] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:27.374316 19839 ts_tablet_manager.cc:1916] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:54:27.388702 19839 ts_tablet_manager.cc:1929] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.5
I20260807 13:54:27.389101 19839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 312c7ed04e334b08b506c8908224a7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:27.397959 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:27.461938 19839 tablet_copy_client.cc:806] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:27.462280 19839 tablet_copy_client.cc:670] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:27.464561 19839 tablet_copy_client.cc:538] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:27.480199 19839 tablet_bootstrap.cc:492] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:54:27.521627 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:27.623502 19756 tablet_bootstrap.cc:492] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:27.624017 19756 tablet_bootstrap.cc:492] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915: Bootstrap complete.
I20260807 13:54:27.624363 19756 ts_tablet_manager.cc:1403] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.533s user 0.056s sys 0.004s
I20260807 13:54:27.625329 19756 raft_consensus.cc:359] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:54:27.635756 19756 raft_consensus.cc:740] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:54:27.636044 19756 consensus_queue.cc:260] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:54:27.640852 19756 ts_tablet_manager.cc:1434] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.015s user 0.004s sys 0.000s
I20260807 13:54:27.642427 4921 tablet_copy_service.cc:342] P c9d2944272bc447dafce7620ac2dbd4b: Request end of tablet copy session 01adf83af3e04875b5fac9470d4da915-312c7ed04e334b08b506c8908224a7da received from {username='slave'} at 127.23.107.131:58793
I20260807 13:54:27.642588 4921 tablet_copy_service.cc:434] P c9d2944272bc447dafce7620ac2dbd4b: ending tablet copy session 01adf83af3e04875b5fac9470d4da915-312c7ed04e334b08b506c8908224a7da on tablet 312c7ed04e334b08b506c8908224a7da with peer 01adf83af3e04875b5fac9470d4da915
I20260807 13:54:27.911291 19839 tablet_bootstrap.cc:492] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:27.911793 19839 tablet_bootstrap.cc:492] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap complete.
I20260807 13:54:27.912524 19839 ts_tablet_manager.cc:1403] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.432s user 0.060s sys 0.005s
I20260807 13:54:27.913301 19839 raft_consensus.cc:359] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:54:27.913553 19839 raft_consensus.cc:740] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:54:27.913825 19839 consensus_queue.cc:260] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:54:27.914579 19839 ts_tablet_manager.cc:1434] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:54:27.925798 4921 tablet_copy_service.cc:342] P c9d2944272bc447dafce7620ac2dbd4b: Request end of tablet copy session edf940ebcc1140cfa0c23214e0c0f179-312c7ed04e334b08b506c8908224a7da received from {username='slave'} at 127.23.107.132:57871
I20260807 13:54:27.925951 4921 tablet_copy_service.cc:434] P c9d2944272bc447dafce7620ac2dbd4b: ending tablet copy session edf940ebcc1140cfa0c23214e0c0f179-312c7ed04e334b08b506c8908224a7da on tablet 312c7ed04e334b08b506c8908224a7da with peer edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:54:28.003779 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:28.022979 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:28.040026 5248 consensus_queue.cc:237] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
W20260807 13:54:28.049463 5154 consensus_peers.cc:597] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 242a68df09cb4c7d9522a33d259ebf78. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:28.054155 7690 raft_consensus.cc:1275] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:28.055001 19841 consensus_queue.cc:1048] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:28.069555 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:28.088042 5248 raft_consensus.cc:1217] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.8->[1.9-1.9] Dedup: 1.9->[]
I20260807 13:54:28.115363 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:28.118048 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:28.131994 5072 raft_consensus.cc:1275] T 242a68df09cb4c7d9522a33d259ebf78 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:28.132834 5072 raft_consensus.cc:1217] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.8->[1.9-1.9] Dedup: 1.9->[]
I20260807 13:54:28.133806 19841 consensus_queue.cc:1048] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:28.139681 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:28.167906 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:28.174454 19841 raft_consensus.cc:2955] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:28.178839 7179 consensus_queue.cc:237] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 3.13, Last appended by leader: 8, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:54:28.182855 5072 raft_consensus.cc:2955] T 242a68df09cb4c7d9522a33d259ebf78 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:28.184573 7690 raft_consensus.cc:2955] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:28.192077 4520 catalog_manager.cc:5697] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879 reported cstate change: config changed from index 7 to 8, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:28.203689 7353 raft_consensus.cc:1275] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 13. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260807 13:54:28.204672 17431 consensus_queue.cc:1048] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260807 13:54:28.207089 7690 raft_consensus.cc:1275] T 04dac80fea124c25b34af8cc290c0d7f P 31d7630573c8475a9f84978d4ebfb879 [term 3 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 13. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260807 13:54:28.218327 20027 consensus_queue.cc:1048] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260807 13:54:28.218771 7102 consensus_peers.cc:597] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:28.243877 17431 raft_consensus.cc:2955] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [term 3 LEADER]: Committing config change with OpId 3.14: config changed from index 13 to 14, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:54:28.244279 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:28.254377 7353 raft_consensus.cc:2955] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Committing config change with OpId 3.14: config changed from index 13 to 14, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:54:28.279130 4516 catalog_manager.cc:5697] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: config changed from index 13 to 14, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New cstate: current_term: 3 leader_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:54:28.407375 7690 raft_consensus.cc:2955] T 04dac80fea124c25b34af8cc290c0d7f P 31d7630573c8475a9f84978d4ebfb879 [term 3 FOLLOWER]: Committing config change with OpId 3.14: config changed from index 13 to 14, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:54:28.414117 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:28.430294 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:28.439078 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:28.460902 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:28.501705 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:28.510514 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:28.533630 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:28.535776 5072 consensus_queue.cc:237] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:28.569093 7524 raft_consensus.cc:1275] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20260807 13:54:28.570422 4717 raft_consensus.cc:1275] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20260807 13:54:28.570710 19891 consensus_queue.cc:1048] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260807 13:54:28.573594 4981 consensus_peers.cc:597] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ffa98a163d7540e3a911a39334657138. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:28.576203 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:54:28.614550 4982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.135:40385, user_credentials={real_user=slave}} blocked reactor thread for 44540.2us
I20260807 13:54:28.656818 19891 consensus_queue.cc:1048] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260807 13:54:28.712690 20103 ts_tablet_manager.cc:933] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:54:28.718550 20131 ts_tablet_manager.cc:933] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179: Initiating tablet copy from peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075)
I20260807 13:54:28.720247 7690 consensus_queue.cc:237] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 2.8, Last appended by leader: 5, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:28.721650 20103 tablet_copy_client.cc:323] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:54:28.722724 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet 242a68df09cb4c7d9522a33d259ebf78 from peer 12ab71778f2f4b378765aaed1a0676a5 ({username='slave'} at 127.23.107.134:42065)
I20260807 13:54:28.722914 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet 242a68df09cb4c7d9522a33d259ebf78 from peer 12ab71778f2f4b378765aaed1a0676a5 at {username='slave'} at 127.23.107.134:42065: session id = 12ab71778f2f4b378765aaed1a0676a5-242a68df09cb4c7d9522a33d259ebf78
I20260807 13:54:28.729624 5272 tablet_copy_source_session.cc:215] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
W20260807 13:54:28.734742 7613 consensus_peers.cc:597] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:28.735390 20103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242a68df09cb4c7d9522a33d259ebf78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:28.736263 5068 raft_consensus.cc:1275] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Refusing update from remote peer 31d7630573c8475a9f84978d4ebfb879: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260807 13:54:28.737010 7353 raft_consensus.cc:1275] T b414c896ad884facb339e5e4a0329065 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Refusing update from remote peer 31d7630573c8475a9f84978d4ebfb879: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260807 13:54:28.738245 18671 consensus_queue.cc:1048] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:28.738948 18671 consensus_queue.cc:1048] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:28.761605 20104 raft_consensus.cc:2955] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:28.772676 18671 raft_consensus.cc:2955] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [term 2 LEADER]: Committing config change with OpId 2.9: config changed from index 8 to 9, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:28.777968 5068 raft_consensus.cc:2955] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Committing config change with OpId 2.9: config changed from index 8 to 9, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:28.783519 7524 raft_consensus.cc:2955] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:28.784188 4516 catalog_manager.cc:5697] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 11 to 12, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:28.795058 20131 tablet_copy_client.cc:323] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.133:38075
I20260807 13:54:28.796029 7213 tablet_copy_service.cc:140] P b77f2b2eade540c6bfd4f75e5229a3cd: Received BeginTabletCopySession request for tablet 04dac80fea124c25b34af8cc290c0d7f from peer edf940ebcc1140cfa0c23214e0c0f179 ({username='slave'} at 127.23.107.132:44429)
I20260807 13:54:28.796258 7213 tablet_copy_service.cc:161] P b77f2b2eade540c6bfd4f75e5229a3cd: Beginning new tablet copy session on tablet 04dac80fea124c25b34af8cc290c0d7f from peer edf940ebcc1140cfa0c23214e0c0f179 at {username='slave'} at 127.23.107.132:44429: session id = edf940ebcc1140cfa0c23214e0c0f179-04dac80fea124c25b34af8cc290c0d7f
I20260807 13:54:28.797402 4717 raft_consensus.cc:2955] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:28.799896 20103 tablet_copy_client.cc:806] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:28.800163 20103 tablet_copy_client.cc:670] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:28.800788 7213 tablet_copy_source_session.cc:215] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:28.806105 20103 tablet_copy_client.cc:538] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:28.810861 20103 tablet_bootstrap.cc:492] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap starting.
I20260807 13:54:28.813548 7353 raft_consensus.cc:2955] T b414c896ad884facb339e5e4a0329065 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Committing config change with OpId 2.9: config changed from index 8 to 9, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:28.826439 4515 catalog_manager.cc:5697] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 8 to 9, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New cstate: current_term: 2 leader_uuid: "31d7630573c8475a9f84978d4ebfb879" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:28.866525 20131 ts_tablet_manager.cc:1916] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:54:28.874639 20131 ts_tablet_manager.cc:1929] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.4
I20260807 13:54:28.874934 20131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04dac80fea124c25b34af8cc290c0d7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:28.878769 20131 tablet_copy_client.cc:806] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:28.879117 20131 tablet_copy_client.cc:670] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:28.880990 20131 tablet_copy_client.cc:538] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:28.887960 20131 tablet_bootstrap.cc:492] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:54:28.919291 20103 tablet_bootstrap.cc:492] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:28.920042 20103 tablet_bootstrap.cc:492] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap complete.
I20260807 13:54:28.920464 20103 ts_tablet_manager.cc:1403] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5: Time spent bootstrapping tablet: real 0.110s user 0.059s sys 0.008s
I20260807 13:54:28.923804 20103 raft_consensus.cc:359] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:28.924052 20103 raft_consensus.cc:740] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Initialized, Role: FOLLOWER
I20260807 13:54:28.925536 20103 consensus_queue.cc:260] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:28.926112 20103 ts_tablet_manager.cc:1434] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260807 13:54:28.926826 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session 12ab71778f2f4b378765aaed1a0676a5-242a68df09cb4c7d9522a33d259ebf78 received from {username='slave'} at 127.23.107.134:42065
I20260807 13:54:28.926956 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session 12ab71778f2f4b378765aaed1a0676a5-242a68df09cb4c7d9522a33d259ebf78 on tablet 242a68df09cb4c7d9522a33d259ebf78 with peer 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:54:29.059332 20190 ts_tablet_manager.cc:933] T ffa98a163d7540e3a911a39334657138 P c9d2944272bc447dafce7620ac2dbd4b: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:54:29.066171 20190 tablet_copy_client.cc:323] T ffa98a163d7540e3a911a39334657138 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:54:29.067086 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet ffa98a163d7540e3a911a39334657138 from peer c9d2944272bc447dafce7620ac2dbd4b ({username='slave'} at 127.23.107.130:47105)
I20260807 13:54:29.067261 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet ffa98a163d7540e3a911a39334657138 from peer c9d2944272bc447dafce7620ac2dbd4b at {username='slave'} at 127.23.107.130:47105: session id = c9d2944272bc447dafce7620ac2dbd4b-ffa98a163d7540e3a911a39334657138
I20260807 13:54:29.070740 5101 tablet_copy_source_session.cc:215] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:29.072768 20190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa98a163d7540e3a911a39334657138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:29.086014 7353 raft_consensus.cc:1217] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260807 13:54:29.103646 20131 tablet_bootstrap.cc:492] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:29.104261 20131 tablet_bootstrap.cc:492] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap complete.
I20260807 13:54:29.104581 20131 ts_tablet_manager.cc:1403] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.217s user 0.064s sys 0.005s
I20260807 13:54:29.105695 20131 raft_consensus.cc:359] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:54:29.105948 20131 raft_consensus.cc:740] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:54:29.106194 20131 consensus_queue.cc:260] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 3.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:54:29.106962 20131 ts_tablet_manager.cc:1434] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
I20260807 13:54:29.107631 7213 tablet_copy_service.cc:342] P b77f2b2eade540c6bfd4f75e5229a3cd: Request end of tablet copy session edf940ebcc1140cfa0c23214e0c0f179-04dac80fea124c25b34af8cc290c0d7f received from {username='slave'} at 127.23.107.132:44429
I20260807 13:54:29.107781 7213 tablet_copy_service.cc:434] P b77f2b2eade540c6bfd4f75e5229a3cd: ending tablet copy session edf940ebcc1140cfa0c23214e0c0f179-04dac80fea124c25b34af8cc290c0d7f on tablet 04dac80fea124c25b34af8cc290c0d7f with peer edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:54:29.122906 20190 tablet_copy_client.cc:806] T ffa98a163d7540e3a911a39334657138 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:29.123245 20190 tablet_copy_client.cc:670] T ffa98a163d7540e3a911a39334657138 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:29.125595 20190 tablet_copy_client.cc:538] T ffa98a163d7540e3a911a39334657138 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:29.132952 20190 tablet_bootstrap.cc:492] T ffa98a163d7540e3a911a39334657138 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:54:29.195811 20225 ts_tablet_manager.cc:933] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Initiating tablet copy from peer 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729)
I20260807 13:54:29.202195 20225 tablet_copy_client.cc:323] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.136:43729
I20260807 13:54:29.203101 7712 tablet_copy_service.cc:140] P 31d7630573c8475a9f84978d4ebfb879: Received BeginTabletCopySession request for tablet b414c896ad884facb339e5e4a0329065 from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 ({username='slave'} at 127.23.107.129:35217)
I20260807 13:54:29.203280 7712 tablet_copy_service.cc:161] P 31d7630573c8475a9f84978d4ebfb879: Beginning new tablet copy session on tablet b414c896ad884facb339e5e4a0329065 from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 at {username='slave'} at 127.23.107.129:35217: session id = fa83b7af134b4e3b949ac3b4e4bcb5e7-b414c896ad884facb339e5e4a0329065
I20260807 13:54:29.206370 7712 tablet_copy_source_session.cc:215] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:29.214460 20225 ts_tablet_manager.cc:1916] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:54:29.242693 20225 ts_tablet_manager.cc:1929] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.4
I20260807 13:54:29.244596 20225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b414c896ad884facb339e5e4a0329065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:29.248109 20225 tablet_copy_client.cc:806] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:29.252857 20225 tablet_copy_client.cc:670] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:29.254998 20225 tablet_copy_client.cc:538] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:29.258705 20225 tablet_bootstrap.cc:492] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:54:29.283717 20190 tablet_bootstrap.cc:492] T ffa98a163d7540e3a911a39334657138 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:29.283720 5248 consensus_queue.cc:237] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:29.284394 20190 tablet_bootstrap.cc:492] T ffa98a163d7540e3a911a39334657138 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap complete.
I20260807 13:54:29.284780 20190 ts_tablet_manager.cc:1403] T ffa98a163d7540e3a911a39334657138 P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.152s user 0.062s sys 0.023s
I20260807 13:54:29.285663 20190 raft_consensus.cc:359] T ffa98a163d7540e3a911a39334657138 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:29.285960 20190 raft_consensus.cc:740] T ffa98a163d7540e3a911a39334657138 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:54:29.286336 20190 consensus_queue.cc:260] T ffa98a163d7540e3a911a39334657138 P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:29.287817 5246 raft_consensus.cc:1217] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179 [term 3 FOLLOWER]: Deduplicated request from leader. Original: 3.13->[3.14-3.14] Dedup: 3.14->[]
I20260807 13:54:29.288776 20190 ts_tablet_manager.cc:1434] T ffa98a163d7540e3a911a39334657138 P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260807 13:54:29.289572 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session c9d2944272bc447dafce7620ac2dbd4b-ffa98a163d7540e3a911a39334657138 received from {username='slave'} at 127.23.107.130:47105
I20260807 13:54:29.289705 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session c9d2944272bc447dafce7620ac2dbd4b-ffa98a163d7540e3a911a39334657138 on tablet ffa98a163d7540e3a911a39334657138 with peer c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:54:29.303329 4897 raft_consensus.cc:1275] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:54:29.304584 19841 consensus_queue.cc:1048] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:29.318361 7690 raft_consensus.cc:1275] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:54:29.319298 19841 consensus_queue.cc:1048] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:29.324340 19622 raft_consensus.cc:2955] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:29.330842 4897 raft_consensus.cc:2955] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:29.358435 4516 catalog_manager.cc:5697] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index 6 to 7, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:29.386857 7690 raft_consensus.cc:2955] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:29.428117 4688 tablet_service.cc:1558] Processing DeleteTablet for tablet 50a090faa58e4f91961c9251030efacf with delete_type TABLET_DATA_TOMBSTONED (TS fa83b7af134b4e3b949ac3b4e4bcb5e7 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:56314
I20260807 13:54:29.430425 20294 tablet_replica.cc:333] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: stopping tablet replica
I20260807 13:54:29.430785 20294 raft_consensus.cc:2243] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:29.431090 20294 raft_consensus.cc:2272] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:29.432412 20294 ts_tablet_manager.cc:1916] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:29.439745 20294 ts_tablet_manager.cc:1929] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20260807 13:54:29.439898 20294 log.cc:1199] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/wals/50a090faa58e4f91961c9251030efacf
I20260807 13:54:29.440618 4506 catalog_manager.cc:5028] TS fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): tablet 50a090faa58e4f91961c9251030efacf (table rebalance_test_table_8 [id=91303cf8b9064e06b8c4165942b287f2]) successfully deleted
I20260807 13:54:29.513870 20225 tablet_bootstrap.cc:492] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:29.514309 20225 tablet_bootstrap.cc:492] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap complete.
I20260807 13:54:29.516579 20225 ts_tablet_manager.cc:1403] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.258s user 0.050s sys 0.011s
I20260807 13:54:29.525434 20225 raft_consensus.cc:359] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:29.525791 20225 raft_consensus.cc:740] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:54:29.541203 20225 consensus_queue.cc:260] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 2.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:29.548000 20225 ts_tablet_manager.cc:1434] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.031s user 0.002s sys 0.000s
I20260807 13:54:29.549319 7712 tablet_copy_service.cc:342] P 31d7630573c8475a9f84978d4ebfb879: Request end of tablet copy session fa83b7af134b4e3b949ac3b4e4bcb5e7-b414c896ad884facb339e5e4a0329065 received from {username='slave'} at 127.23.107.129:35217
I20260807 13:54:29.549510 7712 tablet_copy_service.cc:434] P 31d7630573c8475a9f84978d4ebfb879: ending tablet copy session fa83b7af134b4e3b949ac3b4e4bcb5e7-b414c896ad884facb339e5e4a0329065 on tablet b414c896ad884facb339e5e4a0329065 with peer fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:54:29.569944 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:29.599617 4897 raft_consensus.cc:1217] T ffa98a163d7540e3a911a39334657138 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.11->[1.12-1.12] Dedup: 1.12->[]
I20260807 13:54:29.634052 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:29.654587 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:29.693141 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:29.705071 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:29.734915 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:29.795383 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:29.795507 4715 raft_consensus.cc:1217] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 2.8->[2.9-2.9] Dedup: 2.9->[]
I20260807 13:54:29.798228 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:29.884358 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:29.949997 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:29.983824 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:30.011480 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:30.012110 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:30.013273 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:30.043171 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:30.063941 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:30.092067 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:30.113597 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:30.138232 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:30.148918 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:30.193202 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:30.202718 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:30.207970 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:30.212064 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:30.213125 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:30.229518 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:30.267860 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:30.309147 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:30.354138 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:30.365765 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:30.406631 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:30.430759 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:31.022833 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:31.059311 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:31.097209 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:31.101747 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:31.162171 4715 consensus_queue.cc:237] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:31.192219 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:31.207882 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:31.210988 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:31.236415 7179 raft_consensus.cc:1275] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260807 13:54:31.236799 5072 raft_consensus.cc:1275] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260807 13:54:31.237869 20326 consensus_queue.cc:1048] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260807 13:54:31.239966 4631 consensus_peers.cc:597] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:31.241245 20326 consensus_queue.cc:1048] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:31.274446 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:31.283026 5248 consensus_queue.cc:237] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:54:31.292757 20575 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:31.293985 5072 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:31.299078 7353 consensus_queue.cc:237] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 2.8, Last appended by leader: 5, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:31.303664 4513 catalog_manager.cc:5697] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 9 to 10, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
W20260807 13:54:31.320179 7273 consensus_peers.cc:597] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:31.321704 7690 raft_consensus.cc:1275] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260807 13:54:31.322458 19355 consensus_queue.cc:1048] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:31.323050 4715 raft_consensus.cc:1275] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260807 13:54:31.323751 19355 consensus_queue.cc:1048] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:31.350505 5072 raft_consensus.cc:1275] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:31.351214 20475 consensus_queue.cc:1048] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:31.354792 7687 raft_consensus.cc:1275] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:31.359826 20475 consensus_queue.cc:1048] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:31.404739 20475 raft_consensus.cc:2955] T 80898a5a2cf046f1b7344dfceb175bbd P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:31.416723 7179 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:31.417028 5068 raft_consensus.cc:2955] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:31.420468 7688 raft_consensus.cc:2955] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:31.435602 19355 raft_consensus.cc:2955] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 LEADER]: Committing config change with OpId 2.9: config changed from index 8 to 9, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:31.447263 7688 raft_consensus.cc:2955] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Committing config change with OpId 2.9: config changed from index 8 to 9, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:31.453672 4513 catalog_manager.cc:5697] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 reported cstate change: config changed from index 8 to 9, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:31.456472 4715 raft_consensus.cc:2955] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Committing config change with OpId 2.9: config changed from index 8 to 9, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:31.458835 7327 tablet_service.cc:1558] Processing DeleteTablet for tablet 80898a5a2cf046f1b7344dfceb175bbd with delete_type TABLET_DATA_TOMBSTONED (TS 12ab71778f2f4b378765aaed1a0676a5 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:47002
I20260807 13:54:31.461617 20611 tablet_replica.cc:333] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5: stopping tablet replica
I20260807 13:54:31.462293 20611 raft_consensus.cc:2243] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:31.462323 4513 catalog_manager.cc:5697] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 reported cstate change: config changed from index 8 to 9, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New cstate: current_term: 2 leader_uuid: "12ab71778f2f4b378765aaed1a0676a5" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:31.467463 20611 raft_consensus.cc:2272] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:31.483567 20611 ts_tablet_manager.cc:1916] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:31.512542 20611 ts_tablet_manager.cc:1929] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260807 13:54:31.512743 20611 log.cc:1199] T 80898a5a2cf046f1b7344dfceb175bbd P 12ab71778f2f4b378765aaed1a0676a5: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal/wals/80898a5a2cf046f1b7344dfceb175bbd
I20260807 13:54:31.513679 4506 catalog_manager.cc:5028] TS 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): tablet 80898a5a2cf046f1b7344dfceb175bbd (table rebalance_test_table_1 [id=7f1d26639edd4cb398339b2b0d3659a3]) successfully deleted
I20260807 13:54:31.664649 20658 ts_tablet_manager.cc:933] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:54:31.683672 4715 consensus_queue.cc:237] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:31.689980 20658 tablet_copy_client.cc:323] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:54:31.694285 4748 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet 966ebd287fc14e498e5bd3e6542194ca from peer c9d2944272bc447dafce7620ac2dbd4b ({username='slave'} at 127.23.107.130:51721)
I20260807 13:54:31.694519 4748 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet 966ebd287fc14e498e5bd3e6542194ca from peer c9d2944272bc447dafce7620ac2dbd4b at {username='slave'} at 127.23.107.130:51721: session id = c9d2944272bc447dafce7620ac2dbd4b-966ebd287fc14e498e5bd3e6542194ca
I20260807 13:54:31.705894 4748 tablet_copy_source_session.cc:215] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:31.710851 7179 raft_consensus.cc:1275] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:31.712479 20326 consensus_queue.cc:1048] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:31.714205 7353 raft_consensus.cc:1275] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:31.716863 20326 consensus_queue.cc:1048] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:31.719086 20658 ts_tablet_manager.cc:1916] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_COPYING
W20260807 13:54:31.736845 4631 consensus_peers.cc:597] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:31.744663 20658 ts_tablet_manager.cc:1929] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.8
I20260807 13:54:31.745447 20658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 966ebd287fc14e498e5bd3e6542194ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:31.750476 5068 consensus_queue.cc:237] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:31.776512 7178 raft_consensus.cc:1275] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:54:31.777555 20102 consensus_queue.cc:1048] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:31.824522 7354 raft_consensus.cc:1275] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:54:31.825542 20262 consensus_queue.cc:1048] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:31.836683 20714 ts_tablet_manager.cc:933] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: Initiating tablet copy from peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975)
I20260807 13:54:31.850768 20714 tablet_copy_client.cc:323] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.134:35975
I20260807 13:54:31.860908 7386 tablet_copy_service.cc:140] P 12ab71778f2f4b378765aaed1a0676a5: Received BeginTabletCopySession request for tablet 069a5f0089b24a609b27d4a07a3c4353 from peer c9d2944272bc447dafce7620ac2dbd4b ({username='slave'} at 127.23.107.130:58277)
I20260807 13:54:31.861228 7386 tablet_copy_service.cc:161] P 12ab71778f2f4b378765aaed1a0676a5: Beginning new tablet copy session on tablet 069a5f0089b24a609b27d4a07a3c4353 from peer c9d2944272bc447dafce7620ac2dbd4b at {username='slave'} at 127.23.107.130:58277: session id = c9d2944272bc447dafce7620ac2dbd4b-069a5f0089b24a609b27d4a07a3c4353
I20260807 13:54:31.866010 7386 tablet_copy_source_session.cc:215] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:31.869242 20714 ts_tablet_manager.cc:1916] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:54:31.897109 20714 ts_tablet_manager.cc:1929] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 2.6
I20260807 13:54:31.902673 20102 raft_consensus.cc:2955] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:31.910465 7352 raft_consensus.cc:2955] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:31.926942 4510 catalog_manager.cc:5697] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: config changed from index 6 to 7, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:31.932451 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet d27ce55f2acc4513a9fd90a338098eeb with delete_type TABLET_DATA_TOMBSTONED (TS edf940ebcc1140cfa0c23214e0c0f179 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:53540
I20260807 13:54:31.942836 7179 raft_consensus.cc:2955] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:31.956691 20696 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:31.964187 20724 tablet_replica.cc:333] T d27ce55f2acc4513a9fd90a338098eeb P edf940ebcc1140cfa0c23214e0c0f179: stopping tablet replica
I20260807 13:54:31.964424 20724 raft_consensus.cc:2243] T d27ce55f2acc4513a9fd90a338098eeb P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:31.964668 20724 raft_consensus.cc:2272] T d27ce55f2acc4513a9fd90a338098eeb P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:31.941210 20658 tablet_copy_client.cc:806] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:31.969105 20658 tablet_copy_client.cc:670] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:31.969174 20714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 069a5f0089b24a609b27d4a07a3c4353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:31.971287 20724 ts_tablet_manager.cc:1916] T d27ce55f2acc4513a9fd90a338098eeb P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:31.973556 4510 catalog_manager.cc:5697] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index 7 to 8, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:31.980829 20658 tablet_copy_client.cc:538] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:31.985739 20658 tablet_bootstrap.cc:492] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:54:31.985833 20714 tablet_copy_client.cc:806] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:31.993963 7353 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:31.997315 20714 tablet_copy_client.cc:670] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:31.990118 7178 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:31.999480 20724 ts_tablet_manager.cc:1929] T d27ce55f2acc4513a9fd90a338098eeb P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20260807 13:54:31.999545 20714 tablet_copy_client.cc:538] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:32.002282 20724 log.cc:1199] T d27ce55f2acc4513a9fd90a338098eeb P edf940ebcc1140cfa0c23214e0c0f179: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal/wals/d27ce55f2acc4513a9fd90a338098eeb
I20260807 13:54:32.003423 4506 catalog_manager.cc:5028] TS edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): tablet d27ce55f2acc4513a9fd90a338098eeb (table rebalance_test_table_9 [id=96e83925faa542ffa4808b01a5adbbb3]) successfully deleted
I20260807 13:54:32.011574 20714 tablet_bootstrap.cc:492] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:54:32.080791 5068 consensus_queue.cc:237] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
W20260807 13:54:32.097580 4981 consensus_peers.cc:597] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 739f4f0207104455bf3e87bc04f8d13c. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:32.098999 7524 raft_consensus.cc:1275] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:32.099858 20102 consensus_queue.cc:1048] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:32.106285 7353 raft_consensus.cc:1275] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:32.107975 20102 consensus_queue.cc:1048] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:32.140004 20714 tablet_bootstrap.cc:492] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:32.140990 20714 tablet_bootstrap.cc:492] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap complete.
I20260807 13:54:32.141464 20714 ts_tablet_manager.cc:1403] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.130s user 0.060s sys 0.023s
I20260807 13:54:32.142325 20714 raft_consensus.cc:359] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:32.142601 20714 raft_consensus.cc:740] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:54:32.142921 20714 consensus_queue.cc:260] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 2.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:32.143572 20714 ts_tablet_manager.cc:1434] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260807 13:54:32.144961 7386 tablet_copy_service.cc:342] P 12ab71778f2f4b378765aaed1a0676a5: Request end of tablet copy session c9d2944272bc447dafce7620ac2dbd4b-069a5f0089b24a609b27d4a07a3c4353 received from {username='slave'} at 127.23.107.130:58277
I20260807 13:54:32.145126 7386 tablet_copy_service.cc:434] P 12ab71778f2f4b378765aaed1a0676a5: ending tablet copy session c9d2944272bc447dafce7620ac2dbd4b-069a5f0089b24a609b27d4a07a3c4353 on tablet 069a5f0089b24a609b27d4a07a3c4353 with peer c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:54:32.155308 20714 ts_tablet_manager.cc:933] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:54:32.161821 20714 tablet_copy_client.cc:323] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:54:32.162797 4748 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet 68717842b14e4f06b528c08a65acd3b7 from peer c9d2944272bc447dafce7620ac2dbd4b ({username='slave'} at 127.23.107.130:51721)
I20260807 13:54:32.163014 4748 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet 68717842b14e4f06b528c08a65acd3b7 from peer c9d2944272bc447dafce7620ac2dbd4b at {username='slave'} at 127.23.107.130:51721: session id = c9d2944272bc447dafce7620ac2dbd4b-68717842b14e4f06b528c08a65acd3b7
I20260807 13:54:32.167601 4748 tablet_copy_source_session.cc:215] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:32.177805 20714 ts_tablet_manager.cc:1916] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:54:32.177879 20725 raft_consensus.cc:2955] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:32.178809 7522 raft_consensus.cc:2955] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:32.187021 4510 catalog_manager.cc:5697] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 7 to 8, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:32.190840 20714 ts_tablet_manager.cc:1929] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.5
I20260807 13:54:32.191205 20714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68717842b14e4f06b528c08a65acd3b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:32.195945 20714 tablet_copy_client.cc:806] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:32.196254 20714 tablet_copy_client.cc:670] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:32.199419 20714 tablet_copy_client.cc:538] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:32.204880 20714 tablet_bootstrap.cc:492] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:54:32.206177 7353 raft_consensus.cc:2955] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:32.270643 4897 raft_consensus.cc:1217] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Deduplicated request from leader. Original: 2.8->[2.9-2.9] Dedup: 2.9->[]
I20260807 13:54:32.278111 20714 tablet_bootstrap.cc:492] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:32.278796 20714 tablet_bootstrap.cc:492] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap complete.
I20260807 13:54:32.279742 20714 ts_tablet_manager.cc:1403] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.076s user 0.053s sys 0.009s
I20260807 13:54:32.280126 20658 tablet_bootstrap.cc:492] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:32.280620 20658 tablet_bootstrap.cc:492] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap complete.
I20260807 13:54:32.280867 20714 raft_consensus.cc:359] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:32.281246 20714 raft_consensus.cc:740] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:54:32.281586 20714 consensus_queue.cc:260] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:32.282109 20658 ts_tablet_manager.cc:1403] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.296s user 0.056s sys 0.005s
I20260807 13:54:32.283094 20658 raft_consensus.cc:359] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:32.282279 20714 ts_tablet_manager.cc:1434] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260807 13:54:32.286237 20658 raft_consensus.cc:740] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:54:32.286736 20658 consensus_queue.cc:260] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:32.287770 4748 tablet_copy_service.cc:342] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Request end of tablet copy session c9d2944272bc447dafce7620ac2dbd4b-68717842b14e4f06b528c08a65acd3b7 received from {username='slave'} at 127.23.107.130:51721
I20260807 13:54:32.287858 20658 ts_tablet_manager.cc:1434] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260807 13:54:32.287905 4748 tablet_copy_service.cc:434] P fa83b7af134b4e3b949ac3b4e4bcb5e7: ending tablet copy session c9d2944272bc447dafce7620ac2dbd4b-68717842b14e4f06b528c08a65acd3b7 on tablet 68717842b14e4f06b528c08a65acd3b7 with peer c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:54:32.302707 4748 tablet_copy_service.cc:342] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Request end of tablet copy session c9d2944272bc447dafce7620ac2dbd4b-966ebd287fc14e498e5bd3e6542194ca received from {username='slave'} at 127.23.107.130:51721
I20260807 13:54:32.302897 4748 tablet_copy_service.cc:434] P fa83b7af134b4e3b949ac3b4e4bcb5e7: ending tablet copy session c9d2944272bc447dafce7620ac2dbd4b-966ebd287fc14e498e5bd3e6542194ca on tablet 966ebd287fc14e498e5bd3e6542194ca with peer c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:54:32.357653 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:32.409240 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:32.412839 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:32.482120 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:32.510634 20658 ts_tablet_manager.cc:933] T 739f4f0207104455bf3e87bc04f8d13c P c9d2944272bc447dafce7620ac2dbd4b: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:54:32.539160 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:32.540402 20658 tablet_copy_client.cc:323] T 739f4f0207104455bf3e87bc04f8d13c P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:54:32.541252 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet 739f4f0207104455bf3e87bc04f8d13c from peer c9d2944272bc447dafce7620ac2dbd4b ({username='slave'} at 127.23.107.130:47105)
I20260807 13:54:32.541457 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet 739f4f0207104455bf3e87bc04f8d13c from peer c9d2944272bc447dafce7620ac2dbd4b at {username='slave'} at 127.23.107.130:47105: session id = c9d2944272bc447dafce7620ac2dbd4b-739f4f0207104455bf3e87bc04f8d13c
I20260807 13:54:32.545470 5101 tablet_copy_source_session.cc:215] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:32.547088 20658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739f4f0207104455bf3e87bc04f8d13c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:32.567934 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:32.569257 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:32.583015 20658 tablet_copy_client.cc:806] T 739f4f0207104455bf3e87bc04f8d13c P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:32.583401 20658 tablet_copy_client.cc:670] T 739f4f0207104455bf3e87bc04f8d13c P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:32.591177 20658 tablet_copy_client.cc:538] T 739f4f0207104455bf3e87bc04f8d13c P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:32.614753 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:32.623639 20658 tablet_bootstrap.cc:492] T 739f4f0207104455bf3e87bc04f8d13c P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:54:32.694562 4897 raft_consensus.cc:1217] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260807 13:54:32.752542 4897 raft_consensus.cc:1217] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.9->[1.10-1.10] Dedup: 1.10->[]
I20260807 13:54:32.785845 20658 tablet_bootstrap.cc:492] T 739f4f0207104455bf3e87bc04f8d13c P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:32.786490 20658 tablet_bootstrap.cc:492] T 739f4f0207104455bf3e87bc04f8d13c P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap complete.
I20260807 13:54:32.787866 20658 ts_tablet_manager.cc:1403] T 739f4f0207104455bf3e87bc04f8d13c P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.164s user 0.047s sys 0.001s
I20260807 13:54:32.788789 20658 raft_consensus.cc:359] T 739f4f0207104455bf3e87bc04f8d13c P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:32.789089 20658 raft_consensus.cc:740] T 739f4f0207104455bf3e87bc04f8d13c P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:54:32.789415 20658 consensus_queue.cc:260] T 739f4f0207104455bf3e87bc04f8d13c P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:32.790216 20658 ts_tablet_manager.cc:1434] T 739f4f0207104455bf3e87bc04f8d13c P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:54:32.790968 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session c9d2944272bc447dafce7620ac2dbd4b-739f4f0207104455bf3e87bc04f8d13c received from {username='slave'} at 127.23.107.130:47105
I20260807 13:54:32.791142 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session c9d2944272bc447dafce7620ac2dbd4b-739f4f0207104455bf3e87bc04f8d13c on tablet 739f4f0207104455bf3e87bc04f8d13c with peer c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:54:32.968305 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:32.975875 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:33.021584 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:33.072918 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:33.082054 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:33.092160 4897 raft_consensus.cc:1217] T 739f4f0207104455bf3e87bc04f8d13c P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260807 13:54:33.103545 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:54:33.110502 5153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.133:38075, user_credentials={real_user=slave}} blocked reactor thread for 43717.9us
I20260807 13:54:33.137228 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:33.151994 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:33.531003 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:33.544269 5248 consensus_queue.cc:237] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:33.556424 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:33.592804 4897 raft_consensus.cc:1275] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:33.593708 20980 consensus_queue.cc:1048] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:33.635165 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:33.663425 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:33.697646 7178 raft_consensus.cc:1275] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:33.698561 20980 consensus_queue.cc:1048] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:33.702015 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:33.702715 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:33.706862 20977 raft_consensus.cc:2955] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:33.712538 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:33.715893 7179 raft_consensus.cc:2955] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:33.736752 4515 catalog_manager.cc:5697] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index 8 to 9, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) evicted. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:33.753696 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:33.769605 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:33.799522 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:33.827703 4892 raft_consensus.cc:2955] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:33.848855 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:33.855998 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:33.863808 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:33.890532 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:33.925707 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:33.930668 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:33.934437 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:33.940177 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:33.941794 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:33.962837 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:33.968808 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:33.983443 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:34.028877 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:34.036255 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:34.103173 7502 tablet_service.cc:1558] Processing DeleteTablet for tablet 1715828a5d96455abecae985d1dca004 with delete_type TABLET_DATA_TOMBSTONED (TS 8a9903f009ff46b4a6875490823076c4 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:39618
I20260807 13:54:34.128954 21138 tablet_replica.cc:333] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4: stopping tablet replica
I20260807 13:54:34.146044 21138 raft_consensus.cc:2243] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:34.146600 21138 raft_consensus.cc:2272] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:34.149785 21138 ts_tablet_manager.cc:1916] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:34.236001 21138 ts_tablet_manager.cc:1929] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260807 13:54:34.241284 21138 log.cc:1199] T 1715828a5d96455abecae985d1dca004 P 8a9903f009ff46b4a6875490823076c4: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal/wals/1715828a5d96455abecae985d1dca004
I20260807 13:54:34.242553 4506 catalog_manager.cc:5028] TS 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): tablet 1715828a5d96455abecae985d1dca004 (table rebalance_test_table_2 [id=35d13981f3a742dd9369d1e7bf18498c]) successfully deleted
I20260807 13:54:34.318403 7179 consensus_queue.cc:237] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 3.14, Last appended by leader: 8, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:54:34.348284 5248 raft_consensus.cc:1275] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179 [term 3 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 14. Preceding OpId from leader: term: 3 index: 15. (index mismatch)
I20260807 13:54:34.349133 17431 consensus_queue.cc:1048] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260807 13:54:34.356199 7688 raft_consensus.cc:1275] T 04dac80fea124c25b34af8cc290c0d7f P 31d7630573c8475a9f84978d4ebfb879 [term 3 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 14. Preceding OpId from leader: term: 3 index: 15. (index mismatch)
I20260807 13:54:34.357134 17431 consensus_queue.cc:1048] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260807 13:54:34.368398 21164 raft_consensus.cc:2955] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd [term 3 LEADER]: Committing config change with OpId 3.15: config changed from index 14 to 15, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:54:34.369012 5248 raft_consensus.cc:2955] T 04dac80fea124c25b34af8cc290c0d7f P edf940ebcc1140cfa0c23214e0c0f179 [term 3 FOLLOWER]: Committing config change with OpId 3.15: config changed from index 14 to 15, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:54:34.383216 4515 catalog_manager.cc:5697] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: config changed from index 14 to 15, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New cstate: current_term: 3 leader_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:54:34.404452 7327 tablet_service.cc:1558] Processing DeleteTablet for tablet 04dac80fea124c25b34af8cc290c0d7f with delete_type TABLET_DATA_TOMBSTONED (TS 12ab71778f2f4b378765aaed1a0676a5 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:47002
I20260807 13:54:34.407007 7688 raft_consensus.cc:2955] T 04dac80fea124c25b34af8cc290c0d7f P 31d7630573c8475a9f84978d4ebfb879 [term 3 FOLLOWER]: Committing config change with OpId 3.15: config changed from index 14 to 15, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:54:34.415419 21168 tablet_replica.cc:333] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5: stopping tablet replica
I20260807 13:54:34.417634 21168 raft_consensus.cc:2243] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:34.417920 21168 raft_consensus.cc:2272] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:34.418762 21168 ts_tablet_manager.cc:1916] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:34.426862 21168 ts_tablet_manager.cc:1929] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.14
I20260807 13:54:34.427105 21168 log.cc:1199] T 04dac80fea124c25b34af8cc290c0d7f P 12ab71778f2f4b378765aaed1a0676a5: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal/wals/04dac80fea124c25b34af8cc290c0d7f
I20260807 13:54:34.428581 4506 catalog_manager.cc:5028] TS 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): tablet 04dac80fea124c25b34af8cc290c0d7f (table rebalance_test_table_8 [id=91303cf8b9064e06b8c4165942b287f2]) successfully deleted
I20260807 13:54:34.713460 4715 consensus_queue.cc:237] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:54:34.727764 5068 raft_consensus.cc:1275] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260807 13:54:34.728636 7179 raft_consensus.cc:1275] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260807 13:54:34.728608 20878 consensus_queue.cc:1048] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:54:34.730753 20878 consensus_queue.cc:1048] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:54:34.734269 5072 consensus_queue.cc:237] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:34.746236 4897 raft_consensus.cc:1275] T 739f4f0207104455bf3e87bc04f8d13c P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:34.746869 21148 consensus_queue.cc:1048] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:34.749415 7524 raft_consensus.cc:1275] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:34.750049 21148 consensus_queue.cc:1048] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:34.752736 21291 raft_consensus.cc:2955] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:34.754401 21154 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:34.756628 4897 raft_consensus.cc:2955] T 739f4f0207104455bf3e87bc04f8d13c P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:34.759492 5074 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:34.762053 7524 raft_consensus.cc:2955] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:34.770771 4510 catalog_manager.cc:5697] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index 10 to 11, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:34.771864 7179 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:34.779071 4865 tablet_service.cc:1558] Processing DeleteTablet for tablet 966ebd287fc14e498e5bd3e6542194ca with delete_type TABLET_DATA_TOMBSTONED (TS c9d2944272bc447dafce7620ac2dbd4b not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:36624
I20260807 13:54:34.807170 4515 catalog_manager.cc:5697] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 8 to 9, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:34.828398 7327 tablet_service.cc:1558] Processing DeleteTablet for tablet 739f4f0207104455bf3e87bc04f8d13c with delete_type TABLET_DATA_TOMBSTONED (TS 12ab71778f2f4b378765aaed1a0676a5 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:47002
I20260807 13:54:34.829037 21168 tablet_replica.cc:333] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5: stopping tablet replica
I20260807 13:54:34.829324 21168 raft_consensus.cc:2243] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:34.829674 21168 raft_consensus.cc:2272] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:34.830786 21168 ts_tablet_manager.cc:1916] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260807 13:54:34.903019 5153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.130:37489, user_credentials={real_user=slave}} blocked reactor thread for 125370us
W20260807 13:54:34.904227 5151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.136:43729, user_credentials={real_user=slave}} blocked reactor thread for 127172us
I20260807 13:54:34.920652 21168 ts_tablet_manager.cc:1929] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260807 13:54:34.920974 21168 log.cc:1199] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal/wals/739f4f0207104455bf3e87bc04f8d13c
I20260807 13:54:34.922405 4506 catalog_manager.cc:5028] TS 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): tablet 739f4f0207104455bf3e87bc04f8d13c (table rebalance_test_table_3 [id=c2c7db1795a1414c8299bebbeaf60404]) successfully deleted
I20260807 13:54:34.933123 21303 tablet_replica.cc:333] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: stopping tablet replica
I20260807 13:54:34.933732 21303 raft_consensus.cc:2243] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:34.938324 21303 raft_consensus.cc:2272] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:34.971575 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:34.975000 21303 ts_tablet_manager.cc:1916] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:34.992409 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:35.002097 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:35.013624 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:35.033689 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:35.082186 21303 ts_tablet_manager.cc:1929] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.10
I20260807 13:54:35.082445 21303 log.cc:1199] T 966ebd287fc14e498e5bd3e6542194ca P c9d2944272bc447dafce7620ac2dbd4b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/966ebd287fc14e498e5bd3e6542194ca
I20260807 13:54:35.083366 4505 catalog_manager.cc:5028] TS c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): tablet 966ebd287fc14e498e5bd3e6542194ca (table rebalance_test_table_6 [id=6008038c907645199b055dacb5772621]) successfully deleted
I20260807 13:54:35.118366 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:35.146577 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:35.154879 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:35.388242 7502 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260807 13:54:35.410548 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:35.430509 5039 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:35.437834 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:35.441524 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:35.443231 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:35.494478 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:35.510751 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:35.526804 5068 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "522c3523f2af4eb29e30fa55da2acd3e"
dest_uuid: "01adf83af3e04875b5fac9470d4da915"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:48636
I20260807 13:54:35.527040 5068 raft_consensus.cc:606] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Received request to transfer leadership
I20260807 13:54:35.567123 21291 raft_consensus.cc:993] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915: : Instructing follower 8a9903f009ff46b4a6875490823076c4 to start an election
I20260807 13:54:35.567265 21291 raft_consensus.cc:1081] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Signalling peer 8a9903f009ff46b4a6875490823076c4 to start an election
I20260807 13:54:35.580283 7522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "522c3523f2af4eb29e30fa55da2acd3e"
dest_uuid: "8a9903f009ff46b4a6875490823076c4"
from {username='slave'} at 127.23.107.131:34221
I20260807 13:54:35.580638 7522 raft_consensus.cc:493] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:54:35.580780 7522 raft_consensus.cc:3060] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:54:35.587493 7522 raft_consensus.cc:515] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:35.710147 5068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c3523f2af4eb29e30fa55da2acd3e" candidate_uuid: "8a9903f009ff46b4a6875490823076c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: true dest_uuid: "01adf83af3e04875b5fac9470d4da915"
I20260807 13:54:35.710417 5068 raft_consensus.cc:3055] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:54:35.710510 5068 raft_consensus.cc:740] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Running, Role: LEADER
I20260807 13:54:35.710851 5068 consensus_queue.cc:260] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:35.711328 5068 raft_consensus.cc:3060] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:54:35.713115 7522 leader_election.cc:290] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 election: Requested vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729)
I20260807 13:54:35.713553 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c3523f2af4eb29e30fa55da2acd3e" candidate_uuid: "8a9903f009ff46b4a6875490823076c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: true dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179"
I20260807 13:54:35.713773 5248 raft_consensus.cc:3060] T 522c3523f2af4eb29e30fa55da2acd3e P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:54:35.720417 5248 raft_consensus.cc:2468] T 522c3523f2af4eb29e30fa55da2acd3e P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a9903f009ff46b4a6875490823076c4 in term 2.
I20260807 13:54:35.720916 5068 raft_consensus.cc:2468] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a9903f009ff46b4a6875490823076c4 in term 2.
I20260807 13:54:35.721535 7442 leader_election.cc:304] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, 8a9903f009ff46b4a6875490823076c4, edf940ebcc1140cfa0c23214e0c0f179; no voters:
I20260807 13:54:35.727404 21449 raft_consensus.cc:2804] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:54:35.734470 21449 raft_consensus.cc:697] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 [term 2 LEADER]: Becoming Leader. State: Replica: 8a9903f009ff46b4a6875490823076c4, State: Running, Role: LEADER
I20260807 13:54:35.736410 21449 consensus_queue.cc:237] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:35.752960 7688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c3523f2af4eb29e30fa55da2acd3e" candidate_uuid: "8a9903f009ff46b4a6875490823076c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: true dest_uuid: "31d7630573c8475a9f84978d4ebfb879"
I20260807 13:54:35.753188 7688 raft_consensus.cc:3060] T 522c3523f2af4eb29e30fa55da2acd3e P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:54:35.756163 7688 raft_consensus.cc:2468] T 522c3523f2af4eb29e30fa55da2acd3e P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a9903f009ff46b4a6875490823076c4 in term 2.
I20260807 13:54:35.760528 4513 catalog_manager.cc:5697] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 reported cstate change: term changed from 1 to 2, leader changed from 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) to 8a9903f009ff46b4a6875490823076c4 (127.23.107.135). New cstate: current_term: 2 leader_uuid: "8a9903f009ff46b4a6875490823076c4" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:35.891053 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:35.926229 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:35.927845 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:35.957711 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:36.006191 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:36.015465 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:36.037619 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:36.069083 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:36.180114 5068 raft_consensus.cc:1275] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Refusing update from remote peer 8a9903f009ff46b4a6875490823076c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20260807 13:54:36.181031 21449 consensus_queue.cc:1048] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260807 13:54:36.296135 5151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.136:43729, user_credentials={real_user=slave}} blocked reactor thread for 52363.6us
I20260807 13:54:36.309468 7688 consensus_queue.cc:237] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.9, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:36.318301 5248 raft_consensus.cc:1275] T 522c3523f2af4eb29e30fa55da2acd3e P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Refusing update from remote peer 8a9903f009ff46b4a6875490823076c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20260807 13:54:36.329017 21449 consensus_queue.cc:1048] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:36.341969 4715 raft_consensus.cc:1275] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Refusing update from remote peer 31d7630573c8475a9f84978d4ebfb879: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260807 13:54:36.342828 20145 consensus_queue.cc:1048] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:36.344951 5068 raft_consensus.cc:1275] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Refusing update from remote peer 31d7630573c8475a9f84978d4ebfb879: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260807 13:54:36.346021 20145 consensus_queue.cc:1048] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:36.366392 5068 raft_consensus.cc:2955] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:36.364593 21576 raft_consensus.cc:2955] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 [term 2 LEADER]: Committing config change with OpId 2.10: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:36.381250 4513 catalog_manager.cc:5697] T b414c896ad884facb339e5e4a0329065 P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New cstate: current_term: 2 leader_uuid: "31d7630573c8475a9f84978d4ebfb879" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:36.393843 4715 raft_consensus.cc:2955] T b414c896ad884facb339e5e4a0329065 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:36.410693 7688 raft_consensus.cc:1275] T 522c3523f2af4eb29e30fa55da2acd3e P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Refusing update from remote peer 8a9903f009ff46b4a6875490823076c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20260807 13:54:36.412576 21572 consensus_queue.cc:1048] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:36.476444 7327 tablet_service.cc:1558] Processing DeleteTablet for tablet b414c896ad884facb339e5e4a0329065 with delete_type TABLET_DATA_TOMBSTONED (TS 12ab71778f2f4b378765aaed1a0676a5 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:47002
I20260807 13:54:36.505832 21620 tablet_replica.cc:333] T b414c896ad884facb339e5e4a0329065 P 12ab71778f2f4b378765aaed1a0676a5: stopping tablet replica
I20260807 13:54:36.506294 21620 raft_consensus.cc:2243] T b414c896ad884facb339e5e4a0329065 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:36.506654 21620 raft_consensus.cc:2272] T b414c896ad884facb339e5e4a0329065 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:36.507691 21620 ts_tablet_manager.cc:1916] T b414c896ad884facb339e5e4a0329065 P 12ab71778f2f4b378765aaed1a0676a5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:36.514901 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:36.515599 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:36.520347 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:36.528952 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:36.579077 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:36.600837 21620 ts_tablet_manager.cc:1929] T b414c896ad884facb339e5e4a0329065 P 12ab71778f2f4b378765aaed1a0676a5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.9
I20260807 13:54:36.601923 21620 log.cc:1199] T b414c896ad884facb339e5e4a0329065 P 12ab71778f2f4b378765aaed1a0676a5: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal/wals/b414c896ad884facb339e5e4a0329065
I20260807 13:54:36.603276 4506 catalog_manager.cc:5028] TS 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): tablet b414c896ad884facb339e5e4a0329065 (table rebalance_test_table_2 [id=35d13981f3a742dd9369d1e7bf18498c]) successfully deleted
I20260807 13:54:36.650470 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:36.688266 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:36.698704 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:54:36.734709 4806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.134:35975, user_credentials={real_user=slave}} blocked reactor thread for 64633.3us
I20260807 13:54:36.746038 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:36.773093 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:36.775820 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:36.777698 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:36.789397 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:36.789636 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:36.828197 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:36.888034 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:37.416460 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:37.420024 4897 consensus_queue.cc:237] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:37.435248 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:37.457661 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:37.470433 7522 raft_consensus.cc:1275] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:54:37.471276 21653 consensus_queue.cc:1048] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:37.487681 4716 raft_consensus.cc:1275] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:54:37.488390 21653 consensus_queue.cc:1048] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:37.510233 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:37.510847 21421 raft_consensus.cc:2955] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:37.514705 4716 raft_consensus.cc:2955] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:37.519865 4515 catalog_manager.cc:5697] T 782ac4fa94fb4183940fca514cc068b0 P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index 6 to 7, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:37.546075 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:54:37.592064 5153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.133:38075, user_credentials={real_user=slave}} blocked reactor thread for 100865us
I20260807 13:54:37.596021 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:37.595171 7522 raft_consensus.cc:2955] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:37.613517 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:37.635082 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:37.711455 7327 tablet_service.cc:1558] Processing DeleteTablet for tablet 782ac4fa94fb4183940fca514cc068b0 with delete_type TABLET_DATA_TOMBSTONED (TS 12ab71778f2f4b378765aaed1a0676a5 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:47002
I20260807 13:54:37.715723 21852 tablet_replica.cc:333] T 782ac4fa94fb4183940fca514cc068b0 P 12ab71778f2f4b378765aaed1a0676a5: stopping tablet replica
I20260807 13:54:37.716806 21852 raft_consensus.cc:2243] T 782ac4fa94fb4183940fca514cc068b0 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:37.717597 21852 raft_consensus.cc:2272] T 782ac4fa94fb4183940fca514cc068b0 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:37.718555 21852 ts_tablet_manager.cc:1916] T 782ac4fa94fb4183940fca514cc068b0 P 12ab71778f2f4b378765aaed1a0676a5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:37.745534 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:37.779753 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:37.784948 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:37.785408 21852 ts_tablet_manager.cc:1929] T 782ac4fa94fb4183940fca514cc068b0 P 12ab71778f2f4b378765aaed1a0676a5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20260807 13:54:37.845824 21852 log.cc:1199] T 782ac4fa94fb4183940fca514cc068b0 P 12ab71778f2f4b378765aaed1a0676a5: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal/wals/782ac4fa94fb4183940fca514cc068b0
I20260807 13:54:37.849436 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:37.855021 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:37.860177 4506 catalog_manager.cc:5028] TS 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): tablet 782ac4fa94fb4183940fca514cc068b0 (table rebalance_test_table_2 [id=35d13981f3a742dd9369d1e7bf18498c]) successfully deleted
I20260807 13:54:37.897483 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:37.898294 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:37.902468 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:37.921626 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260807 13:54:37.929098 4982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.134:35975, user_credentials={real_user=slave}} blocked reactor thread for 95092.9us
I20260807 13:54:37.951642 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:37.958184 7522 consensus_queue.cc:237] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 2.7, Last appended by leader: 6, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:37.961648 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:37.961856 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:37.983661 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:37.993278 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:37.996603 7690 raft_consensus.cc:1275] T 522c3523f2af4eb29e30fa55da2acd3e P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Refusing update from remote peer 8a9903f009ff46b4a6875490823076c4: Log matching property violated. Preceding OpId in replica: term: 2 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260807 13:54:37.997109 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:37.997493 21593 consensus_queue.cc:1048] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:37.999614 5248 raft_consensus.cc:1275] T 522c3523f2af4eb29e30fa55da2acd3e P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Refusing update from remote peer 8a9903f009ff46b4a6875490823076c4: Log matching property violated. Preceding OpId in replica: term: 2 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260807 13:54:38.005936 21593 consensus_queue.cc:1048] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:38.018846 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:38.094978 21908 raft_consensus.cc:2955] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 [term 2 LEADER]: Committing config change with OpId 2.8: config changed from index 6 to 8, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:38.096976 5246 raft_consensus.cc:2955] T 522c3523f2af4eb29e30fa55da2acd3e P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Committing config change with OpId 2.8: config changed from index 6 to 8, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:38.103554 4513 catalog_manager.cc:5697] T 522c3523f2af4eb29e30fa55da2acd3e P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index 6 to 8, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New cstate: current_term: 2 leader_uuid: "8a9903f009ff46b4a6875490823076c4" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:38.108388 5039 tablet_service.cc:1558] Processing DeleteTablet for tablet 522c3523f2af4eb29e30fa55da2acd3e with delete_type TABLET_DATA_TOMBSTONED (TS 01adf83af3e04875b5fac9470d4da915 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:36810
I20260807 13:54:38.111954 21914 tablet_replica.cc:333] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915: stopping tablet replica
I20260807 13:54:38.114408 21914 raft_consensus.cc:2243] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:38.115360 21914 raft_consensus.cc:2272] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:38.118850 21914 ts_tablet_manager.cc:1916] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:38.128525 7690 raft_consensus.cc:2955] T 522c3523f2af4eb29e30fa55da2acd3e P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Committing config change with OpId 2.8: config changed from index 6 to 8, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
W20260807 13:54:38.146092 7444 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:41217, user_credentials={real_user=slave}} blocked reactor thread for 44493.9us
I20260807 13:54:38.163771 21914 ts_tablet_manager.cc:1929] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.7
I20260807 13:54:38.164613 21914 log.cc:1199] T 522c3523f2af4eb29e30fa55da2acd3e P 01adf83af3e04875b5fac9470d4da915: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/wals/522c3523f2af4eb29e30fa55da2acd3e
I20260807 13:54:38.165894 4504 catalog_manager.cc:5028] TS 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): tablet 522c3523f2af4eb29e30fa55da2acd3e (table rebalance_test_table_7 [id=2ff801ea568346e096cc895a279c109c]) successfully deleted
I20260807 13:54:38.484822 5246 consensus_queue.cc:237] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:38.493216 7688 raft_consensus.cc:1275] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:38.493422 4897 raft_consensus.cc:1275] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
W20260807 13:54:38.494177 5154 consensus_peers.cc:597] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:38.494233 21821 consensus_queue.cc:1048] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:38.494786 21821 consensus_queue.cc:1048] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:38.523962 4716 consensus_queue.cc:237] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:38.546955 21559 raft_consensus.cc:2955] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:38.552934 4892 raft_consensus.cc:2955] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:38.562695 4517 catalog_manager.cc:5697] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index 7 to 8, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:38.574404 7688 raft_consensus.cc:2955] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:38.581125 4897 raft_consensus.cc:1275] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:38.582146 21749 consensus_queue.cc:1048] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:38.584846 7180 raft_consensus.cc:1275] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:38.585632 21749 consensus_queue.cc:1048] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:38.589522 21749 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:38.596681 4892 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:38.601661 5068 consensus_queue.cc:237] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:38.630386 4517 catalog_manager.cc:5697] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index 8 to 9, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:38.637486 7327 tablet_service.cc:1558] Processing DeleteTablet for tablet 68717842b14e4f06b528c08a65acd3b7 with delete_type TABLET_DATA_TOMBSTONED (TS 12ab71778f2f4b378765aaed1a0676a5 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:47002
I20260807 13:54:38.653160 22062 tablet_replica.cc:333] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: stopping tablet replica
I20260807 13:54:38.653656 22062 raft_consensus.cc:2243] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:38.654279 22062 raft_consensus.cc:2272] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:38.655356 22062 ts_tablet_manager.cc:1916] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:38.689782 4716 raft_consensus.cc:1275] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260807 13:54:38.690485 21148 consensus_queue.cc:1048] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:38.692564 7524 raft_consensus.cc:1275] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260807 13:54:38.693648 21148 consensus_queue.cc:1048] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:38.699884 22062 ts_tablet_manager.cc:1929] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260807 13:54:38.700129 22062 log.cc:1199] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal/wals/68717842b14e4f06b528c08a65acd3b7
I20260807 13:54:38.701432 4506 catalog_manager.cc:5028] TS 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): tablet 68717842b14e4f06b528c08a65acd3b7 (table rebalance_test_table_1 [id=7f1d26639edd4cb398339b2b0d3659a3]) successfully deleted
I20260807 13:54:38.724517 7688 raft_consensus.cc:1275] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260807 13:54:38.725637 21885 consensus_queue.cc:1048] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:38.729216 21148 raft_consensus.cc:2955] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:38.736220 7522 raft_consensus.cc:2955] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:38.758044 4513 catalog_manager.cc:5697] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 reported cstate change: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:38.759407 4715 raft_consensus.cc:2955] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:38.762431 7327 tablet_service.cc:1558] Processing DeleteTablet for tablet 43f5461808a646c885d593f782538930 with delete_type TABLET_DATA_TOMBSTONED (TS 12ab71778f2f4b378765aaed1a0676a5 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:47002
I20260807 13:54:38.762954 22062 tablet_replica.cc:333] T 43f5461808a646c885d593f782538930 P 12ab71778f2f4b378765aaed1a0676a5: stopping tablet replica
I20260807 13:54:38.763211 22062 raft_consensus.cc:2243] T 43f5461808a646c885d593f782538930 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:38.763392 22062 raft_consensus.cc:2272] T 43f5461808a646c885d593f782538930 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:38.764393 22062 ts_tablet_manager.cc:1916] T 43f5461808a646c885d593f782538930 P 12ab71778f2f4b378765aaed1a0676a5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:38.780751 22062 ts_tablet_manager.cc:1929] T 43f5461808a646c885d593f782538930 P 12ab71778f2f4b378765aaed1a0676a5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20260807 13:54:38.780965 22062 log.cc:1199] T 43f5461808a646c885d593f782538930 P 12ab71778f2f4b378765aaed1a0676a5: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal/wals/43f5461808a646c885d593f782538930
I20260807 13:54:38.781981 4506 catalog_manager.cc:5028] TS 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): tablet 43f5461808a646c885d593f782538930 (table rebalance_test_table_4 [id=e242e42da20d4458a49a269a9569307a]) successfully deleted
I20260807 13:54:38.794406 7180 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:38.830602 7688 raft_consensus.cc:2955] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:39.012127 22129 ts_tablet_manager.cc:933] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:54:39.018151 4715 consensus_queue.cc:237] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
W20260807 13:54:39.033319 4632 consensus_peers.cc:597] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:39.034590 5068 raft_consensus.cc:1275] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20260807 13:54:39.035189 7180 raft_consensus.cc:1275] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20260807 13:54:39.035177 21749 consensus_queue.cc:1048] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260807 13:54:39.035897 21749 consensus_queue.cc:1048] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260807 13:54:39.058153 22129 tablet_copy_client.cc:323] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:54:39.059011 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet 50a090faa58e4f91961c9251030efacf from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 ({username='slave'} at 127.23.107.129:40357)
I20260807 13:54:39.059177 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet 50a090faa58e4f91961c9251030efacf from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 at {username='slave'} at 127.23.107.129:40357: session id = fa83b7af134b4e3b949ac3b4e4bcb5e7-50a090faa58e4f91961c9251030efacf
I20260807 13:54:39.062559 5272 tablet_copy_source_session.cc:215] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:39.063911 22129 ts_tablet_manager.cc:1916] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:54:39.065770 21749 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:54:39.070533 5074 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:54:39.077323 4513 catalog_manager.cc:5697] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 11 to 12, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:54:39.078867 22129 ts_tablet_manager.cc:1929] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.6
I20260807 13:54:39.080039 22129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a090faa58e4f91961c9251030efacf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:39.088436 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:39.095818 22129 tablet_copy_client.cc:806] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:39.098148 22129 tablet_copy_client.cc:670] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:39.100790 22129 tablet_copy_client.cc:538] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:39.113495 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:39.115342 22129 tablet_bootstrap.cc:492] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:54:39.133411 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:39.207780 7180 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:54:39.229308 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260807 13:54:39.231608 5153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.130:37489, user_credentials={real_user=slave}} blocked reactor thread for 43936.7us
I20260807 13:54:39.260208 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:39.264427 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:39.294651 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:39.319067 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:39.339887 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:39.343474 22129 tablet_bootstrap.cc:492] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:39.344203 22129 tablet_bootstrap.cc:492] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap complete.
I20260807 13:54:39.344563 22129 ts_tablet_manager.cc:1403] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.229s user 0.054s sys 0.004s
I20260807 13:54:39.345436 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:39.346251 22129 raft_consensus.cc:359] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:39.346591 22129 raft_consensus.cc:740] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:54:39.347939 22129 consensus_queue.cc:260] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:39.352159 22129 ts_tablet_manager.cc:1434] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260807 13:54:39.352609 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:39.354009 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:39.355628 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session fa83b7af134b4e3b949ac3b4e4bcb5e7-50a090faa58e4f91961c9251030efacf received from {username='slave'} at 127.23.107.129:40357
I20260807 13:54:39.355775 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session fa83b7af134b4e3b949ac3b4e4bcb5e7-50a090faa58e4f91961c9251030efacf on tablet 50a090faa58e4f91961c9251030efacf with peer fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:54:39.407235 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:39.433547 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:39.456326 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:39.502863 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:39.527558 4715 raft_consensus.cc:1217] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260807 13:54:39.585076 22204 ts_tablet_manager.cc:933] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:54:39.616400 22204 tablet_copy_client.cc:323] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:54:39.618062 4748 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet 966ebd287fc14e498e5bd3e6542194ca from peer edf940ebcc1140cfa0c23214e0c0f179 ({username='slave'} at 127.23.107.132:57653)
I20260807 13:54:39.618223 4748 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet 966ebd287fc14e498e5bd3e6542194ca from peer edf940ebcc1140cfa0c23214e0c0f179 at {username='slave'} at 127.23.107.132:57653: session id = edf940ebcc1140cfa0c23214e0c0f179-966ebd287fc14e498e5bd3e6542194ca
I20260807 13:54:39.621809 4748 tablet_copy_source_session.cc:215] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:39.624783 22204 ts_tablet_manager.cc:1916] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:54:39.644191 22204 ts_tablet_manager.cc:1929] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.4
I20260807 13:54:39.644589 22204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 966ebd287fc14e498e5bd3e6542194ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:39.655494 22204 tablet_copy_client.cc:806] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:39.655826 22204 tablet_copy_client.cc:670] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:39.661564 22204 tablet_copy_client.cc:538] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:39.666962 22204 tablet_bootstrap.cc:492] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:54:39.796648 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:39.807366 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:39.895335 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:39.912281 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:39.928368 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:39.929526 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:39.948562 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:39.996538 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:40.079291 22204 tablet_bootstrap.cc:492] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:40.079910 22204 tablet_bootstrap.cc:492] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap complete.
I20260807 13:54:40.080323 22204 ts_tablet_manager.cc:1403] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.413s user 0.070s sys 0.025s
I20260807 13:54:40.081236 22204 raft_consensus.cc:359] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:54:40.081600 22204 raft_consensus.cc:740] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:54:40.082010 22204 consensus_queue.cc:260] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:54:40.082893 22204 ts_tablet_manager.cc:1434] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:54:40.084039 4748 tablet_copy_service.cc:342] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Request end of tablet copy session edf940ebcc1140cfa0c23214e0c0f179-966ebd287fc14e498e5bd3e6542194ca received from {username='slave'} at 127.23.107.132:57653
I20260807 13:54:40.084164 4748 tablet_copy_service.cc:434] P fa83b7af134b4e3b949ac3b4e4bcb5e7: ending tablet copy session edf940ebcc1140cfa0c23214e0c0f179-966ebd287fc14e498e5bd3e6542194ca on tablet 966ebd287fc14e498e5bd3e6542194ca with peer edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:54:40.112066 5068 consensus_queue.cc:237] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:40.135795 7180 raft_consensus.cc:1275] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:40.136731 22076 consensus_queue.cc:1048] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:40.162392 22076 raft_consensus.cc:2955] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:40.166656 7178 raft_consensus.cc:2955] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:40.179934 4513 catalog_manager.cc:5697] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: config changed from index 7 to 8, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:40.194636 7353 consensus_queue.cc:237] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.9, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:40.255811 7524 raft_consensus.cc:1275] T faef317e47a244c6965864f82f21edfa P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260807 13:54:40.256645 21695 consensus_queue.cc:1048] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:40.264915 5068 raft_consensus.cc:1275] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260807 13:54:40.265904 21695 consensus_queue.cc:1048] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:40.339412 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:40.351595 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:40.384692 22379 raft_consensus.cc:2955] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 [term 2 LEADER]: Committing config change with OpId 2.10: config changed from index 9 to 10, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:40.389137 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:40.392208 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:40.413657 5068 raft_consensus.cc:2955] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 9 to 10, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:40.435676 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:40.468701 5246 raft_consensus.cc:1217] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.11->[1.12-1.12] Dedup: 1.12->[]
I20260807 13:54:40.489063 7524 raft_consensus.cc:2955] T faef317e47a244c6965864f82f21edfa P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 9 to 10, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:40.499881 7327 tablet_service.cc:1558] Processing DeleteTablet for tablet d27ce55f2acc4513a9fd90a338098eeb with delete_type TABLET_DATA_TOMBSTONED (TS 12ab71778f2f4b378765aaed1a0676a5 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:47002
I20260807 13:54:40.505944 22393 tablet_replica.cc:333] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5: stopping tablet replica
I20260807 13:54:40.506481 22393 raft_consensus.cc:2243] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:40.507222 22393 raft_consensus.cc:2272] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:40.507879 5074 consensus_queue.cc:237] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:40.508502 22393 ts_tablet_manager.cc:1916] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260807 13:54:40.511160 4982 consensus_peers.cc:597] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 -> Peer 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): Couldn't send request to peer 8a9903f009ff46b4a6875490823076c4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d27ce55f2acc4513a9fd90a338098eeb. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:40.511699 7180 raft_consensus.cc:1275] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:40.512420 22076 consensus_queue.cc:1048] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:40.515403 4515 catalog_manager.cc:5697] T faef317e47a244c6965864f82f21edfa P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 9 to 10, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) evicted. New cstate: current_term: 2 leader_uuid: "12ab71778f2f4b378765aaed1a0676a5" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:40.522308 22076 raft_consensus.cc:2955] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:40.531636 4504 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet d27ce55f2acc4513a9fd90a338098eeb with cas_config_opid_index 8: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260807 13:54:40.532516 7668 tablet_service.cc:1558] Processing DeleteTablet for tablet faef317e47a244c6965864f82f21edfa with delete_type TABLET_DATA_TOMBSTONED (TS 31d7630573c8475a9f84978d4ebfb879 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:56664
I20260807 13:54:40.547382 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:40.552305 4515 catalog_manager.cc:5697] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 8 to 9, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:40.555819 22401 tablet_replica.cc:333] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879: stopping tablet replica
I20260807 13:54:40.557911 22401 raft_consensus.cc:2243] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:40.559608 22401 raft_consensus.cc:2272] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:40.562045 22401 ts_tablet_manager.cc:1916] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:40.562579 7178 raft_consensus.cc:2955] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:40.594156 22393 ts_tablet_manager.cc:1929] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.7
I20260807 13:54:40.594442 22393 log.cc:1199] T d27ce55f2acc4513a9fd90a338098eeb P 12ab71778f2f4b378765aaed1a0676a5: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal/wals/d27ce55f2acc4513a9fd90a338098eeb
I20260807 13:54:40.605525 4506 catalog_manager.cc:5028] TS 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): tablet d27ce55f2acc4513a9fd90a338098eeb (table rebalance_test_table_9 [id=96e83925faa542ffa4808b01a5adbbb3]) successfully deleted
I20260807 13:54:40.607882 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:40.613826 22401 ts_tablet_manager.cc:1929] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.9
I20260807 13:54:40.617944 22401 log.cc:1199] T faef317e47a244c6965864f82f21edfa P 31d7630573c8475a9f84978d4ebfb879: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/wal/wals/faef317e47a244c6965864f82f21edfa
I20260807 13:54:40.627028 4503 catalog_manager.cc:5028] TS 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729): tablet faef317e47a244c6965864f82f21edfa (table rebalance_test_table_8 [id=91303cf8b9064e06b8c4165942b287f2]) successfully deleted
I20260807 13:54:40.707917 5246 consensus_queue.cc:237] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:40.729180 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:40.767315 7353 raft_consensus.cc:1275] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:40.769026 22038 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:40.783082 22038 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:40.787051 7354 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:40.797307 4513 catalog_manager.cc:5697] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: config changed from index 8 to 9, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) evicted. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:40.803234 7502 tablet_service.cc:1558] Processing DeleteTablet for tablet 96bc42d66fa04fb69afa630969dbb579 with delete_type TABLET_DATA_TOMBSTONED (TS 8a9903f009ff46b4a6875490823076c4 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:39618
I20260807 13:54:40.804575 7690 raft_consensus.cc:1275] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:40.805598 22279 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:40.853101 22446 tablet_replica.cc:333] T 96bc42d66fa04fb69afa630969dbb579 P 8a9903f009ff46b4a6875490823076c4: stopping tablet replica
I20260807 13:54:40.854439 7690 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:40.865556 22446 raft_consensus.cc:2243] T 96bc42d66fa04fb69afa630969dbb579 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:40.865947 22446 raft_consensus.cc:2272] T 96bc42d66fa04fb69afa630969dbb579 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:40.868603 22446 ts_tablet_manager.cc:1916] T 96bc42d66fa04fb69afa630969dbb579 P 8a9903f009ff46b4a6875490823076c4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:40.910354 22446 ts_tablet_manager.cc:1929] T 96bc42d66fa04fb69afa630969dbb579 P 8a9903f009ff46b4a6875490823076c4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260807 13:54:40.925798 22446 log.cc:1199] T 96bc42d66fa04fb69afa630969dbb579 P 8a9903f009ff46b4a6875490823076c4: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal/wals/96bc42d66fa04fb69afa630969dbb579
I20260807 13:54:40.929459 4506 catalog_manager.cc:5028] TS 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): tablet 96bc42d66fa04fb69afa630969dbb579 (table rebalance_test_table_4 [id=e242e42da20d4458a49a269a9569307a]) successfully deleted
I20260807 13:54:41.000820 22483 ts_tablet_manager.cc:933] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:54:41.017710 22483 tablet_copy_client.cc:323] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:54:41.019397 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet d27ce55f2acc4513a9fd90a338098eeb from peer 8a9903f009ff46b4a6875490823076c4 ({username='slave'} at 127.23.107.135:53271)
I20260807 13:54:41.019644 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet d27ce55f2acc4513a9fd90a338098eeb from peer 8a9903f009ff46b4a6875490823076c4 at {username='slave'} at 127.23.107.135:53271: session id = 8a9903f009ff46b4a6875490823076c4-d27ce55f2acc4513a9fd90a338098eeb
I20260807 13:54:41.024114 5101 tablet_copy_source_session.cc:215] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:41.037285 22483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27ce55f2acc4513a9fd90a338098eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:41.131004 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:41.167362 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:41.169999 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:41.183337 22483 tablet_copy_client.cc:806] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:41.183723 22483 tablet_copy_client.cc:670] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:41.185621 22483 tablet_copy_client.cc:538] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:41.189409 22483 tablet_bootstrap.cc:492] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4: Bootstrap starting.
I20260807 13:54:41.207062 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:41.229178 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:41.253526 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:41.291191 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:54:41.301659 5151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.136:43729, user_credentials={real_user=slave}} blocked reactor thread for 96811.7us
I20260807 13:54:41.330996 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:41.348620 22483 tablet_bootstrap.cc:492] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:41.349105 22483 tablet_bootstrap.cc:492] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4: Bootstrap complete.
I20260807 13:54:41.349401 22483 ts_tablet_manager.cc:1403] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4: Time spent bootstrapping tablet: real 0.160s user 0.071s sys 0.013s
I20260807 13:54:41.350188 22483 raft_consensus.cc:359] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:41.350391 22483 raft_consensus.cc:740] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a9903f009ff46b4a6875490823076c4, State: Initialized, Role: FOLLOWER
I20260807 13:54:41.350647 22483 consensus_queue.cc:260] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:41.354552 22483 ts_tablet_manager.cc:1434] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260807 13:54:41.357797 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session 8a9903f009ff46b4a6875490823076c4-d27ce55f2acc4513a9fd90a338098eeb received from {username='slave'} at 127.23.107.135:53271
I20260807 13:54:41.357973 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session 8a9903f009ff46b4a6875490823076c4-d27ce55f2acc4513a9fd90a338098eeb on tablet d27ce55f2acc4513a9fd90a338098eeb with peer 8a9903f009ff46b4a6875490823076c4
I20260807 13:54:41.373723 7524 raft_consensus.cc:1217] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.8->[1.9-1.9] Dedup: 1.9->[]
I20260807 13:54:41.580106 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:41.588028 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:41.622428 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:41.631677 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:41.637269 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:41.646111 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:41.650406 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:41.684743 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:41.692044 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:41.714967 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:41.731775 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:41.750183 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:41.777043 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:41.783119 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:41.814498 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:41.834324 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:42.060523 4897 consensus_queue.cc:237] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:42.061791 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:42.066779 7178 raft_consensus.cc:1275] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:54:42.067476 21923 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:42.071436 5246 raft_consensus.cc:1275] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:54:42.072489 21923 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:42.089149 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:42.119431 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:42.129861 7178 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:42.136180 4515 catalog_manager.cc:5697] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: config changed from index 6 to 7, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) evicted. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:42.140856 5246 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:42.128232 22700 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:42.171711 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:42.172765 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
W20260807 13:54:42.203143 4805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.133:38075, user_credentials={real_user=slave}} blocked reactor thread for 67300.9us
I20260807 13:54:42.214988 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:42.252405 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:42.279801 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:42.313141 7502 tablet_service.cc:1558] Processing DeleteTablet for tablet 541201ddfdf041ed87b3d0e731763a37 with delete_type TABLET_DATA_TOMBSTONED (TS 8a9903f009ff46b4a6875490823076c4 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:39618
I20260807 13:54:42.328023 22724 tablet_replica.cc:333] T 541201ddfdf041ed87b3d0e731763a37 P 8a9903f009ff46b4a6875490823076c4: stopping tablet replica
I20260807 13:54:42.328497 22724 raft_consensus.cc:2243] T 541201ddfdf041ed87b3d0e731763a37 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:42.329031 22724 raft_consensus.cc:2272] T 541201ddfdf041ed87b3d0e731763a37 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:42.330082 22724 ts_tablet_manager.cc:1916] T 541201ddfdf041ed87b3d0e731763a37 P 8a9903f009ff46b4a6875490823076c4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:42.412395 22724 ts_tablet_manager.cc:1929] T 541201ddfdf041ed87b3d0e731763a37 P 8a9903f009ff46b4a6875490823076c4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20260807 13:54:42.412585 22724 log.cc:1199] T 541201ddfdf041ed87b3d0e731763a37 P 8a9903f009ff46b4a6875490823076c4: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal/wals/541201ddfdf041ed87b3d0e731763a37
I20260807 13:54:42.415508 4506 catalog_manager.cc:5028] TS 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): tablet 541201ddfdf041ed87b3d0e731763a37 (table rebalance_test_table_4 [id=e242e42da20d4458a49a269a9569307a]) successfully deleted
I20260807 13:54:42.634564 5246 consensus_queue.cc:237] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:42.637573 4897 raft_consensus.cc:1275] T e22d4edb78d24783bae07928b6c95fc2 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:54:42.638542 22038 consensus_queue.cc:1048] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:42.642024 7690 raft_consensus.cc:1275] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:54:42.642940 22038 consensus_queue.cc:1048] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:42.741940 22800 raft_consensus.cc:2955] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:42.754575 7690 raft_consensus.cc:2955] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:42.780237 4510 catalog_manager.cc:5697] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index 6 to 7, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:42.799311 5039 tablet_service.cc:1558] Processing DeleteTablet for tablet e22d4edb78d24783bae07928b6c95fc2 with delete_type TABLET_DATA_TOMBSTONED (TS 01adf83af3e04875b5fac9470d4da915 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:36810
I20260807 13:54:42.818362 22833 tablet_replica.cc:333] T e22d4edb78d24783bae07928b6c95fc2 P 01adf83af3e04875b5fac9470d4da915: stopping tablet replica
I20260807 13:54:42.818984 22833 raft_consensus.cc:2243] T e22d4edb78d24783bae07928b6c95fc2 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:42.819471 22833 raft_consensus.cc:2272] T e22d4edb78d24783bae07928b6c95fc2 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:42.820727 22833 ts_tablet_manager.cc:1916] T e22d4edb78d24783bae07928b6c95fc2 P 01adf83af3e04875b5fac9470d4da915: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260807 13:54:42.824213 5153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.130:37489, user_credentials={real_user=slave}} blocked reactor thread for 77252.7us
I20260807 13:54:42.826891 4897 raft_consensus.cc:2955] T e22d4edb78d24783bae07928b6c95fc2 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:42.832000 22833 ts_tablet_manager.cc:1929] T e22d4edb78d24783bae07928b6c95fc2 P 01adf83af3e04875b5fac9470d4da915: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20260807 13:54:42.832160 22833 log.cc:1199] T e22d4edb78d24783bae07928b6c95fc2 P 01adf83af3e04875b5fac9470d4da915: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/wals/e22d4edb78d24783bae07928b6c95fc2
I20260807 13:54:42.833662 4504 catalog_manager.cc:5028] TS 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): tablet e22d4edb78d24783bae07928b6c95fc2 (table rebalance_test_table_0 [id=14867b014aab43119171102f60bb134d]) successfully deleted
I20260807 13:54:42.876706 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:42.887923 5246 consensus_queue.cc:237] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:42.937628 7691 raft_consensus.cc:1275] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:42.938499 7178 raft_consensus.cc:1275] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:42.939383 22812 consensus_queue.cc:1048] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:42.950425 22812 consensus_queue.cc:1048] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:42.965986 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:42.966784 22816 raft_consensus.cc:2955] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:42.974824 7180 raft_consensus.cc:2955] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:42.975484 4510 catalog_manager.cc:5697] T c10b910e9f354933b60ae70f1baa9b6f P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index 8 to 9, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:42.987696 7327 tablet_service.cc:1558] Processing DeleteTablet for tablet c10b910e9f354933b60ae70f1baa9b6f with delete_type TABLET_DATA_TOMBSTONED (TS 12ab71778f2f4b378765aaed1a0676a5 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:47002
I20260807 13:54:43.029737 7691 raft_consensus.cc:2955] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:43.059134 22867 tablet_replica.cc:333] T c10b910e9f354933b60ae70f1baa9b6f P 12ab71778f2f4b378765aaed1a0676a5: stopping tablet replica
I20260807 13:54:43.059464 22867 raft_consensus.cc:2243] T c10b910e9f354933b60ae70f1baa9b6f P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:43.059814 22867 raft_consensus.cc:2272] T c10b910e9f354933b60ae70f1baa9b6f P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:43.099170 22867 ts_tablet_manager.cc:1916] T c10b910e9f354933b60ae70f1baa9b6f P 12ab71778f2f4b378765aaed1a0676a5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:43.100767 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:43.132683 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:43.134624 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:43.189721 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:43.200666 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:43.248073 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:43.262524 22867 ts_tablet_manager.cc:1929] T c10b910e9f354933b60ae70f1baa9b6f P 12ab71778f2f4b378765aaed1a0676a5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260807 13:54:43.264577 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:43.273710 22867 log.cc:1199] T c10b910e9f354933b60ae70f1baa9b6f P 12ab71778f2f4b378765aaed1a0676a5: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal/wals/c10b910e9f354933b60ae70f1baa9b6f
I20260807 13:54:43.278553 4506 catalog_manager.cc:5028] TS 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): tablet c10b910e9f354933b60ae70f1baa9b6f (table rebalance_test_table_3 [id=c2c7db1795a1414c8299bebbeaf60404]) successfully deleted
I20260807 13:54:43.299260 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:43.305106 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:43.317678 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:43.323348 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:43.360143 4688 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:43.376173 5068 consensus_queue.cc:237] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:43.407651 4897 raft_consensus.cc:1275] T ffa98a163d7540e3a911a39334657138 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20260807 13:54:43.408996 22398 consensus_queue.cc:1048] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260807 13:54:43.410835 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:43.420885 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
W20260807 13:54:43.471716 4981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.130:37489, user_credentials={real_user=slave}} blocked reactor thread for 63176.1us
I20260807 13:54:43.493327 7522 raft_consensus.cc:1275] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20260807 13:54:43.498572 22398 consensus_queue.cc:1048] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260807 13:54:43.538281 22398 raft_consensus.cc:2955] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:43.554636 4515 catalog_manager.cc:5697] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 12 to 13, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:43.556196 4897 raft_consensus.cc:2955] T ffa98a163d7540e3a911a39334657138 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:43.576988 7524 raft_consensus.cc:2955] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:43.635196 4688 tablet_service.cc:1558] Processing DeleteTablet for tablet ffa98a163d7540e3a911a39334657138 with delete_type TABLET_DATA_TOMBSTONED (TS fa83b7af134b4e3b949ac3b4e4bcb5e7 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:56314
I20260807 13:54:43.678617 22952 tablet_replica.cc:333] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: stopping tablet replica
I20260807 13:54:43.678929 22952 raft_consensus.cc:2243] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:43.679226 22952 raft_consensus.cc:2272] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:43.680426 22952 ts_tablet_manager.cc:1916] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:43.703409 22952 ts_tablet_manager.cc:1929] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.12
I20260807 13:54:43.705623 22952 log.cc:1199] T ffa98a163d7540e3a911a39334657138 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/wal/wals/ffa98a163d7540e3a911a39334657138
I20260807 13:54:43.710316 4506 catalog_manager.cc:5028] TS fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): tablet ffa98a163d7540e3a911a39334657138 (table rebalance_test_table_6 [id=6008038c907645199b055dacb5772621]) successfully deleted
I20260807 13:54:43.764092 7353 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "069a5f0089b24a609b27d4a07a3c4353"
dest_uuid: "12ab71778f2f4b378765aaed1a0676a5"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:43484
I20260807 13:54:43.764416 7353 raft_consensus.cc:606] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 LEADER]: Received request to transfer leadership
I20260807 13:54:43.810369 22994 raft_consensus.cc:993] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: : Instructing follower fa83b7af134b4e3b949ac3b4e4bcb5e7 to start an election
I20260807 13:54:43.810763 22371 raft_consensus.cc:1081] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 LEADER]: Signalling peer fa83b7af134b4e3b949ac3b4e4bcb5e7 to start an election
I20260807 13:54:43.812436 4716 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "069a5f0089b24a609b27d4a07a3c4353"
dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
from {username='slave'} at 127.23.107.134:34891
I20260807 13:54:43.812734 4716 raft_consensus.cc:493] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:54:43.812863 4716 raft_consensus.cc:3060] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:54:43.817606 4716 raft_consensus.cc:515] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:43.820287 7353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a5f0089b24a609b27d4a07a3c4353" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 9 } } ignore_live_leader: true dest_uuid: "12ab71778f2f4b378765aaed1a0676a5"
I20260807 13:54:43.828718 4716 leader_election.cc:290] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 3 election: Requested vote from peers 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975), 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:54:43.829126 7690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a5f0089b24a609b27d4a07a3c4353" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 9 } } ignore_live_leader: true dest_uuid: "31d7630573c8475a9f84978d4ebfb879"
I20260807 13:54:43.829391 7690 raft_consensus.cc:3060] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:54:43.829825 7353 raft_consensus.cc:3055] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:54:43.829979 7353 raft_consensus.cc:740] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Running, Role: LEADER
I20260807 13:54:43.830345 7353 consensus_queue.cc:260] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.9, Last appended by leader: 9, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:43.830906 7353 raft_consensus.cc:3060] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:54:43.830883 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a5f0089b24a609b27d4a07a3c4353" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 9 } } ignore_live_leader: true dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
I20260807 13:54:43.831113 4897 raft_consensus.cc:3060] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:54:43.834630 7353 raft_consensus.cc:2468] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 3.
I20260807 13:54:43.835983 7690 raft_consensus.cc:2468] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 3.
I20260807 13:54:43.837733 4897 raft_consensus.cc:2468] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 3.
I20260807 13:54:43.838748 4629 leader_election.cc:304] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5, 31d7630573c8475a9f84978d4ebfb879, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:54:43.839159 22885 raft_consensus.cc:2804] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:54:43.839672 22885 raft_consensus.cc:697] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 3 LEADER]: Becoming Leader. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Running, Role: LEADER
I20260807 13:54:43.840096 22885 consensus_queue.cc:237] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.9, Last appended by leader: 9, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:43.861562 4515 catalog_manager.cc:5697] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: term changed from 2 to 3, leader changed from 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) to fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129). New cstate: current_term: 3 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:44.046428 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:44.062193 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:44.121399 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:44.140192 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:44.164984 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:44.202410 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:44.217132 4688 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:44.234282 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:44.276351 4897 raft_consensus.cc:1275] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 3 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 3 index: 10. (index mismatch)
I20260807 13:54:44.276958 22885 consensus_queue.cc:1048] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:44.289614 7690 raft_consensus.cc:1275] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [term 3 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 3 index: 10. (index mismatch)
I20260807 13:54:44.290498 22885 consensus_queue.cc:1048] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:44.303097 7353 raft_consensus.cc:1275] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 3 index: 10. (index mismatch)
I20260807 13:54:44.303746 23000 consensus_queue.cc:1048] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:44.401809 4716 consensus_queue.cc:237] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:54:44.420279 7178 raft_consensus.cc:1275] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20260807 13:54:44.421707 5246 raft_consensus.cc:1275] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20260807 13:54:44.423151 22885 consensus_queue.cc:1048] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260807 13:54:44.423971 22885 consensus_queue.cc:1048] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260807 13:54:44.471895 23097 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:54:44.479579 7180 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:54:44.480662 4513 catalog_manager.cc:5697] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index 12 to 13, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:54:44.495735 5246 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:54:44.524685 5039 tablet_service.cc:1558] Processing DeleteTablet for tablet 966ebd287fc14e498e5bd3e6542194ca with delete_type TABLET_DATA_TOMBSTONED (TS 01adf83af3e04875b5fac9470d4da915 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:36810
I20260807 13:54:44.573252 5037 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:44.606838 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:44.614428 23138 tablet_replica.cc:333] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915: stopping tablet replica
I20260807 13:54:44.614665 23138 raft_consensus.cc:2243] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:44.614995 23138 raft_consensus.cc:2272] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:44.615810 23138 ts_tablet_manager.cc:1916] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:44.631590 23138 ts_tablet_manager.cc:1929] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.12
I20260807 13:54:44.631742 23138 log.cc:1199] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/wals/966ebd287fc14e498e5bd3e6542194ca
I20260807 13:54:44.632032 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:44.632750 4504 catalog_manager.cc:5028] TS 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): tablet 966ebd287fc14e498e5bd3e6542194ca (table rebalance_test_table_6 [id=6008038c907645199b055dacb5772621]) successfully deleted
I20260807 13:54:44.662458 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:44.722251 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:44.771452 4688 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:44.772660 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:44.805833 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:45.047197 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:45.147604 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:45.158164 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:45.164337 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:45.169101 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:45.186182 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:45.188517 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:45.202196 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:45.248328 5068 consensus_queue.cc:237] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:45.258193 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:45.309782 7522 raft_consensus.cc:1275] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260807 13:54:45.309828 4716 raft_consensus.cc:1275] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260807 13:54:45.313859 23213 consensus_queue.cc:1048] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:54:45.314258 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:45.316926 23213 consensus_queue.cc:1048] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:54:45.319119 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260807 13:54:45.323037 5152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.131:40441, user_credentials={real_user=slave}} blocked reactor thread for 43528.5us
I20260807 13:54:45.375079 23048 raft_consensus.cc:2955] T 43f5461808a646c885d593f782538930 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:45.395648 4716 raft_consensus.cc:2955] T 43f5461808a646c885d593f782538930 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:45.403224 7524 raft_consensus.cc:2955] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:45.411849 4513 catalog_manager.cc:5697] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 reported cstate change: config changed from index 10 to 11, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) evicted. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:45.442548 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:45.461212 4688 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:45.496088 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:45.538880 7668 tablet_service.cc:1558] Processing DeleteTablet for tablet 43f5461808a646c885d593f782538930 with delete_type TABLET_DATA_TOMBSTONED (TS 31d7630573c8475a9f84978d4ebfb879 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:56664
I20260807 13:54:45.558264 4688 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:45.564754 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:45.583745 23271 tablet_replica.cc:333] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879: stopping tablet replica
I20260807 13:54:45.584141 23271 raft_consensus.cc:2243] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:45.584476 23271 raft_consensus.cc:2272] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:45.590826 23271 ts_tablet_manager.cc:1916] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:45.670718 23271 ts_tablet_manager.cc:1929] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.10
I20260807 13:54:45.670945 23271 log.cc:1199] T 43f5461808a646c885d593f782538930 P 31d7630573c8475a9f84978d4ebfb879: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/wal/wals/43f5461808a646c885d593f782538930
I20260807 13:54:45.676828 4503 catalog_manager.cc:5028] TS 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729): tablet 43f5461808a646c885d593f782538930 (table rebalance_test_table_4 [id=e242e42da20d4458a49a269a9569307a]) successfully deleted
I20260807 13:54:45.867002 4897 consensus_queue.cc:237] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:54:45.898278 5246 raft_consensus.cc:1275] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260807 13:54:45.899336 23079 consensus_queue.cc:1048] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:45.901136 5068 raft_consensus.cc:1275] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260807 13:54:45.903286 23079 consensus_queue.cc:1048] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:45.915104 7178 raft_consensus.cc:1275] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260807 13:54:45.921666 23079 consensus_queue.cc:1048] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:45.937453 23079 raft_consensus.cc:2955] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:45.942970 5246 raft_consensus.cc:2955] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:45.956909 4513 catalog_manager.cc:5697] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:45.963928 5068 raft_consensus.cc:2955] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:45.966176 7327 tablet_service.cc:1558] Processing DeleteTablet for tablet 312c7ed04e334b08b506c8908224a7da with delete_type TABLET_DATA_TOMBSTONED (TS 12ab71778f2f4b378765aaed1a0676a5 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:47002
I20260807 13:54:45.982398 7180 raft_consensus.cc:2955] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:45.984164 23350 tablet_replica.cc:333] T 312c7ed04e334b08b506c8908224a7da P 12ab71778f2f4b378765aaed1a0676a5: stopping tablet replica
I20260807 13:54:45.984589 23350 raft_consensus.cc:2243] T 312c7ed04e334b08b506c8908224a7da P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:45.985040 23350 raft_consensus.cc:2272] T 312c7ed04e334b08b506c8908224a7da P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:45.986214 23350 ts_tablet_manager.cc:1916] T 312c7ed04e334b08b506c8908224a7da P 12ab71778f2f4b378765aaed1a0676a5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:46.022933 23350 ts_tablet_manager.cc:1929] T 312c7ed04e334b08b506c8908224a7da P 12ab71778f2f4b378765aaed1a0676a5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20260807 13:54:46.023202 23350 log.cc:1199] T 312c7ed04e334b08b506c8908224a7da P 12ab71778f2f4b378765aaed1a0676a5: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal/wals/312c7ed04e334b08b506c8908224a7da
I20260807 13:54:46.025646 4506 catalog_manager.cc:5028] TS 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): tablet 312c7ed04e334b08b506c8908224a7da (table rebalance_test_table_5 [id=b6c061acc30c4e5aa6bee1f054e3a59a]) successfully deleted
I20260807 13:54:46.135874 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:46.168370 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:46.183876 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:46.199258 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:46.202244 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:46.293434 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:46.317839 4688 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:46.338084 5068 consensus_queue.cc:237] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
W20260807 13:54:46.349203 4982 consensus_peers.cc:597] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:46.350092 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:46.352340 4897 raft_consensus.cc:1275] T 739f4f0207104455bf3e87bc04f8d13c P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260807 13:54:46.352972 23258 consensus_queue.cc:1048] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:46.355556 7524 raft_consensus.cc:1275] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260807 13:54:46.357788 23258 consensus_queue.cc:1048] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260807 13:54:46.400928 4982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.135:40385, user_credentials={real_user=slave}} blocked reactor thread for 44724.4us
I20260807 13:54:46.432340 23258 raft_consensus.cc:2955] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:46.437192 4892 raft_consensus.cc:2955] T 739f4f0207104455bf3e87bc04f8d13c P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:46.446182 4515 catalog_manager.cc:5697] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:46.473534 4716 consensus_queue.cc:237] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 3.10, Last appended by leader: 9, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:46.477614 7524 raft_consensus.cc:2955] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:46.493017 4892 raft_consensus.cc:1275] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 3 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 3 index: 10. Preceding OpId from leader: term: 3 index: 11. (index mismatch)
I20260807 13:54:46.493824 23205 consensus_queue.cc:1048] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:54:46.512363 23452 raft_consensus.cc:2955] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 3 LEADER]: Committing config change with OpId 3.11: config changed from index 9 to 11, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:46.513044 4892 raft_consensus.cc:2955] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 3 FOLLOWER]: Committing config change with OpId 3.11: config changed from index 9 to 11, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:46.518288 7688 raft_consensus.cc:1275] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [term 3 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 3 index: 10. Preceding OpId from leader: term: 3 index: 11. (index mismatch)
I20260807 13:54:46.518976 23205 consensus_queue.cc:1048] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:54:46.520444 4513 catalog_manager.cc:5697] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index 9 to 11, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New cstate: current_term: 3 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:46.550815 7327 tablet_service.cc:1558] Processing DeleteTablet for tablet 069a5f0089b24a609b27d4a07a3c4353 with delete_type TABLET_DATA_TOMBSTONED (TS 12ab71778f2f4b378765aaed1a0676a5 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:47002
I20260807 13:54:46.561957 7688 raft_consensus.cc:2955] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [term 3 FOLLOWER]: Committing config change with OpId 3.11: config changed from index 9 to 11, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:46.576381 23460 tablet_replica.cc:333] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: stopping tablet replica
I20260807 13:54:46.577579 23460 raft_consensus.cc:2243] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:46.578128 23460 raft_consensus.cc:2272] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:46.579010 23460 ts_tablet_manager.cc:1916] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:46.599514 23460 ts_tablet_manager.cc:1929] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.10
I20260807 13:54:46.600946 23460 log.cc:1199] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal/wals/069a5f0089b24a609b27d4a07a3c4353
I20260807 13:54:46.602223 4506 catalog_manager.cc:5028] TS 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): tablet 069a5f0089b24a609b27d4a07a3c4353 (table rebalance_test_table_5 [id=b6c061acc30c4e5aa6bee1f054e3a59a]) successfully deleted
I20260807 13:54:46.674866 5246 consensus_queue.cc:237] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:46.678541 7353 raft_consensus.cc:1275] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
W20260807 13:54:46.679267 5153 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 96bc42d66fa04fb69afa630969dbb579. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:46.679368 23251 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:46.680850 7688 raft_consensus.cc:1275] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260807 13:54:46.721971 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:54:46.745440 23513 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:46.754622 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:46.774964 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:46.775018 23513 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:46.781560 7353 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:46.790979 4513 catalog_manager.cc:5697] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: config changed from index 9 to 10, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:46.791958 7688 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:46.836331 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:46.862032 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:46.885743 23555 ts_tablet_manager.cc:933] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:54:46.888046 23555 tablet_copy_client.cc:323] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:54:46.889513 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet 739f4f0207104455bf3e87bc04f8d13c from peer 12ab71778f2f4b378765aaed1a0676a5 ({username='slave'} at 127.23.107.134:57547)
I20260807 13:54:46.889694 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet 739f4f0207104455bf3e87bc04f8d13c from peer 12ab71778f2f4b378765aaed1a0676a5 at {username='slave'} at 127.23.107.134:57547: session id = 12ab71778f2f4b378765aaed1a0676a5-739f4f0207104455bf3e87bc04f8d13c
I20260807 13:54:46.893191 5101 tablet_copy_source_session.cc:215] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:46.895524 23555 ts_tablet_manager.cc:1916] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:54:46.906785 5246 consensus_queue.cc:237] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:46.917390 23555 ts_tablet_manager.cc:1929] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.8
I20260807 13:54:46.919708 23555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739f4f0207104455bf3e87bc04f8d13c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:46.921478 4716 raft_consensus.cc:1275] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:46.922183 23251 consensus_queue.cc:1048] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:46.925792 4892 raft_consensus.cc:1275] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:46.926491 23251 consensus_queue.cc:1048] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:46.933987 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:46.935957 23555 tablet_copy_client.cc:806] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:46.936827 23555 tablet_copy_client.cc:670] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:46.945330 23555 tablet_copy_client.cc:538] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:46.949599 23513 raft_consensus.cc:2955] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:46.950258 4892 raft_consensus.cc:2955] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:46.956864 23555 tablet_bootstrap.cc:492] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap starting.
I20260807 13:54:46.972313 4515 catalog_manager.cc:5697] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index 8 to 9, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) evicted. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:46.976608 7668 tablet_service.cc:1558] Processing DeleteTablet for tablet 50a090faa58e4f91961c9251030efacf with delete_type TABLET_DATA_TOMBSTONED (TS 31d7630573c8475a9f84978d4ebfb879 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:56664
I20260807 13:54:47.001063 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:47.029683 23581 tablet_replica.cc:333] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879: stopping tablet replica
I20260807 13:54:47.031826 23581 raft_consensus.cc:2243] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:47.032366 23581 raft_consensus.cc:2272] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:47.044422 23581 ts_tablet_manager.cc:1916] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:47.052484 4716 raft_consensus.cc:2955] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:54:47.053439 4688 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:47.073628 23555 tablet_bootstrap.cc:492] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:47.074846 23555 tablet_bootstrap.cc:492] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap complete.
I20260807 13:54:47.076004 23555 ts_tablet_manager.cc:1403] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5: Time spent bootstrapping tablet: real 0.119s user 0.056s sys 0.003s
I20260807 13:54:47.081367 23555 raft_consensus.cc:359] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:47.083161 23555 raft_consensus.cc:740] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Initialized, Role: FOLLOWER
I20260807 13:54:47.083938 23555 consensus_queue.cc:260] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:47.116065 23555 ts_tablet_manager.cc:1434] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5: Time spent starting tablet: real 0.036s user 0.000s sys 0.002s
I20260807 13:54:47.123171 23581 ts_tablet_manager.cc:1929] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260807 13:54:47.123172 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session 12ab71778f2f4b378765aaed1a0676a5-739f4f0207104455bf3e87bc04f8d13c received from {username='slave'} at 127.23.107.134:57547
I20260807 13:54:47.123330 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session 12ab71778f2f4b378765aaed1a0676a5-739f4f0207104455bf3e87bc04f8d13c on tablet 739f4f0207104455bf3e87bc04f8d13c with peer 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:54:47.123458 23581 log.cc:1199] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/wal/wals/50a090faa58e4f91961c9251030efacf
I20260807 13:54:47.124570 4503 catalog_manager.cc:5028] TS 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729): tablet 50a090faa58e4f91961c9251030efacf (table rebalance_test_table_8 [id=91303cf8b9064e06b8c4165942b287f2]) successfully deleted
I20260807 13:54:47.128652 5068 consensus_queue.cc:237] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
W20260807 13:54:47.147465 4982 consensus_peers.cc:597] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 16afb6ff06704a8795f1de84ffa81de0. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:47.149091 7180 raft_consensus.cc:1275] T 16afb6ff06704a8795f1de84ffa81de0 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260807 13:54:47.149966 23436 consensus_queue.cc:1048] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:47.159132 7524 raft_consensus.cc:1275] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260807 13:54:47.160359 23258 consensus_queue.cc:1048] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:47.176633 23258 raft_consensus.cc:2955] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:47.182667 7522 raft_consensus.cc:2955] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:47.193142 4513 catalog_manager.cc:5697] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 reported cstate change: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:47.193496 7180 raft_consensus.cc:2955] T 16afb6ff06704a8795f1de84ffa81de0 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:47.262449 23618 ts_tablet_manager.cc:933] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:54:47.270293 5068 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81cbb42cd4954383976169ec16ef2416"
dest_uuid: "01adf83af3e04875b5fac9470d4da915"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:50434
I20260807 13:54:47.270560 5068 raft_consensus.cc:606] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Received request to transfer leadership
I20260807 13:54:47.302017 23618 tablet_copy_client.cc:323] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:54:47.302847 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet 96bc42d66fa04fb69afa630969dbb579 from peer c9d2944272bc447dafce7620ac2dbd4b ({username='slave'} at 127.23.107.130:56979)
I20260807 13:54:47.302989 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet 96bc42d66fa04fb69afa630969dbb579 from peer c9d2944272bc447dafce7620ac2dbd4b at {username='slave'} at 127.23.107.130:56979: session id = c9d2944272bc447dafce7620ac2dbd4b-96bc42d66fa04fb69afa630969dbb579
I20260807 13:54:47.306644 5272 tablet_copy_source_session.cc:215] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:47.308398 23618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96bc42d66fa04fb69afa630969dbb579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:47.380391 7353 raft_consensus.cc:1217] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.9->[1.10-1.10] Dedup: 1.10->[]
I20260807 13:54:47.406101 23618 tablet_copy_client.cc:806] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:47.406518 23618 tablet_copy_client.cc:670] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:47.409019 23618 tablet_copy_client.cc:538] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:47.430631 23618 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:54:47.435796 23258 raft_consensus.cc:993] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915: : Instructing follower fa83b7af134b4e3b949ac3b4e4bcb5e7 to start an election
I20260807 13:54:47.435915 23258 raft_consensus.cc:1081] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Signalling peer fa83b7af134b4e3b949ac3b4e4bcb5e7 to start an election
I20260807 13:54:47.436646 4716 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81cbb42cd4954383976169ec16ef2416"
dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
from {username='slave'} at 127.23.107.131:50563
I20260807 13:54:47.436829 4716 raft_consensus.cc:493] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:54:47.436910 4716 raft_consensus.cc:3060] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:54:47.440232 4716 raft_consensus.cc:515] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:47.441648 5068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81cbb42cd4954383976169ec16ef2416" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: true dest_uuid: "01adf83af3e04875b5fac9470d4da915"
I20260807 13:54:47.441879 5068 raft_consensus.cc:3055] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:54:47.441946 5068 raft_consensus.cc:740] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Running, Role: LEADER
I20260807 13:54:47.442266 5068 consensus_queue.cc:260] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:47.442749 5068 raft_consensus.cc:3060] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:54:47.446759 5068 raft_consensus.cc:2468] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 2.
I20260807 13:54:47.448453 7353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81cbb42cd4954383976169ec16ef2416" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: true dest_uuid: "12ab71778f2f4b378765aaed1a0676a5"
I20260807 13:54:47.448732 7353 raft_consensus.cc:3060] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:54:47.452294 7353 raft_consensus.cc:2468] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 2.
I20260807 13:54:47.453174 4632 leader_election.cc:304] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, 12ab71778f2f4b378765aaed1a0676a5, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:54:47.453636 23452 raft_consensus.cc:2804] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:54:47.456281 7688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81cbb42cd4954383976169ec16ef2416" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: true dest_uuid: "31d7630573c8475a9f84978d4ebfb879"
I20260807 13:54:47.456665 7688 raft_consensus.cc:3060] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:54:47.460660 7688 raft_consensus.cc:2468] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 2.
I20260807 13:54:47.477001 4716 leader_election.cc:290] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 2 election: Requested vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975), 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729)
I20260807 13:54:47.539358 23452 raft_consensus.cc:697] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 LEADER]: Becoming Leader. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Running, Role: LEADER
I20260807 13:54:47.539861 23452 consensus_queue.cc:237] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:47.556582 23555 ts_tablet_manager.cc:933] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:54:47.559042 4510 catalog_manager.cc:5697] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: term changed from 1 to 2, leader changed from 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) to fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129). New cstate: current_term: 2 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:47.586225 5246 consensus_queue.cc:237] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:47.589991 23555 tablet_copy_client.cc:323] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:54:47.590930 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet 16afb6ff06704a8795f1de84ffa81de0 from peer 12ab71778f2f4b378765aaed1a0676a5 ({username='slave'} at 127.23.107.134:57547)
I20260807 13:54:47.591109 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet 16afb6ff06704a8795f1de84ffa81de0 from peer 12ab71778f2f4b378765aaed1a0676a5 at {username='slave'} at 127.23.107.134:57547: session id = 12ab71778f2f4b378765aaed1a0676a5-16afb6ff06704a8795f1de84ffa81de0
W20260807 13:54:47.597870 5154 consensus_peers.cc:597] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1715828a5d96455abecae985d1dca004. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:47.599022 5101 tablet_copy_source_session.cc:215] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:47.599382 4897 raft_consensus.cc:1275] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260807 13:54:47.600345 23513 consensus_queue.cc:1048] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:47.610468 23555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16afb6ff06704a8795f1de84ffa81de0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:47.614409 7180 raft_consensus.cc:1275] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260807 13:54:47.615657 23513 consensus_queue.cc:1048] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:47.648000 23513 raft_consensus.cc:2955] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:47.650203 4892 raft_consensus.cc:2955] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:47.658242 4510 catalog_manager.cc:5697] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:47.680565 23555 tablet_copy_client.cc:806] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:47.680922 23555 tablet_copy_client.cc:670] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:47.701709 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
W20260807 13:54:47.718533 5153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.130:37489, user_credentials={real_user=slave}} blocked reactor thread for 59790.2us
I20260807 13:54:47.719414 7180 raft_consensus.cc:2955] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:47.732118 23555 tablet_copy_client.cc:538] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:47.766409 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:47.782742 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:47.785964 23555 tablet_bootstrap.cc:492] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap starting.
I20260807 13:54:47.787545 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:47.866158 23618 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:47.872195 23618 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap complete.
I20260807 13:54:47.908581 23618 ts_tablet_manager.cc:1403] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.478s user 0.061s sys 0.022s
I20260807 13:54:47.910281 23618 raft_consensus.cc:359] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:47.923683 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:47.928367 23618 raft_consensus.cc:740] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:54:47.928798 23618 consensus_queue.cc:260] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:47.929697 23618 ts_tablet_manager.cc:1434] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.021s user 0.003s sys 0.000s
I20260807 13:54:47.931391 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:47.939606 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session c9d2944272bc447dafce7620ac2dbd4b-96bc42d66fa04fb69afa630969dbb579 received from {username='slave'} at 127.23.107.130:56979
I20260807 13:54:47.939744 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session c9d2944272bc447dafce7620ac2dbd4b-96bc42d66fa04fb69afa630969dbb579 on tablet 96bc42d66fa04fb69afa630969dbb579 with peer c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:54:47.973589 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:47.999265 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:48.019634 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:48.038859 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:48.058728 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:48.085323 7688 raft_consensus.cc:1275] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20260807 13:54:48.086483 23676 consensus_queue.cc:1048] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:48.104851 7352 raft_consensus.cc:1275] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20260807 13:54:48.107347 23676 consensus_queue.cc:1048] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:48.108577 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:48.111775 23767 ts_tablet_manager.cc:933] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:54:48.134681 5068 raft_consensus.cc:1275] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20260807 13:54:48.135615 23676 consensus_queue.cc:1048] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:54:48.158311 23767 tablet_copy_client.cc:323] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:54:48.159287 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet 1715828a5d96455abecae985d1dca004 from peer 12ab71778f2f4b378765aaed1a0676a5 ({username='slave'} at 127.23.107.134:42065)
I20260807 13:54:48.159461 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet 1715828a5d96455abecae985d1dca004 from peer 12ab71778f2f4b378765aaed1a0676a5 at {username='slave'} at 127.23.107.134:42065: session id = 12ab71778f2f4b378765aaed1a0676a5-1715828a5d96455abecae985d1dca004
I20260807 13:54:48.162752 5272 tablet_copy_source_session.cc:215] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:48.192255 23767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1715828a5d96455abecae985d1dca004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:48.211572 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:48.221729 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:48.229535 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260807 13:54:48.210765 23782 log.cc:927] Time spent T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5: Append to log took a long time: real 0.053s user 0.000s sys 0.000s
I20260807 13:54:48.270771 4716 consensus_queue.cc:237] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
W20260807 13:54:48.296216 4632 consensus_peers.cc:597] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:48.297784 4892 raft_consensus.cc:1275] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260807 13:54:48.298534 7180 raft_consensus.cc:1275] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260807 13:54:48.299124 23676 consensus_queue.cc:1048] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:48.299520 23781 consensus_queue.cc:1048] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:48.309068 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:48.333544 4897 raft_consensus.cc:1217] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.9->[1.10-1.10] Dedup: 1.10->[]
I20260807 13:54:48.355477 23781 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:48.358161 7178 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:48.387374 4892 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:48.390244 23767 tablet_copy_client.cc:806] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:48.390566 23767 tablet_copy_client.cc:670] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:48.391063 4510 catalog_manager.cc:5697] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index 9 to 10, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:48.392585 23767 tablet_copy_client.cc:538] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:48.396596 23767 tablet_bootstrap.cc:492] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap starting.
I20260807 13:54:48.415895 23555 tablet_bootstrap.cc:492] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:48.416420 23555 tablet_bootstrap.cc:492] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap complete.
I20260807 13:54:48.416713 23555 ts_tablet_manager.cc:1403] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5: Time spent bootstrapping tablet: real 0.631s user 0.055s sys 0.010s
I20260807 13:54:48.417606 23555 raft_consensus.cc:359] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:48.417887 23555 raft_consensus.cc:740] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Initialized, Role: FOLLOWER
I20260807 13:54:48.418216 23555 consensus_queue.cc:260] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:48.418738 23555 ts_tablet_manager.cc:1434] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 13:54:48.422120 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session 12ab71778f2f4b378765aaed1a0676a5-16afb6ff06704a8795f1de84ffa81de0 received from {username='slave'} at 127.23.107.134:57547
I20260807 13:54:48.422276 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session 12ab71778f2f4b378765aaed1a0676a5-16afb6ff06704a8795f1de84ffa81de0 on tablet 16afb6ff06704a8795f1de84ffa81de0 with peer 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:54:48.508812 4982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.135:40385, user_credentials={real_user=slave}} blocked reactor thread for 72763.2us
I20260807 13:54:48.517511 7354 raft_consensus.cc:1217] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.9->[1.10-1.10] Dedup: 1.10->[]
I20260807 13:54:48.536585 23767 tablet_bootstrap.cc:492] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:48.537279 23767 tablet_bootstrap.cc:492] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap complete.
I20260807 13:54:48.537742 23767 ts_tablet_manager.cc:1403] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5: Time spent bootstrapping tablet: real 0.141s user 0.053s sys 0.021s
I20260807 13:54:48.538870 23767 raft_consensus.cc:359] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:48.539317 23767 raft_consensus.cc:740] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Initialized, Role: FOLLOWER
I20260807 13:54:48.544639 23767 consensus_queue.cc:260] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:48.545563 23767 ts_tablet_manager.cc:1434] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260807 13:54:48.548066 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session 12ab71778f2f4b378765aaed1a0676a5-1715828a5d96455abecae985d1dca004 received from {username='slave'} at 127.23.107.134:42065
I20260807 13:54:48.548318 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session 12ab71778f2f4b378765aaed1a0676a5-1715828a5d96455abecae985d1dca004 on tablet 1715828a5d96455abecae985d1dca004 with peer 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:54:48.702098 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:48.711885 23767 ts_tablet_manager.cc:933] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:54:48.728698 23767 tablet_copy_client.cc:323] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:54:48.729568 4748 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet 68717842b14e4f06b528c08a65acd3b7 from peer 12ab71778f2f4b378765aaed1a0676a5 ({username='slave'} at 127.23.107.134:34891)
I20260807 13:54:48.729849 4748 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet 68717842b14e4f06b528c08a65acd3b7 from peer 12ab71778f2f4b378765aaed1a0676a5 at {username='slave'} at 127.23.107.134:34891: session id = 12ab71778f2f4b378765aaed1a0676a5-68717842b14e4f06b528c08a65acd3b7
I20260807 13:54:48.736114 4748 tablet_copy_source_session.cc:215] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:48.737401 23767 ts_tablet_manager.cc:1916] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:54:48.747217 23767 ts_tablet_manager.cc:1929] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.8
I20260807 13:54:48.747522 23767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68717842b14e4f06b528c08a65acd3b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:48.759302 23767 tablet_copy_client.cc:806] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:48.759541 23767 tablet_copy_client.cc:670] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:48.772967 23767 tablet_copy_client.cc:538] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:48.773871 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:48.783113 23767 tablet_bootstrap.cc:492] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap starting.
I20260807 13:54:48.818897 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:48.832165 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:48.857194 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260807 13:54:48.900709 4806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.129:32841, user_credentials={real_user=slave}} blocked reactor thread for 64442.1us
W20260807 13:54:48.917762 7444 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:41217, user_credentials={real_user=slave}} blocked reactor thread for 46918.6us
I20260807 13:54:48.930684 7354 raft_consensus.cc:1217] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.9->[1.10-1.10] Dedup: 1.10->[]
I20260807 13:54:48.938093 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:48.981598 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:48.992367 5068 consensus_queue.cc:237] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:49.006342 7522 raft_consensus.cc:1275] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:49.006858 7354 raft_consensus.cc:1275] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:49.007336 23436 consensus_queue.cc:1048] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:49.008249 23436 consensus_queue.cc:1048] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:49.027251 23436 raft_consensus.cc:2955] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:49.035233 4510 catalog_manager.cc:5697] T eab259b597a64c04869543ccb1d9038c P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 8 to 9, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) evicted. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:49.079597 7354 raft_consensus.cc:2955] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
W20260807 13:54:49.130582 23767 log.cc:927] Time spent T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: Append to log took a long time: real 0.055s user 0.001s sys 0.000s
I20260807 13:54:49.145242 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:49.222872 7158 tablet_service.cc:1558] Processing DeleteTablet for tablet eab259b597a64c04869543ccb1d9038c with delete_type TABLET_DATA_TOMBSTONED (TS b77f2b2eade540c6bfd4f75e5229a3cd not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:33148
I20260807 13:54:49.231876 23942 tablet_replica.cc:333] T eab259b597a64c04869543ccb1d9038c P b77f2b2eade540c6bfd4f75e5229a3cd: stopping tablet replica
I20260807 13:54:49.237015 23942 raft_consensus.cc:2243] T eab259b597a64c04869543ccb1d9038c P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:49.237476 23942 raft_consensus.cc:2272] T eab259b597a64c04869543ccb1d9038c P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:49.251345 23942 ts_tablet_manager.cc:1916] T eab259b597a64c04869543ccb1d9038c P b77f2b2eade540c6bfd4f75e5229a3cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:49.291332 23767 tablet_bootstrap.cc:492] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:49.292040 23767 tablet_bootstrap.cc:492] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap complete.
I20260807 13:54:49.292435 23767 ts_tablet_manager.cc:1403] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: Time spent bootstrapping tablet: real 0.509s user 0.063s sys 0.001s
I20260807 13:54:49.293843 23767 raft_consensus.cc:359] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:49.294396 23767 raft_consensus.cc:740] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Initialized, Role: FOLLOWER
I20260807 13:54:49.294858 23767 consensus_queue.cc:260] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:49.295527 23767 ts_tablet_manager.cc:1434] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: Time spent starting tablet: real 0.003s user 0.005s sys 0.000s
I20260807 13:54:49.296797 4748 tablet_copy_service.cc:342] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Request end of tablet copy session 12ab71778f2f4b378765aaed1a0676a5-68717842b14e4f06b528c08a65acd3b7 received from {username='slave'} at 127.23.107.134:34891
I20260807 13:54:49.296965 4748 tablet_copy_service.cc:434] P fa83b7af134b4e3b949ac3b4e4bcb5e7: ending tablet copy session 12ab71778f2f4b378765aaed1a0676a5-68717842b14e4f06b528c08a65acd3b7 on tablet 68717842b14e4f06b528c08a65acd3b7 with peer 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:54:49.353273 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:49.392303 23942 ts_tablet_manager.cc:1929] T eab259b597a64c04869543ccb1d9038c P b77f2b2eade540c6bfd4f75e5229a3cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260807 13:54:49.392522 23942 log.cc:1199] T eab259b597a64c04869543ccb1d9038c P b77f2b2eade540c6bfd4f75e5229a3cd: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal/wals/eab259b597a64c04869543ccb1d9038c
I20260807 13:54:49.393605 4505 catalog_manager.cc:5028] TS b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): tablet eab259b597a64c04869543ccb1d9038c (table rebalance_test_table_7 [id=2ff801ea568346e096cc895a279c109c]) successfully deleted
I20260807 13:54:49.425762 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:49.426518 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:49.454299 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:49.487931 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:49.502305 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:49.509708 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:49.579437 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:49.610610 7524 raft_consensus.cc:2955] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:54:49.670290 5246 consensus_queue.cc:237] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:49.692596 7354 raft_consensus.cc:1275] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:49.694480 23931 consensus_queue.cc:1048] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:49.715092 7688 raft_consensus.cc:1275] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:54:49.715847 23931 consensus_queue.cc:1048] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:49.723863 23931 raft_consensus.cc:2955] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:49.728799 7354 raft_consensus.cc:2955] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:49.739020 4513 catalog_manager.cc:5697] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: config changed from index 8 to 9, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:49.774017 7688 raft_consensus.cc:2955] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:49.782671 7354 raft_consensus.cc:1217] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.9->[1.10-1.10] Dedup: 1.10->[]
I20260807 13:54:49.897387 5039 tablet_service.cc:1558] Processing DeleteTablet for tablet 242a68df09cb4c7d9522a33d259ebf78 with delete_type TABLET_DATA_TOMBSTONED (TS 01adf83af3e04875b5fac9470d4da915 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:36810
I20260807 13:54:49.901386 24059 tablet_replica.cc:333] T 242a68df09cb4c7d9522a33d259ebf78 P 01adf83af3e04875b5fac9470d4da915: stopping tablet replica
I20260807 13:54:49.902370 24059 raft_consensus.cc:2243] T 242a68df09cb4c7d9522a33d259ebf78 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:49.904678 24059 raft_consensus.cc:2272] T 242a68df09cb4c7d9522a33d259ebf78 P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:49.906356 24059 ts_tablet_manager.cc:1916] T 242a68df09cb4c7d9522a33d259ebf78 P 01adf83af3e04875b5fac9470d4da915: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:49.924206 24059 ts_tablet_manager.cc:1929] T 242a68df09cb4c7d9522a33d259ebf78 P 01adf83af3e04875b5fac9470d4da915: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260807 13:54:49.924484 24059 log.cc:1199] T 242a68df09cb4c7d9522a33d259ebf78 P 01adf83af3e04875b5fac9470d4da915: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/wals/242a68df09cb4c7d9522a33d259ebf78
I20260807 13:54:49.989519 4504 catalog_manager.cc:5028] TS 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): tablet 242a68df09cb4c7d9522a33d259ebf78 (table rebalance_test_table_6 [id=6008038c907645199b055dacb5772621]) successfully deleted
I20260807 13:54:50.089660 4715 consensus_queue.cc:237] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 2.7, Last appended by leader: 6, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:50.105023 7354 raft_consensus.cc:1275] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 2 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260807 13:54:50.106997 7688 raft_consensus.cc:1275] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 2 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260807 13:54:50.107859 23781 consensus_queue.cc:1048] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:50.108525 23781 consensus_queue.cc:1048] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:50.115067 23781 raft_consensus.cc:2955] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 LEADER]: Committing config change with OpId 2.8: config changed from index 6 to 8, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:50.123890 7688 raft_consensus.cc:2955] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Committing config change with OpId 2.8: config changed from index 6 to 8, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:50.147162 4513 catalog_manager.cc:5697] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 reported cstate change: config changed from index 6 to 8, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New cstate: current_term: 2 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:50.153657 5039 tablet_service.cc:1558] Processing DeleteTablet for tablet 81cbb42cd4954383976169ec16ef2416 with delete_type TABLET_DATA_TOMBSTONED (TS 01adf83af3e04875b5fac9470d4da915 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:36810
I20260807 13:54:50.153331 7354 raft_consensus.cc:2955] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Committing config change with OpId 2.8: config changed from index 6 to 8, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:50.154121 24059 tablet_replica.cc:333] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915: stopping tablet replica
I20260807 13:54:50.154498 24059 raft_consensus.cc:2243] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:50.154886 24059 raft_consensus.cc:2272] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:50.156106 24059 ts_tablet_manager.cc:1916] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:50.176568 24059 ts_tablet_manager.cc:1929] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.7
I20260807 13:54:50.177062 24059 log.cc:1199] T 81cbb42cd4954383976169ec16ef2416 P 01adf83af3e04875b5fac9470d4da915: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/wals/81cbb42cd4954383976169ec16ef2416
I20260807 13:54:50.178507 4504 catalog_manager.cc:5028] TS 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): tablet 81cbb42cd4954383976169ec16ef2416 (table rebalance_test_table_9 [id=96e83925faa542ffa4808b01a5adbbb3]) successfully deleted
W20260807 13:54:50.218497 4981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.133:38075, user_credentials={real_user=slave}} blocked reactor thread for 50417us
W20260807 13:54:50.228099 4806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.129:32841, user_credentials={real_user=slave}} blocked reactor thread for 62353.5us
I20260807 13:54:50.279733 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:50.293870 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:50.325702 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:50.329038 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:50.334909 4715 consensus_queue.cc:237] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 3.11, Last appended by leader: 9, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:50.371843 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260807 13:54:50.390509 4632 consensus_peers.cc:597] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:50.393488 4892 raft_consensus.cc:1275] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 3 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 3 index: 11. Preceding OpId from leader: term: 3 index: 12. (index mismatch)
I20260807 13:54:50.398775 7688 raft_consensus.cc:1275] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [term 3 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 3 index: 11. Preceding OpId from leader: term: 3 index: 12. (index mismatch)
I20260807 13:54:50.399576 23781 consensus_queue.cc:1048] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260807 13:54:50.400283 23781 consensus_queue.cc:1048] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260807 13:54:50.423569 24127 raft_consensus.cc:2955] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 3 LEADER]: Committing config change with OpId 3.12: config changed from index 11 to 12, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:50.424463 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:50.430584 7688 raft_consensus.cc:2955] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [term 3 FOLLOWER]: Committing config change with OpId 3.12: config changed from index 11 to 12, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:50.428965 4892 raft_consensus.cc:2955] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 3 FOLLOWER]: Committing config change with OpId 3.12: config changed from index 11 to 12, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:50.439342 4519 catalog_manager.cc:5697] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index 11 to 12, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New cstate: current_term: 3 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:50.461798 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:50.500484 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:50.577754 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:50.619915 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:50.626420 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:50.650501 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:50.712392 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:50.715351 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:50.742579 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:50.791476 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:50.898350 24292 ts_tablet_manager.cc:933] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:54:50.917634 24292 tablet_copy_client.cc:323] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:54:50.918578 4748 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet 069a5f0089b24a609b27d4a07a3c4353 from peer 12ab71778f2f4b378765aaed1a0676a5 ({username='slave'} at 127.23.107.134:34891)
I20260807 13:54:50.918742 4748 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet 069a5f0089b24a609b27d4a07a3c4353 from peer 12ab71778f2f4b378765aaed1a0676a5 at {username='slave'} at 127.23.107.134:34891: session id = 12ab71778f2f4b378765aaed1a0676a5-069a5f0089b24a609b27d4a07a3c4353
I20260807 13:54:50.926407 4748 tablet_copy_source_session.cc:215] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:50.928159 24292 ts_tablet_manager.cc:1916] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:54:50.971966 24292 ts_tablet_manager.cc:1929] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 3.10
I20260807 13:54:50.973028 24292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 069a5f0089b24a609b27d4a07a3c4353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:50.997170 24292 tablet_copy_client.cc:806] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:50.998276 24292 tablet_copy_client.cc:670] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:51.001904 24292 tablet_copy_client.cc:538] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:51.010885 4892 consensus_queue.cc:237] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:51.014595 24292 tablet_bootstrap.cc:492] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap starting.
W20260807 13:54:51.043689 4806 consensus_peers.cc:597] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 541201ddfdf041ed87b3d0e731763a37. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:51.045513 7178 raft_consensus.cc:1275] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:51.046553 24149 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:51.064232 5246 raft_consensus.cc:1275] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:54:51.065312 24149 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:54:51.084429 24149 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:51.086987 5248 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:51.095831 4516 catalog_manager.cc:5697] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index 7 to 8, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:51.107496 7178 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:51.261854 24292 tablet_bootstrap.cc:492] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:51.262465 24292 tablet_bootstrap.cc:492] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap complete.
I20260807 13:54:51.262867 24292 ts_tablet_manager.cc:1403] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: Time spent bootstrapping tablet: real 0.251s user 0.086s sys 0.008s
I20260807 13:54:51.264024 24292 raft_consensus.cc:359] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:51.264350 24292 raft_consensus.cc:740] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Initialized, Role: FOLLOWER
I20260807 13:54:51.264747 24292 consensus_queue.cc:260] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 3.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:51.265533 24292 ts_tablet_manager.cc:1434] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:54:51.266686 4748 tablet_copy_service.cc:342] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Request end of tablet copy session 12ab71778f2f4b378765aaed1a0676a5-069a5f0089b24a609b27d4a07a3c4353 received from {username='slave'} at 127.23.107.134:34891
I20260807 13:54:51.266850 4748 tablet_copy_service.cc:434] P fa83b7af134b4e3b949ac3b4e4bcb5e7: ending tablet copy session 12ab71778f2f4b378765aaed1a0676a5-069a5f0089b24a609b27d4a07a3c4353 on tablet 069a5f0089b24a609b27d4a07a3c4353 with peer 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:54:51.288874 4715 consensus_queue.cc:237] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:51.310384 4892 raft_consensus.cc:1275] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260807 13:54:51.311559 7178 raft_consensus.cc:1275] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260807 13:54:51.313485 24350 consensus_queue.cc:1048] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:54:51.314234 24127 consensus_queue.cc:1048] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:54:51.320902 24350 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:51.326438 7178 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:51.329521 4519 catalog_manager.cc:5697] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index 10 to 11, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:51.338276 7327 tablet_service.cc:1558] Processing DeleteTablet for tablet 68717842b14e4f06b528c08a65acd3b7 with delete_type TABLET_DATA_TOMBSTONED (TS 12ab71778f2f4b378765aaed1a0676a5 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:47002
I20260807 13:54:51.349404 4892 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:51.455550 7353 raft_consensus.cc:1217] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Deduplicated request from leader. Original: 3.11->[3.12-3.12] Dedup: 3.12->[]
I20260807 13:54:51.497632 24292 ts_tablet_manager.cc:933] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5: Initiating tablet copy from peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
W20260807 13:54:51.511412 4629 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.136:43729, user_credentials={real_user=slave}} blocked reactor thread for 70326.6us
I20260807 13:54:51.513115 24292 tablet_copy_client.cc:323] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.130:37489
I20260807 13:54:51.514091 4921 tablet_copy_service.cc:140] P c9d2944272bc447dafce7620ac2dbd4b: Received BeginTabletCopySession request for tablet 541201ddfdf041ed87b3d0e731763a37 from peer 12ab71778f2f4b378765aaed1a0676a5 ({username='slave'} at 127.23.107.134:40561)
I20260807 13:54:51.514264 4921 tablet_copy_service.cc:161] P c9d2944272bc447dafce7620ac2dbd4b: Beginning new tablet copy session on tablet 541201ddfdf041ed87b3d0e731763a37 from peer 12ab71778f2f4b378765aaed1a0676a5 at {username='slave'} at 127.23.107.134:40561: session id = 12ab71778f2f4b378765aaed1a0676a5-541201ddfdf041ed87b3d0e731763a37
I20260807 13:54:51.519186 4921 tablet_copy_source_session.cc:215] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:51.520994 24292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541201ddfdf041ed87b3d0e731763a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:51.532646 24292 tablet_copy_client.cc:806] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:51.533043 24292 tablet_copy_client.cc:670] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:51.538579 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:51.578832 24421 tablet_replica.cc:333] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: stopping tablet replica
I20260807 13:54:51.579268 24421 raft_consensus.cc:2243] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:51.579299 7328 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:51.579766 24421 raft_consensus.cc:2272] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:51.581254 24292 tablet_copy_client.cc:538] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:51.583416 24421 ts_tablet_manager.cc:1916] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:51.604164 5246 consensus_queue.cc:237] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:51.620596 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:51.629464 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:51.639935 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:51.646574 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:51.664441 24292 tablet_bootstrap.cc:492] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap starting.
I20260807 13:54:51.674340 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:51.678848 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:51.679095 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:51.713599 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:51.732411 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:51.736462 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:51.741796 7353 raft_consensus.cc:1275] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260807 13:54:51.743089 23823 consensus_queue.cc:1048] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:54:51.754643 7178 raft_consensus.cc:1275] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260807 13:54:51.761497 23823 consensus_queue.cc:1048] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:54:51.763363 24488 raft_consensus.cc:2955] T 1715828a5d96455abecae985d1dca004 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
W20260807 13:54:51.839713 5154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.134:35975, user_credentials={real_user=slave}} blocked reactor thread for 77491us
I20260807 13:54:51.847714 7353 raft_consensus.cc:2955] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:51.847669 7178 raft_consensus.cc:2955] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:51.851179 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:51.856279 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:51.863260 4519 catalog_manager.cc:5697] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: config changed from index 10 to 11, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:51.888595 24421 ts_tablet_manager.cc:1929] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.10
I20260807 13:54:51.888773 24421 log.cc:1199] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal/wals/68717842b14e4f06b528c08a65acd3b7
I20260807 13:54:51.913946 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:51.917904 4506 catalog_manager.cc:5028] TS 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): tablet 68717842b14e4f06b528c08a65acd3b7 (table rebalance_test_table_1 [id=7f1d26639edd4cb398339b2b0d3659a3]) successfully deleted
I20260807 13:54:51.951570 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:52.087554 4865 tablet_service.cc:1558] Processing DeleteTablet for tablet 1715828a5d96455abecae985d1dca004 with delete_type TABLET_DATA_TOMBSTONED (TS c9d2944272bc447dafce7620ac2dbd4b not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:36624
I20260807 13:54:52.115139 24513 tablet_replica.cc:333] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b: stopping tablet replica
I20260807 13:54:52.115571 24513 raft_consensus.cc:2243] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:52.115903 24513 raft_consensus.cc:2272] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:52.116952 24513 ts_tablet_manager.cc:1916] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:52.184587 24513 ts_tablet_manager.cc:1929] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.10
I20260807 13:54:52.217722 24513 log.cc:1199] T 1715828a5d96455abecae985d1dca004 P c9d2944272bc447dafce7620ac2dbd4b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/1715828a5d96455abecae985d1dca004
I20260807 13:54:52.219048 4505 catalog_manager.cc:5028] TS c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): tablet 1715828a5d96455abecae985d1dca004 (table rebalance_test_table_2 [id=35d13981f3a742dd9369d1e7bf18498c]) successfully deleted
I20260807 13:54:52.254202 24292 tablet_bootstrap.cc:492] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:52.259326 24292 tablet_bootstrap.cc:492] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap complete.
I20260807 13:54:52.264806 24292 ts_tablet_manager.cc:1403] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5: Time spent bootstrapping tablet: real 0.600s user 0.088s sys 0.025s
I20260807 13:54:52.267920 24292 raft_consensus.cc:359] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:52.268524 24292 raft_consensus.cc:740] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Initialized, Role: FOLLOWER
I20260807 13:54:52.269752 24292 consensus_queue.cc:260] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:52.271554 24292 ts_tablet_manager.cc:1434] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260807 13:54:52.275265 4921 tablet_copy_service.cc:342] P c9d2944272bc447dafce7620ac2dbd4b: Request end of tablet copy session 12ab71778f2f4b378765aaed1a0676a5-541201ddfdf041ed87b3d0e731763a37 received from {username='slave'} at 127.23.107.134:40561
I20260807 13:54:52.275497 4921 tablet_copy_service.cc:434] P c9d2944272bc447dafce7620ac2dbd4b: ending tablet copy session 12ab71778f2f4b378765aaed1a0676a5-541201ddfdf041ed87b3d0e731763a37 on tablet 541201ddfdf041ed87b3d0e731763a37 with peer 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:54:52.510926 7353 raft_consensus.cc:1217] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260807 13:54:52.525910 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:52.536603 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:52.541635 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:52.594295 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:52.599874 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
W20260807 13:54:52.638010 4806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.134:35975, user_credentials={real_user=slave}} blocked reactor thread for 119683us
I20260807 13:54:52.696370 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:52.726873 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:52.747267 4715 consensus_queue.cc:237] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 3.12, Last appended by leader: 9, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:52.772039 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:52.772182 4892 raft_consensus.cc:1275] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 3 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 3 index: 12. Preceding OpId from leader: term: 3 index: 13. (index mismatch)
I20260807 13:54:52.772555 7690 raft_consensus.cc:1275] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [term 3 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 3 index: 12. Preceding OpId from leader: term: 3 index: 13. (index mismatch)
I20260807 13:54:52.772889 24127 consensus_queue.cc:1048] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260807 13:54:52.774919 24127 consensus_queue.cc:1048] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260807 13:54:52.835219 24660 raft_consensus.cc:2955] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 3 LEADER]: Committing config change with OpId 3.13: config changed from index 12 to 13, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:52.843331 7690 raft_consensus.cc:2955] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [term 3 FOLLOWER]: Committing config change with OpId 3.13: config changed from index 12 to 13, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:52.854625 4892 raft_consensus.cc:2955] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 3 FOLLOWER]: Committing config change with OpId 3.13: config changed from index 12 to 13, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:52.863389 4520 catalog_manager.cc:5697] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index 12 to 13, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) evicted. New cstate: current_term: 3 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
W20260807 13:54:52.921913 4632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.134:35975, user_credentials={real_user=slave}} blocked reactor thread for 54823.3us
I20260807 13:54:52.929517 7327 tablet_service.cc:1558] Processing DeleteTablet for tablet 069a5f0089b24a609b27d4a07a3c4353 with delete_type TABLET_DATA_TOMBSTONED (TS 12ab71778f2f4b378765aaed1a0676a5 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:47002
I20260807 13:54:52.944733 24683 tablet_replica.cc:333] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: stopping tablet replica
I20260807 13:54:52.945248 24683 raft_consensus.cc:2243] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:52.952764 24683 raft_consensus.cc:2272] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:52.968688 24683 ts_tablet_manager.cc:1916] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:52.985736 24683 ts_tablet_manager.cc:1929] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.12
I20260807 13:54:52.986214 24683 log.cc:1199] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/wal/wals/069a5f0089b24a609b27d4a07a3c4353
I20260807 13:54:52.987516 4506 catalog_manager.cc:5028] TS 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): tablet 069a5f0089b24a609b27d4a07a3c4353 (table rebalance_test_table_5 [id=b6c061acc30c4e5aa6bee1f054e3a59a]) successfully deleted
I20260807 13:54:53.030081 4715 consensus_queue.cc:237] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 1.13, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:54:53.055353 5246 raft_consensus.cc:1275] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
W20260807 13:54:53.057915 4630 consensus_peers.cc:597] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:53.060171 24127 consensus_queue.cc:1048] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260807 13:54:53.060575 7178 raft_consensus.cc:1275] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
I20260807 13:54:53.061379 24127 consensus_queue.cc:1048] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260807 13:54:53.075130 24674 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:53.076910 5248 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:53.082962 7178 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:53.084931 4513 catalog_manager.cc:5697] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index 13 to 14, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) added. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:53.294476 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:53.297714 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:53.322834 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:53.393697 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:53.395539 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:53.439447 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:53.449656 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:53.493844 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:53.500684 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:53.515111 24802 ts_tablet_manager.cc:933] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:54:53.544997 24802 tablet_copy_client.cc:323] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:54:53.545915 4748 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet 966ebd287fc14e498e5bd3e6542194ca from peer 01adf83af3e04875b5fac9470d4da915 ({username='slave'} at 127.23.107.131:50563)
I20260807 13:54:53.546075 4748 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet 966ebd287fc14e498e5bd3e6542194ca from peer 01adf83af3e04875b5fac9470d4da915 at {username='slave'} at 127.23.107.131:50563: session id = 01adf83af3e04875b5fac9470d4da915-966ebd287fc14e498e5bd3e6542194ca
I20260807 13:54:53.549165 4748 tablet_copy_source_session.cc:215] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:53.551928 4897 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "541201ddfdf041ed87b3d0e731763a37"
dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:40506
I20260807 13:54:53.552183 4897 raft_consensus.cc:606] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Received request to transfer leadership
I20260807 13:54:53.557783 24802 ts_tablet_manager.cc:1916] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915: Deleting tablet data with delete state TABLET_DATA_COPYING
W20260807 13:54:53.559975 5152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.131:40441, user_credentials={real_user=slave}} blocked reactor thread for 126811us
I20260807 13:54:53.580039 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:53.616847 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:53.630295 24802 ts_tablet_manager.cc:1929] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.12
I20260807 13:54:53.630679 24802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 966ebd287fc14e498e5bd3e6542194ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:53.656632 24802 tablet_copy_client.cc:806] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:53.656996 24802 tablet_copy_client.cc:670] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:53.662556 24635 raft_consensus.cc:993] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b: : Instructing follower b77f2b2eade540c6bfd4f75e5229a3cd to start an election
I20260807 13:54:53.662740 24635 raft_consensus.cc:1081] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Signalling peer b77f2b2eade540c6bfd4f75e5229a3cd to start an election
I20260807 13:54:53.663900 7178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "541201ddfdf041ed87b3d0e731763a37"
dest_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd"
from {username='slave'} at 127.23.107.130:42083
I20260807 13:54:53.664140 7178 raft_consensus.cc:493] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:54:53.664322 7178 raft_consensus.cc:3060] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:54:53.668947 7178 raft_consensus.cc:515] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:53.673995 7158 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:53.674541 5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541201ddfdf041ed87b3d0e731763a37" candidate_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179"
I20260807 13:54:53.674772 5246 raft_consensus.cc:3060] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:54:53.678756 5246 raft_consensus.cc:2468] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77f2b2eade540c6bfd4f75e5229a3cd in term 2.
I20260807 13:54:53.683154 7178 leader_election.cc:290] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 election: Requested vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975)
I20260807 13:54:53.683643 7353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541201ddfdf041ed87b3d0e731763a37" candidate_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "12ab71778f2f4b378765aaed1a0676a5"
I20260807 13:54:53.683970 7353 raft_consensus.cc:3060] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:54:53.687124 7353 raft_consensus.cc:2468] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77f2b2eade540c6bfd4f75e5229a3cd in term 2.
I20260807 13:54:53.688776 7102 leader_election.cc:304] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5, b77f2b2eade540c6bfd4f75e5229a3cd, edf940ebcc1140cfa0c23214e0c0f179; no voters:
I20260807 13:54:53.689188 21934 raft_consensus.cc:2804] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:54:53.699910 4865 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:54:53.702208 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:53.729418 21934 raft_consensus.cc:697] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 LEADER]: Becoming Leader. State: Replica: b77f2b2eade540c6bfd4f75e5229a3cd, State: Running, Role: LEADER
I20260807 13:54:53.730038 21934 consensus_queue.cc:237] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:53.732882 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:53.740265 4517 catalog_manager.cc:5697] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: term changed from 1 to 2, leader changed from c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) to b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133). New cstate: current_term: 2 leader_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:53.761242 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541201ddfdf041ed87b3d0e731763a37" candidate_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
I20260807 13:54:53.761570 4897 raft_consensus.cc:3055] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:54:53.761673 4897 raft_consensus.cc:740] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Running, Role: LEADER
I20260807 13:54:53.762048 4897 consensus_queue.cc:260] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:53.762594 4897 raft_consensus.cc:3060] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:54:53.766357 4897 raft_consensus.cc:2468] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77f2b2eade540c6bfd4f75e5229a3cd in term 2.
I20260807 13:54:53.795864 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
W20260807 13:54:53.852319 4982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.129:32841, user_credentials={real_user=slave}} blocked reactor thread for 192732us
I20260807 13:54:53.881973 24802 tablet_copy_client.cc:538] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:53.886757 24802 tablet_bootstrap.cc:492] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:54:54.124994 4897 raft_consensus.cc:1275] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260807 13:54:54.126055 24831 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:54.127502 5246 raft_consensus.cc:1275] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260807 13:54:54.135959 21934 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:54:54.184319 24802 tablet_bootstrap.cc:492] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:54.184844 24802 tablet_bootstrap.cc:492] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915: Bootstrap complete.
I20260807 13:54:54.185184 24802 ts_tablet_manager.cc:1403] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.299s user 0.066s sys 0.011s
I20260807 13:54:54.189054 24802 raft_consensus.cc:359] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:54:54.189311 24802 raft_consensus.cc:740] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:54:54.190440 24802 consensus_queue.cc:260] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 1.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:54:54.197822 7353 raft_consensus.cc:1275] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260807 13:54:54.197983 24802 ts_tablet_manager.cc:1434] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.013s user 0.004s sys 0.000s
I20260807 13:54:54.200778 21934 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260807 13:54:54.224915 4748 tablet_copy_service.cc:342] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Request end of tablet copy session 01adf83af3e04875b5fac9470d4da915-966ebd287fc14e498e5bd3e6542194ca received from {username='slave'} at 127.23.107.131:50563
I20260807 13:54:54.225096 4748 tablet_copy_service.cc:434] P fa83b7af134b4e3b949ac3b4e4bcb5e7: ending tablet copy session 01adf83af3e04875b5fac9470d4da915-966ebd287fc14e498e5bd3e6542194ca on tablet 966ebd287fc14e498e5bd3e6542194ca with peer 01adf83af3e04875b5fac9470d4da915
I20260807 13:54:54.412962 5068 raft_consensus.cc:1217] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.13->[1.14-1.14] Dedup: 1.14->[]
I20260807 13:54:54.488526 5068 consensus_queue.cc:237] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:54.499570 7353 raft_consensus.cc:1275] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260807 13:54:54.500610 24848 consensus_queue.cc:1048] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:54:54.511428 7522 raft_consensus.cc:1275] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260807 13:54:54.512421 24848 consensus_queue.cc:1048] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:54:54.518497 24848 raft_consensus.cc:2955] T 16afb6ff06704a8795f1de84ffa81de0 P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:54.522858 7354 raft_consensus.cc:2955] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:54.529786 4517 catalog_manager.cc:5697] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: config changed from index 10 to 11, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) evicted. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:54.585958 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:54.606529 7524 raft_consensus.cc:2955] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:54.641443 7158 tablet_service.cc:1558] Processing DeleteTablet for tablet 16afb6ff06704a8795f1de84ffa81de0 with delete_type TABLET_DATA_TOMBSTONED (TS b77f2b2eade540c6bfd4f75e5229a3cd not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:33148
I20260807 13:54:54.669245 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:54.679000 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:54.679847 25003 tablet_replica.cc:333] T 16afb6ff06704a8795f1de84ffa81de0 P b77f2b2eade540c6bfd4f75e5229a3cd: stopping tablet replica
I20260807 13:54:54.680141 25003 raft_consensus.cc:2243] T 16afb6ff06704a8795f1de84ffa81de0 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:54.694545 25003 raft_consensus.cc:2272] T 16afb6ff06704a8795f1de84ffa81de0 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:54.695724 25003 ts_tablet_manager.cc:1916] T 16afb6ff06704a8795f1de84ffa81de0 P b77f2b2eade540c6bfd4f75e5229a3cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:54.734733 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:54.751030 7158 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:54.768674 25003 ts_tablet_manager.cc:1929] T 16afb6ff06704a8795f1de84ffa81de0 P b77f2b2eade540c6bfd4f75e5229a3cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.10
I20260807 13:54:54.770123 25003 log.cc:1199] T 16afb6ff06704a8795f1de84ffa81de0 P b77f2b2eade540c6bfd4f75e5229a3cd: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal/wals/16afb6ff06704a8795f1de84ffa81de0
I20260807 13:54:54.784001 4505 catalog_manager.cc:5028] TS b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): tablet 16afb6ff06704a8795f1de84ffa81de0 (table rebalance_test_table_0 [id=14867b014aab43119171102f60bb134d]) successfully deleted
I20260807 13:54:54.803395 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:54.808957 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:54.849103 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:54.871441 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:54.880097 4865 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:54.931802 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:54.971077 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:54.974458 7158 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:54.991204 4865 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:55.019735 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:55.050541 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:55.247666 4715 consensus_queue.cc:237] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
W20260807 13:54:55.265785 4632 consensus_peers.cc:597] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:55.267901 4897 raft_consensus.cc:1275] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20260807 13:54:55.268656 7178 raft_consensus.cc:1275] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20260807 13:54:55.270085 24674 consensus_queue.cc:1048] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260807 13:54:55.270685 24674 consensus_queue.cc:1048] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260807 13:54:55.305832 25080 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:55.307668 7178 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:55.324672 4520 catalog_manager.cc:5697] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index 11 to 12, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:55.326195 4897 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:55.364892 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:55.399943 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:55.430030 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:55.440986 7158 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:55.499162 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:55.560990 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
W20260807 13:54:55.561300 4806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:41217, user_credentials={real_user=slave}} blocked reactor thread for 78030.6us
I20260807 13:54:55.587551 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:55.602514 4865 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:55.728308 5248 consensus_queue.cc:237] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:55.787061 4715 raft_consensus.cc:1275] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260807 13:54:55.788424 4897 raft_consensus.cc:1275] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
W20260807 13:54:55.789623 5151 consensus_peers.cc:597] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 -> Peer 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729): Couldn't send request to peer 31d7630573c8475a9f84978d4ebfb879. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:55.789917 24975 consensus_queue.cc:1048] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:55.790603 24975 consensus_queue.cc:1048] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:55.815521 24975 raft_consensus.cc:2955] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:55.828094 4892 raft_consensus.cc:2955] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:55.859962 4517 catalog_manager.cc:5697] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index 9 to 10, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:55.862368 4715 raft_consensus.cc:2955] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:55.892500 25194 ts_tablet_manager.cc:933] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:54:55.949808 25194 tablet_copy_client.cc:323] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:54:55.950737 4748 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet 68717842b14e4f06b528c08a65acd3b7 from peer 12ab71778f2f4b378765aaed1a0676a5 ({username='slave'} at 127.23.107.134:34891)
I20260807 13:54:55.950911 4748 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet 68717842b14e4f06b528c08a65acd3b7 from peer 12ab71778f2f4b378765aaed1a0676a5 at {username='slave'} at 127.23.107.134:34891: session id = 12ab71778f2f4b378765aaed1a0676a5-68717842b14e4f06b528c08a65acd3b7
I20260807 13:54:55.955046 4748 tablet_copy_source_session.cc:215] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:55.959650 25194 ts_tablet_manager.cc:1916] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:54:55.969441 25194 ts_tablet_manager.cc:1929] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.10
I20260807 13:54:55.969830 25194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68717842b14e4f06b528c08a65acd3b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:55.982268 25194 tablet_copy_client.cc:806] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:55.982538 25194 tablet_copy_client.cc:670] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:55.985657 25194 tablet_copy_client.cc:538] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:55.989676 25194 tablet_bootstrap.cc:492] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap starting.
I20260807 13:54:56.080638 7178 consensus_queue.cc:237] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.9, Last appended by leader: 8, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:56.091594 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:56.148144 7353 raft_consensus.cc:1275] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260807 13:54:56.148847 5246 raft_consensus.cc:1275] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260807 13:54:56.150420 24891 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:56.151292 24891 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:54:56.170387 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:56.192338 24891 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 LEADER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:56.200954 4510 catalog_manager.cc:5697] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: config changed from index 8 to 10, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New cstate: current_term: 2 leader_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:56.204478 7353 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:56.211400 4865 tablet_service.cc:1558] Processing DeleteTablet for tablet 541201ddfdf041ed87b3d0e731763a37 with delete_type TABLET_DATA_TOMBSTONED (TS c9d2944272bc447dafce7620ac2dbd4b not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:36624
I20260807 13:54:56.244891 25284 tablet_replica.cc:333] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b: stopping tablet replica
I20260807 13:54:56.245245 25284 raft_consensus.cc:2243] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:56.245718 25284 raft_consensus.cc:2272] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:56.248063 25284 ts_tablet_manager.cc:1916] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:56.250648 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:56.266142 25194 tablet_bootstrap.cc:492] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:56.266673 25194 tablet_bootstrap.cc:492] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap complete.
I20260807 13:54:56.267021 25194 ts_tablet_manager.cc:1403] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: Time spent bootstrapping tablet: real 0.277s user 0.093s sys 0.066s
I20260807 13:54:56.267961 25194 raft_consensus.cc:359] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:56.268217 25194 raft_consensus.cc:740] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Initialized, Role: FOLLOWER
I20260807 13:54:56.268639 25194 consensus_queue.cc:260] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:56.269255 25194 ts_tablet_manager.cc:1434] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260807 13:54:56.271313 4748 tablet_copy_service.cc:342] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Request end of tablet copy session 12ab71778f2f4b378765aaed1a0676a5-68717842b14e4f06b528c08a65acd3b7 received from {username='slave'} at 127.23.107.134:34891
I20260807 13:54:56.271476 4748 tablet_copy_service.cc:434] P fa83b7af134b4e3b949ac3b4e4bcb5e7: ending tablet copy session 12ab71778f2f4b378765aaed1a0676a5-68717842b14e4f06b528c08a65acd3b7 on tablet 68717842b14e4f06b528c08a65acd3b7 with peer 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:54:56.285526 7158 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:56.295648 5246 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:56.299811 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:56.371695 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:56.392503 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:56.397058 25284 ts_tablet_manager.cc:1929] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.9
I20260807 13:54:56.397198 25284 log.cc:1199] T 541201ddfdf041ed87b3d0e731763a37 P c9d2944272bc447dafce7620ac2dbd4b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/541201ddfdf041ed87b3d0e731763a37
I20260807 13:54:56.397308 7353 raft_consensus.cc:1217] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.11->[1.12-1.12] Dedup: 1.12->[]
I20260807 13:54:56.412781 4865 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:56.438848 4715 consensus_queue.cc:237] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:54:56.449589 25311 ts_tablet_manager.cc:933] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
W20260807 13:54:56.451757 4630 consensus_peers.cc:597] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:56.453126 7524 raft_consensus.cc:1275] T 0c1327c8461e44f2ac5d77f10c390eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:54:56.458284 4505 catalog_manager.cc:5028] TS c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): tablet 541201ddfdf041ed87b3d0e731763a37 (table rebalance_test_table_4 [id=e242e42da20d4458a49a269a9569307a]) successfully deleted
I20260807 13:54:56.460156 25080 consensus_queue.cc:1048] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:54:56.470746 4897 raft_consensus.cc:1275] T 0c1327c8461e44f2ac5d77f10c390eeb P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:54:56.472143 25080 consensus_queue.cc:1048] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:54:56.478927 4715 consensus_queue.cc:237] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 3.13, Last appended by leader: 9, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:56.485620 25311 tablet_copy_client.cc:323] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:54:56.486632 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet 50a090faa58e4f91961c9251030efacf from peer 31d7630573c8475a9f84978d4ebfb879 ({username='slave'} at 127.23.107.136:35045)
I20260807 13:54:56.486850 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet 50a090faa58e4f91961c9251030efacf from peer 31d7630573c8475a9f84978d4ebfb879 at {username='slave'} at 127.23.107.136:35045: session id = 31d7630573c8475a9f84978d4ebfb879-50a090faa58e4f91961c9251030efacf
I20260807 13:54:56.493104 5272 tablet_copy_source_session.cc:215] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:56.495054 25311 ts_tablet_manager.cc:1916] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:54:56.525538 25311 ts_tablet_manager.cc:1929] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.8
I20260807 13:54:56.528774 25311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a090faa58e4f91961c9251030efacf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:56.536845 25080 raft_consensus.cc:2955] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:56.543828 7688 raft_consensus.cc:1275] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [term 3 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 3 index: 13. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260807 13:54:56.544661 25324 consensus_queue.cc:1048] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260807 13:54:56.550410 4897 raft_consensus.cc:2955] T 0c1327c8461e44f2ac5d77f10c390eeb P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:56.557934 4520 catalog_manager.cc:5697] T 0c1327c8461e44f2ac5d77f10c390eeb P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index 5 to 6, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) added. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:56.562631 7524 raft_consensus.cc:2955] T 0c1327c8461e44f2ac5d77f10c390eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:56.573290 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:56.574455 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:56.578330 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:56.596345 25324 raft_consensus.cc:2955] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 3 LEADER]: Committing config change with OpId 3.14: config changed from index 13 to 14, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:56.598043 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:56.602411 7688 raft_consensus.cc:2955] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [term 3 FOLLOWER]: Committing config change with OpId 3.14: config changed from index 13 to 14, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:56.605571 25311 tablet_copy_client.cc:806] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:56.605816 25311 tablet_copy_client.cc:670] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:56.607982 25311 tablet_copy_client.cc:538] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:56.619737 25311 tablet_bootstrap.cc:492] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879: Bootstrap starting.
I20260807 13:54:56.626278 4513 catalog_manager.cc:5697] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index 13 to 14, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New cstate: current_term: 3 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:56.639648 4865 tablet_service.cc:1558] Processing DeleteTablet for tablet 069a5f0089b24a609b27d4a07a3c4353 with delete_type TABLET_DATA_TOMBSTONED (TS c9d2944272bc447dafce7620ac2dbd4b not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:36624
I20260807 13:54:56.640002 25284 tablet_replica.cc:333] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: stopping tablet replica
I20260807 13:54:56.640228 25284 raft_consensus.cc:2243] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:56.640566 25284 raft_consensus.cc:2272] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:56.641603 25284 ts_tablet_manager.cc:1916] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:56.653990 4715 consensus_queue.cc:237] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 3.14, Last appended by leader: 9, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:56.654263 7158 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
W20260807 13:54:56.657794 4632 consensus_peers.cc:597] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975): Couldn't send request to peer 12ab71778f2f4b378765aaed1a0676a5. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:56.662508 25284 ts_tablet_manager.cc:1929] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.13
I20260807 13:54:56.662642 25284 log.cc:1199] T 069a5f0089b24a609b27d4a07a3c4353 P c9d2944272bc447dafce7620ac2dbd4b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/069a5f0089b24a609b27d4a07a3c4353
I20260807 13:54:56.668543 4505 catalog_manager.cc:5028] TS c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): tablet 069a5f0089b24a609b27d4a07a3c4353 (table rebalance_test_table_5 [id=b6c061acc30c4e5aa6bee1f054e3a59a]) successfully deleted
I20260807 13:54:56.681602 7690 raft_consensus.cc:1275] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [term 3 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 3 index: 14. Preceding OpId from leader: term: 3 index: 15. (index mismatch)
I20260807 13:54:56.682662 25341 consensus_queue.cc:1048] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260807 13:54:56.700130 7690 raft_consensus.cc:2955] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [term 3 FOLLOWER]: Committing config change with OpId 3.15: config changed from index 14 to 15, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:56.700353 25324 raft_consensus.cc:2955] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 3 LEADER]: Committing config change with OpId 3.15: config changed from index 14 to 15, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:56.706228 4506 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet 069a5f0089b24a609b27d4a07a3c4353 with cas_config_opid_index 14: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260807 13:54:56.708802 4520 catalog_manager.cc:5697] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index 14 to 15, VOTER 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134) added. New cstate: current_term: 3 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:56.710170 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:56.711030 4865 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:56.736387 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:56.930835 25311 tablet_bootstrap.cc:492] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:56.931396 25311 tablet_bootstrap.cc:492] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879: Bootstrap complete.
I20260807 13:54:56.931756 25311 ts_tablet_manager.cc:1403] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879: Time spent bootstrapping tablet: real 0.312s user 0.044s sys 0.009s
I20260807 13:54:56.932555 25311 raft_consensus.cc:359] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:56.932858 25311 raft_consensus.cc:740] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d7630573c8475a9f84978d4ebfb879, State: Initialized, Role: FOLLOWER
I20260807 13:54:56.933151 25311 consensus_queue.cc:260] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:54:56.934338 25311 ts_tablet_manager.cc:1434] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260807 13:54:56.935587 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session 31d7630573c8475a9f84978d4ebfb879-50a090faa58e4f91961c9251030efacf received from {username='slave'} at 127.23.107.136:35045
I20260807 13:54:56.935802 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session 31d7630573c8475a9f84978d4ebfb879-50a090faa58e4f91961c9251030efacf on tablet 50a090faa58e4f91961c9251030efacf with peer 31d7630573c8475a9f84978d4ebfb879
I20260807 13:54:57.015509 7688 raft_consensus.cc:1217] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.9->[1.10-1.10] Dedup: 1.10->[]
I20260807 13:54:57.078763 25441 ts_tablet_manager.cc:933] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:54:57.100766 25445 ts_tablet_manager.cc:933] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:54:57.104197 25441 tablet_copy_client.cc:323] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:54:57.105016 4748 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet 0c1327c8461e44f2ac5d77f10c390eeb from peer 01adf83af3e04875b5fac9470d4da915 ({username='slave'} at 127.23.107.131:50563)
I20260807 13:54:57.105197 4748 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet 0c1327c8461e44f2ac5d77f10c390eeb from peer 01adf83af3e04875b5fac9470d4da915 at {username='slave'} at 127.23.107.131:50563: session id = 01adf83af3e04875b5fac9470d4da915-0c1327c8461e44f2ac5d77f10c390eeb
I20260807 13:54:57.106020 25445 tablet_copy_client.cc:323] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:54:57.108901 4748 tablet_copy_source_session.cc:215] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:57.110982 4746 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet 069a5f0089b24a609b27d4a07a3c4353 from peer 12ab71778f2f4b378765aaed1a0676a5 ({username='slave'} at 127.23.107.134:34891)
I20260807 13:54:57.111353 4746 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet 069a5f0089b24a609b27d4a07a3c4353 from peer 12ab71778f2f4b378765aaed1a0676a5 at {username='slave'} at 127.23.107.134:34891: session id = 12ab71778f2f4b378765aaed1a0676a5-069a5f0089b24a609b27d4a07a3c4353
I20260807 13:54:57.127429 4746 tablet_copy_source_session.cc:215] T 069a5f0089b24a609b27d4a07a3c4353 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:57.127341 5246 consensus_queue.cc:237] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:57.129014 25445 ts_tablet_manager.cc:1916] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:54:57.129281 25441 ts_tablet_manager.cc:1916] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:54:57.135967 25445 ts_tablet_manager.cc:1929] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 3.12
I20260807 13:54:57.136250 25445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 069a5f0089b24a609b27d4a07a3c4353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:57.138532 25441 ts_tablet_manager.cc:1929] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.4
I20260807 13:54:57.138798 25441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c1327c8461e44f2ac5d77f10c390eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:57.139487 25445 tablet_copy_client.cc:806] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:57.139694 25445 tablet_copy_client.cc:670] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:57.143662 25445 tablet_copy_client.cc:538] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:57.145145 4897 raft_consensus.cc:1275] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260807 13:54:57.146049 7353 raft_consensus.cc:1275] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260807 13:54:57.147112 24975 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:54:57.147681 24975 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:54:57.163316 25445 tablet_bootstrap.cc:492] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap starting.
I20260807 13:54:57.195922 25441 tablet_copy_client.cc:806] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:57.196376 25441 tablet_copy_client.cc:670] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:57.199374 25441 tablet_copy_client.cc:538] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:57.206471 24975 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:57.207365 7353 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:57.216143 25441 tablet_bootstrap.cc:492] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:54:57.216404 4520 catalog_manager.cc:5697] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: config changed from index 10 to 11, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) evicted. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:57.242327 4897 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:54:57.257623 7668 tablet_service.cc:1558] Processing DeleteTablet for tablet 96bc42d66fa04fb69afa630969dbb579 with delete_type TABLET_DATA_TOMBSTONED (TS 31d7630573c8475a9f84978d4ebfb879 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:56664
I20260807 13:54:57.282717 25487 tablet_replica.cc:333] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: stopping tablet replica
I20260807 13:54:57.282850 25445 tablet_bootstrap.cc:492] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:57.283380 25445 tablet_bootstrap.cc:492] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: Bootstrap complete.
I20260807 13:54:57.283738 25445 ts_tablet_manager.cc:1403] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: Time spent bootstrapping tablet: real 0.122s user 0.050s sys 0.011s
I20260807 13:54:57.284765 25445 raft_consensus.cc:359] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:57.285053 25445 raft_consensus.cc:740] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Initialized, Role: FOLLOWER
I20260807 13:54:57.285386 25445 consensus_queue.cc:260] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 3.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:57.286118 25445 ts_tablet_manager.cc:1434] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20260807 13:54:57.287578 4746 tablet_copy_service.cc:342] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Request end of tablet copy session 12ab71778f2f4b378765aaed1a0676a5-069a5f0089b24a609b27d4a07a3c4353 received from {username='slave'} at 127.23.107.134:34891
I20260807 13:54:57.287724 4746 tablet_copy_service.cc:434] P fa83b7af134b4e3b949ac3b4e4bcb5e7: ending tablet copy session 12ab71778f2f4b378765aaed1a0676a5-069a5f0089b24a609b27d4a07a3c4353 on tablet 069a5f0089b24a609b27d4a07a3c4353 with peer 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:54:57.290949 25487 raft_consensus.cc:2243] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:57.291381 25487 raft_consensus.cc:2272] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:57.296655 25487 ts_tablet_manager.cc:1916] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:57.329414 25487 ts_tablet_manager.cc:1929] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.10
I20260807 13:54:57.329864 25487 log.cc:1199] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/wal/wals/96bc42d66fa04fb69afa630969dbb579
I20260807 13:54:57.331540 4503 catalog_manager.cc:5028] TS 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729): tablet 96bc42d66fa04fb69afa630969dbb579 (table rebalance_test_table_4 [id=e242e42da20d4458a49a269a9569307a]) successfully deleted
I20260807 13:54:57.337755 25441 tablet_bootstrap.cc:492] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:57.338267 25441 tablet_bootstrap.cc:492] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915: Bootstrap complete.
I20260807 13:54:57.338588 25441 ts_tablet_manager.cc:1403] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.123s user 0.056s sys 0.009s
I20260807 13:54:57.339475 25441 raft_consensus.cc:359] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:54:57.339704 25441 raft_consensus.cc:740] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:54:57.346563 25441 consensus_queue.cc:260] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:54:57.354830 25441 ts_tablet_manager.cc:1434] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.016s user 0.003s sys 0.000s
I20260807 13:54:57.360466 4746 tablet_copy_service.cc:342] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Request end of tablet copy session 01adf83af3e04875b5fac9470d4da915-0c1327c8461e44f2ac5d77f10c390eeb received from {username='slave'} at 127.23.107.131:50563
I20260807 13:54:57.360652 4746 tablet_copy_service.cc:434] P fa83b7af134b4e3b949ac3b4e4bcb5e7: ending tablet copy session 01adf83af3e04875b5fac9470d4da915-0c1327c8461e44f2ac5d77f10c390eeb on tablet 0c1327c8461e44f2ac5d77f10c390eeb with peer 01adf83af3e04875b5fac9470d4da915
I20260807 13:54:57.537062 7353 raft_consensus.cc:1217] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Deduplicated request from leader. Original: 3.14->[3.15-3.15] Dedup: 3.15->[]
I20260807 13:54:57.540807 5068 raft_consensus.cc:1217] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.5->[1.6-1.6] Dedup: 1.6->[]
I20260807 13:54:57.586163 7178 consensus_queue.cc:237] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 2.10, Last appended by leader: 8, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
W20260807 13:54:57.603648 7100 consensus_peers.cc:597] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 541201ddfdf041ed87b3d0e731763a37. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:57.604800 7353 raft_consensus.cc:1275] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 10. Preceding OpId from leader: term: 2 index: 11. (index mismatch)
I20260807 13:54:57.605517 25274 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:54:57.608040 5246 raft_consensus.cc:1275] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 10. Preceding OpId from leader: term: 2 index: 11. (index mismatch)
I20260807 13:54:57.608698 25274 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:54:57.672636 25567 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 LEADER]: Committing config change with OpId 2.11: config changed from index 10 to 11, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:57.674408 7354 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Committing config change with OpId 2.11: config changed from index 10 to 11, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:57.692893 5246 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Committing config change with OpId 2.11: config changed from index 10 to 11, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:57.707548 4519 catalog_manager.cc:5697] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: config changed from index 10 to 11, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) added. New cstate: current_term: 2 leader_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:57.783851 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:57.821931 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:57.919415 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:57.974228 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:58.003120 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:58.038738 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:58.059530 7158 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:58.061848 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:58.073416 4865 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:58.078065 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:58.098244 7158 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:58.100041 4865 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:58.105948 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:58.134510 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:58.213321 25665 ts_tablet_manager.cc:933] T 541201ddfdf041ed87b3d0e731763a37 P 01adf83af3e04875b5fac9470d4da915: Initiating tablet copy from peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075)
I20260807 13:54:58.213665 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:58.217178 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:58.217674 4687 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:58.231655 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:58.241585 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:58.287345 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:58.307606 4865 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:58.337071 7158 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:58.361734 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:58.363023 5246 consensus_queue.cc:237] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:58.371119 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:58.390590 25665 tablet_copy_client.cc:323] T 541201ddfdf041ed87b3d0e731763a37 P 01adf83af3e04875b5fac9470d4da915: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.133:38075
I20260807 13:54:58.391665 7213 tablet_copy_service.cc:140] P b77f2b2eade540c6bfd4f75e5229a3cd: Received BeginTabletCopySession request for tablet 541201ddfdf041ed87b3d0e731763a37 from peer 01adf83af3e04875b5fac9470d4da915 ({username='slave'} at 127.23.107.131:46299)
I20260807 13:54:58.391839 7213 tablet_copy_service.cc:161] P b77f2b2eade540c6bfd4f75e5229a3cd: Beginning new tablet copy session on tablet 541201ddfdf041ed87b3d0e731763a37 from peer 01adf83af3e04875b5fac9470d4da915 at {username='slave'} at 127.23.107.131:46299: session id = 01adf83af3e04875b5fac9470d4da915-541201ddfdf041ed87b3d0e731763a37
I20260807 13:54:58.396571 7213 tablet_copy_source_session.cc:215] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:58.398264 25665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541201ddfdf041ed87b3d0e731763a37. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 13:54:58.412145 5153 consensus_peers.cc:597] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 -> Peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): Couldn't send request to peer b77f2b2eade540c6bfd4f75e5229a3cd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e93615e4fb61416d8740ce61970610af. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:58.412853 7522 raft_consensus.cc:1275] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:54:58.414746 25452 consensus_queue.cc:1048] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:54:58.416344 4897 raft_consensus.cc:1275] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 13:54:58.418330 25452 consensus_queue.cc:1048] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:54:58.423805 25665 tablet_copy_client.cc:806] T 541201ddfdf041ed87b3d0e731763a37 P 01adf83af3e04875b5fac9470d4da915: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:58.424291 25665 tablet_copy_client.cc:670] T 541201ddfdf041ed87b3d0e731763a37 P 01adf83af3e04875b5fac9470d4da915: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:58.467970 25452 raft_consensus.cc:2955] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:58.470186 4892 raft_consensus.cc:2955] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:58.477737 7522 raft_consensus.cc:2955] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:58.480387 4513 catalog_manager.cc:5697] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index 5 to 6, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:54:58.498111 25665 tablet_copy_client.cc:538] T 541201ddfdf041ed87b3d0e731763a37 P 01adf83af3e04875b5fac9470d4da915: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:58.534135 25665 tablet_bootstrap.cc:492] T 541201ddfdf041ed87b3d0e731763a37 P 01adf83af3e04875b5fac9470d4da915: Bootstrap starting.
I20260807 13:54:58.722649 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:58.759142 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:58.770980 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:58.788825 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:58.834868 7158 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:58.874960 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:58.884362 25665 tablet_bootstrap.cc:492] T 541201ddfdf041ed87b3d0e731763a37 P 01adf83af3e04875b5fac9470d4da915: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:58.888756 25665 tablet_bootstrap.cc:492] T 541201ddfdf041ed87b3d0e731763a37 P 01adf83af3e04875b5fac9470d4da915: Bootstrap complete.
I20260807 13:54:58.889124 25665 ts_tablet_manager.cc:1403] T 541201ddfdf041ed87b3d0e731763a37 P 01adf83af3e04875b5fac9470d4da915: Time spent bootstrapping tablet: real 0.355s user 0.063s sys 0.015s
I20260807 13:54:58.892494 25665 raft_consensus.cc:359] T 541201ddfdf041ed87b3d0e731763a37 P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:54:58.894225 25665 raft_consensus.cc:740] T 541201ddfdf041ed87b3d0e731763a37 P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Initialized, Role: FOLLOWER
I20260807 13:54:58.895119 25665 consensus_queue.cc:260] T 541201ddfdf041ed87b3d0e731763a37 P 01adf83af3e04875b5fac9470d4da915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 2.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:54:58.898437 4865 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:58.898898 25665 ts_tablet_manager.cc:1434] T 541201ddfdf041ed87b3d0e731763a37 P 01adf83af3e04875b5fac9470d4da915: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260807 13:54:58.905380 7213 tablet_copy_service.cc:342] P b77f2b2eade540c6bfd4f75e5229a3cd: Request end of tablet copy session 01adf83af3e04875b5fac9470d4da915-541201ddfdf041ed87b3d0e731763a37 received from {username='slave'} at 127.23.107.131:46299
I20260807 13:54:58.905531 7213 tablet_copy_service.cc:434] P b77f2b2eade540c6bfd4f75e5229a3cd: ending tablet copy session 01adf83af3e04875b5fac9470d4da915-541201ddfdf041ed87b3d0e731763a37 on tablet 541201ddfdf041ed87b3d0e731763a37 with peer 01adf83af3e04875b5fac9470d4da915
I20260807 13:54:58.931157 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:59.009665 25785 ts_tablet_manager.cc:933] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
W20260807 13:54:59.026710 4632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.134:35975, user_credentials={real_user=slave}} blocked reactor thread for 102785us
I20260807 13:54:59.066073 25785 tablet_copy_client.cc:323] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:54:59.069150 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet e93615e4fb61416d8740ce61970610af from peer b77f2b2eade540c6bfd4f75e5229a3cd ({username='slave'} at 127.23.107.133:38087)
I20260807 13:54:59.069375 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet e93615e4fb61416d8740ce61970610af from peer b77f2b2eade540c6bfd4f75e5229a3cd at {username='slave'} at 127.23.107.133:38087: session id = b77f2b2eade540c6bfd4f75e5229a3cd-e93615e4fb61416d8740ce61970610af
I20260807 13:54:59.073132 5272 tablet_copy_source_session.cc:215] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:59.075920 25785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93615e4fb61416d8740ce61970610af. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 13:54:59.078671 5154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.134:35975, user_credentials={real_user=slave}} blocked reactor thread for 50439us
I20260807 13:54:59.099851 25785 tablet_copy_client.cc:806] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:59.100504 25785 tablet_copy_client.cc:670] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:59.103075 25785 tablet_copy_client.cc:538] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:59.112123 25785 tablet_bootstrap.cc:492] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap starting.
I20260807 13:54:59.154928 5246 consensus_queue.cc:237] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
W20260807 13:54:59.199692 5151 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 -> Peer 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729): Couldn't send request to peer 31d7630573c8475a9f84978d4ebfb879. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:54:59.201027 4892 raft_consensus.cc:1275] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20260807 13:54:59.201802 25788 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260807 13:54:59.212934 7353 raft_consensus.cc:1275] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20260807 13:54:59.213827 25788 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260807 13:54:59.218987 25794 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:59.222621 7354 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:59.230031 4892 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:59.231424 4519 catalog_manager.cc:5697] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: config changed from index 11 to 12, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:54:59.263365 4715 consensus_queue.cc:237] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 1.14, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:54:59.280189 5074 raft_consensus.cc:1217] T 541201ddfdf041ed87b3d0e731763a37 P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 2.10->[2.11-2.11] Dedup: 2.11->[]
I20260807 13:54:59.290225 5074 raft_consensus.cc:1275] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 14. Preceding OpId from leader: term: 1 index: 15. (index mismatch)
I20260807 13:54:59.291554 25777 consensus_queue.cc:1048] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260807 13:54:59.292956 25785 tablet_bootstrap.cc:492] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:54:59.293457 25785 tablet_bootstrap.cc:492] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: Bootstrap complete.
I20260807 13:54:59.293819 25785 ts_tablet_manager.cc:1403] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent bootstrapping tablet: real 0.182s user 0.064s sys 0.033s
I20260807 13:54:59.294902 25785 raft_consensus.cc:359] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:59.295156 25785 raft_consensus.cc:740] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77f2b2eade540c6bfd4f75e5229a3cd, State: Initialized, Role: FOLLOWER
I20260807 13:54:59.295430 25785 consensus_queue.cc:260] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:54:59.296130 25785 ts_tablet_manager.cc:1434] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260807 13:54:59.296941 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-e93615e4fb61416d8740ce61970610af received from {username='slave'} at 127.23.107.133:38087
I20260807 13:54:59.297092 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-e93615e4fb61416d8740ce61970610af on tablet e93615e4fb61416d8740ce61970610af with peer b77f2b2eade540c6bfd4f75e5229a3cd
I20260807 13:54:59.298921 7178 raft_consensus.cc:1275] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 14. Preceding OpId from leader: term: 1 index: 15. (index mismatch)
I20260807 13:54:59.300992 25781 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.15: config changed from index 14 to 15, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:59.302464 5074 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.15: config changed from index 14 to 15, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:59.306998 25776 consensus_queue.cc:1048] T 966ebd287fc14e498e5bd3e6542194ca P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260807 13:54:59.309813 4515 catalog_manager.cc:5697] T 966ebd287fc14e498e5bd3e6542194ca P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 14 to 15, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:59.314646 7178 raft_consensus.cc:2955] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.15: config changed from index 14 to 15, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:54:59.316357 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 966ebd287fc14e498e5bd3e6542194ca with delete_type TABLET_DATA_TOMBSTONED (TS edf940ebcc1140cfa0c23214e0c0f179 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:53540
I20260807 13:54:59.338136 25856 tablet_replica.cc:333] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179: stopping tablet replica
I20260807 13:54:59.340699 25856 raft_consensus.cc:2243] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:54:59.341511 25856 raft_consensus.cc:2272] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:54:59.343266 25856 ts_tablet_manager.cc:1916] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:54:59.372326 25856 ts_tablet_manager.cc:1929] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.14
I20260807 13:54:59.385664 25856 log.cc:1199] T 966ebd287fc14e498e5bd3e6542194ca P edf940ebcc1140cfa0c23214e0c0f179: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal/wals/966ebd287fc14e498e5bd3e6542194ca
I20260807 13:54:59.387100 4506 catalog_manager.cc:5028] TS edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): tablet 966ebd287fc14e498e5bd3e6542194ca (table rebalance_test_table_6 [id=6008038c907645199b055dacb5772621]) successfully deleted
W20260807 13:54:59.527521 4806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.135:40385, user_credentials={real_user=slave}} blocked reactor thread for 77949.9us
I20260807 13:54:59.546607 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:59.562878 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:59.566996 7178 raft_consensus.cc:1217] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.5->[1.6-1.6] Dedup: 1.6->[]
I20260807 13:54:59.613646 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:59.627240 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:54:59.699213 7158 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:54:59.717118 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:54:59.745105 25961 ts_tablet_manager.cc:933] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:54:59.756883 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:54:59.769529 25961 tablet_copy_client.cc:323] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:54:59.770380 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet 96bc42d66fa04fb69afa630969dbb579 from peer 31d7630573c8475a9f84978d4ebfb879 ({username='slave'} at 127.23.107.136:35045)
I20260807 13:54:59.770557 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet 96bc42d66fa04fb69afa630969dbb579 from peer 31d7630573c8475a9f84978d4ebfb879 at {username='slave'} at 127.23.107.136:35045: session id = 31d7630573c8475a9f84978d4ebfb879-96bc42d66fa04fb69afa630969dbb579
I20260807 13:54:59.774740 5272 tablet_copy_source_session.cc:215] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:54:59.776028 25961 ts_tablet_manager.cc:1916] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:54:59.791391 25961 ts_tablet_manager.cc:1929] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.10
I20260807 13:54:59.794265 25961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96bc42d66fa04fb69afa630969dbb579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:54:59.797657 4715 consensus_queue.cc:237] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:59.810999 4865 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:54:59.811794 7354 raft_consensus.cc:1275] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20260807 13:54:59.814643 25781 consensus_queue.cc:1048] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260807 13:54:59.821970 7178 raft_consensus.cc:1275] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20260807 13:54:59.822669 25781 consensus_queue.cc:1048] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260807 13:54:59.840653 25781 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:59.844128 7180 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:59.849836 4515 catalog_manager.cc:5697] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: config changed from index 12 to 13, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:59.863291 25961 tablet_copy_client.cc:806] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 0 data blocks...
I20260807 13:54:59.865978 25961 tablet_copy_client.cc:670] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 1 WAL segments...
I20260807 13:54:59.878350 7353 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:54:59.895237 25961 tablet_copy_client.cc:538] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:54:59.942646 25961 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap starting.
I20260807 13:54:59.949013 4865 tablet_service.cc:1558] Processing DeleteTablet for tablet 68717842b14e4f06b528c08a65acd3b7 with delete_type TABLET_DATA_TOMBSTONED (TS c9d2944272bc447dafce7620ac2dbd4b not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:36624
I20260807 13:55:00.012497 25984 tablet_replica.cc:333] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b: stopping tablet replica
I20260807 13:55:00.012996 25984 raft_consensus.cc:2243] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:55:00.013368 25984 raft_consensus.cc:2272] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:55:00.028824 25984 ts_tablet_manager.cc:1916] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:55:00.091782 25984 ts_tablet_manager.cc:1929] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.12
I20260807 13:55:00.092111 25984 log.cc:1199] T 68717842b14e4f06b528c08a65acd3b7 P c9d2944272bc447dafce7620ac2dbd4b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/68717842b14e4f06b528c08a65acd3b7
I20260807 13:55:00.093598 4505 catalog_manager.cc:5028] TS c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): tablet 68717842b14e4f06b528c08a65acd3b7 (table rebalance_test_table_1 [id=7f1d26639edd4cb398339b2b0d3659a3]) successfully deleted
I20260807 13:55:00.158574 25961 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:55:00.159392 25961 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap complete.
I20260807 13:55:00.159929 25961 ts_tablet_manager.cc:1403] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: Time spent bootstrapping tablet: real 0.217s user 0.109s sys 0.039s
I20260807 13:55:00.161156 25961 raft_consensus.cc:359] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:55:00.162422 25961 raft_consensus.cc:740] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d7630573c8475a9f84978d4ebfb879, State: Initialized, Role: FOLLOWER
I20260807 13:55:00.163046 25961 consensus_queue.cc:260] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:55:00.167306 25961 ts_tablet_manager.cc:1434] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260807 13:55:00.168741 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session 31d7630573c8475a9f84978d4ebfb879-96bc42d66fa04fb69afa630969dbb579 received from {username='slave'} at 127.23.107.136:35045
I20260807 13:55:00.168900 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session 31d7630573c8475a9f84978d4ebfb879-96bc42d66fa04fb69afa630969dbb579 on tablet 96bc42d66fa04fb69afa630969dbb579 with peer 31d7630573c8475a9f84978d4ebfb879
I20260807 13:55:00.192477 7690 raft_consensus.cc:1217] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.11->[1.12-1.12] Dedup: 1.12->[]
I20260807 13:55:00.385426 5246 consensus_queue.cc:237] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:55:00.389915 7180 raft_consensus.cc:1275] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:55:00.390138 4892 raft_consensus.cc:1275] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:55:00.390693 25788 consensus_queue.cc:1048] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:55:00.393821 25788 consensus_queue.cc:1048] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:55:00.427716 25788 raft_consensus.cc:2955] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:55:00.450235 4519 catalog_manager.cc:5697] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index 6 to 7, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) evicted. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:55:00.456234 4897 raft_consensus.cc:2955] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:55:00.461193 7180 raft_consensus.cc:2955] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:55:00.482875 7502 tablet_service.cc:1558] Processing DeleteTablet for tablet e93615e4fb61416d8740ce61970610af with delete_type TABLET_DATA_TOMBSTONED (TS 8a9903f009ff46b4a6875490823076c4 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:39618
I20260807 13:55:00.505687 26139 tablet_replica.cc:333] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4: stopping tablet replica
I20260807 13:55:00.509536 26139 raft_consensus.cc:2243] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:55:00.510576 26139 raft_consensus.cc:2272] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:55:00.514135 26139 ts_tablet_manager.cc:1916] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:55:00.561949 26139 ts_tablet_manager.cc:1929] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20260807 13:55:00.562594 26139 log.cc:1199] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal/wals/e93615e4fb61416d8740ce61970610af
I20260807 13:55:00.563871 4506 catalog_manager.cc:5028] TS 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): tablet e93615e4fb61416d8740ce61970610af (table rebalance_test_table_9 [id=96e83925faa542ffa4808b01a5adbbb3]) successfully deleted
I20260807 13:55:00.673974 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:00.712121 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:00.712647 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:00.718158 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:00.719110 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:00.739491 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:00.760274 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:00.774240 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260807 13:55:00.800717 7441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.136:43729, user_credentials={real_user=slave}} blocked reactor thread for 54669.7us
I20260807 13:55:00.801712 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:00.837244 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:00.859539 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:00.860591 7158 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:00.887360 7158 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:00.909101 7158 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:00.921800 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:00.929838 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:55:01.025835 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:55:01.033475 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:01.043226 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:55:01.052469 4865 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:01.069752 4865 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:01.075848 4865 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:01.188638 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:01.195278 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:01.206542 4865 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:01.211997 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:01.227694 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:01.254686 7158 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:01.266206 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:01.293642 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:01.314363 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:55:01.367172 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:01.721011 4508 maintenance_manager.cc:419] P 8cbfb811b4254ad3a53fc5ab7e02474d: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033338
I20260807 13:55:01.809427 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:01.873948 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:01.876636 4507 maintenance_manager.cc:643] P 8cbfb811b4254ad3a53fc5ab7e02474d: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.155s user 0.035s sys 0.058s Metrics: {"bytes_written":20313,"cfile_init":1,"dirs.queue_time_us":26151,"dirs.run_cpu_time_us":243,"dirs.run_wall_time_us":885,"drs_written":1,"lbm_read_time_us":134,"lbm_reads_lt_1ms":4,"lbm_write_time_us":13437,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":28,"peak_mem_usage":0,"rows_written":43,"thread_start_us":45952,"threads_started":2,"wal-append.queue_time_us":20093}
I20260807 13:55:01.878568 4508 maintenance_manager.cc:419] P 8cbfb811b4254ad3a53fc5ab7e02474d: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10486 bytes on disk
I20260807 13:55:01.880384 4507 maintenance_manager.cc:643] P 8cbfb811b4254ad3a53fc5ab7e02474d: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.001s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":158,"lbm_reads_lt_1ms":4}
I20260807 13:55:01.881109 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:01.894863 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:01.923529 7158 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:01.993876 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:02.019029 4865 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:02.051088 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:55:02.057101 5074 consensus_queue.cc:237] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:55:02.079742 7354 raft_consensus.cc:1275] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260807 13:55:02.080804 25823 consensus_queue.cc:1048] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:55:02.094651 7522 raft_consensus.cc:1275] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260807 13:55:02.095453 25823 consensus_queue.cc:1048] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:55:02.121805 26336 raft_consensus.cc:2955] T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:55:02.122939 7524 raft_consensus.cc:2955] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:55:02.135304 4520 catalog_manager.cc:5697] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 reported cstate change: config changed from index 10 to 11, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
W20260807 13:55:02.158315 26342 log.cc:927] Time spent T 739f4f0207104455bf3e87bc04f8d13c P 01adf83af3e04875b5fac9470d4da915: Append to log took a long time: real 0.080s user 0.000s sys 0.000s
I20260807 13:55:02.163601 7354 raft_consensus.cc:2955] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:55:02.177158 4716 consensus_queue.cc:237] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:55:02.181931 5074 consensus_queue.cc:237] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:55:02.188864 4865 tablet_service.cc:1558] Processing DeleteTablet for tablet 739f4f0207104455bf3e87bc04f8d13c with delete_type TABLET_DATA_TOMBSTONED (TS c9d2944272bc447dafce7620ac2dbd4b not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:36624
I20260807 13:55:02.196702 5068 raft_consensus.cc:1275] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:55:02.198637 26374 tablet_replica.cc:333] T 739f4f0207104455bf3e87bc04f8d13c P c9d2944272bc447dafce7620ac2dbd4b: stopping tablet replica
I20260807 13:55:02.198609 7180 raft_consensus.cc:1275] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260807 13:55:02.198828 26374 raft_consensus.cc:2243] T 739f4f0207104455bf3e87bc04f8d13c P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:55:02.199018 26374 raft_consensus.cc:2272] T 739f4f0207104455bf3e87bc04f8d13c P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:55:02.199306 26230 consensus_queue.cc:1048] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:55:02.199901 26374 ts_tablet_manager.cc:1916] T 739f4f0207104455bf3e87bc04f8d13c P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260807 13:55:02.203840 4981 consensus_peers.cc:597] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:55:02.204054 26336 consensus_queue.cc:1048] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:55:02.204851 4897 raft_consensus.cc:1275] T 0c1327c8461e44f2ac5d77f10c390eeb P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 13:55:02.206110 26230 consensus_queue.cc:1048] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:55:02.209147 26374 ts_tablet_manager.cc:1929] T 739f4f0207104455bf3e87bc04f8d13c P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.10
I20260807 13:55:02.209266 26374 log.cc:1199] T 739f4f0207104455bf3e87bc04f8d13c P c9d2944272bc447dafce7620ac2dbd4b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/739f4f0207104455bf3e87bc04f8d13c
I20260807 13:55:02.210114 4505 catalog_manager.cc:5028] TS c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): tablet 739f4f0207104455bf3e87bc04f8d13c (table rebalance_test_table_3 [id=c2c7db1795a1414c8299bebbeaf60404]) successfully deleted
I20260807 13:55:02.218251 26230 raft_consensus.cc:2955] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:55:02.222292 5074 raft_consensus.cc:2955] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:55:02.229447 4510 catalog_manager.cc:5697] T 0c1327c8461e44f2ac5d77f10c390eeb P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 6 to 7, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) evicted. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:55:02.230288 7522 raft_consensus.cc:1275] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260807 13:55:02.231115 26336 consensus_queue.cc:1048] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:55:02.235981 7502 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c1327c8461e44f2ac5d77f10c390eeb with delete_type TABLET_DATA_TOMBSTONED (TS 8a9903f009ff46b4a6875490823076c4 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:39618
I20260807 13:55:02.238521 26336 raft_consensus.cc:2955] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:55:02.240320 7524 raft_consensus.cc:2955] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:55:02.256115 4511 catalog_manager.cc:5697] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 9 to 10, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:55:02.257063 7180 raft_consensus.cc:2955] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:55:02.274650 26382 tablet_replica.cc:333] T 0c1327c8461e44f2ac5d77f10c390eeb P 8a9903f009ff46b4a6875490823076c4: stopping tablet replica
I20260807 13:55:02.276391 4892 raft_consensus.cc:2955] T 0c1327c8461e44f2ac5d77f10c390eeb P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:55:02.277212 26382 raft_consensus.cc:2243] T 0c1327c8461e44f2ac5d77f10c390eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:55:02.277637 26382 raft_consensus.cc:2272] T 0c1327c8461e44f2ac5d77f10c390eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:55:02.282407 26382 ts_tablet_manager.cc:1916] T 0c1327c8461e44f2ac5d77f10c390eeb P 8a9903f009ff46b4a6875490823076c4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:55:02.292131 26382 ts_tablet_manager.cc:1929] T 0c1327c8461e44f2ac5d77f10c390eeb P 8a9903f009ff46b4a6875490823076c4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20260807 13:55:02.314097 26382 log.cc:1199] T 0c1327c8461e44f2ac5d77f10c390eeb P 8a9903f009ff46b4a6875490823076c4: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal/wals/0c1327c8461e44f2ac5d77f10c390eeb
I20260807 13:55:02.315685 4506 catalog_manager.cc:5028] TS 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): tablet 0c1327c8461e44f2ac5d77f10c390eeb (table rebalance_test_table_3 [id=c2c7db1795a1414c8299bebbeaf60404]) successfully deleted
I20260807 13:55:02.529439 7180 consensus_queue.cc:237] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 2.11, Last appended by leader: 8, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:55:02.535027 5074 raft_consensus.cc:1275] T 541201ddfdf041ed87b3d0e731763a37 P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
I20260807 13:55:02.536083 26279 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260807 13:55:02.543219 26487 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 LEADER]: Committing config change with OpId 2.12: config changed from index 11 to 12, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:55:02.546389 7354 raft_consensus.cc:1275] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
I20260807 13:55:02.547384 26279 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260807 13:55:02.550498 7354 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Committing config change with OpId 2.12: config changed from index 11 to 12, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:55:02.543964 5074 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Committing config change with OpId 2.12: config changed from index 11 to 12, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:55:02.557550 4511 catalog_manager.cc:5697] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: config changed from index 11 to 12, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New cstate: current_term: 2 leader_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:55:02.564601 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 541201ddfdf041ed87b3d0e731763a37 with delete_type TABLET_DATA_TOMBSTONED (TS edf940ebcc1140cfa0c23214e0c0f179 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:53540
I20260807 13:55:02.582971 26502 tablet_replica.cc:333] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179: stopping tablet replica
I20260807 13:55:02.583226 26502 raft_consensus.cc:2243] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:55:02.583514 26502 raft_consensus.cc:2272] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:55:02.585556 26502 ts_tablet_manager.cc:1916] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:55:02.595255 26502 ts_tablet_manager.cc:1929] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.11
I20260807 13:55:02.595466 26502 log.cc:1199] T 541201ddfdf041ed87b3d0e731763a37 P edf940ebcc1140cfa0c23214e0c0f179: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal/wals/541201ddfdf041ed87b3d0e731763a37
I20260807 13:55:02.596666 4506 catalog_manager.cc:5028] TS edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): tablet 541201ddfdf041ed87b3d0e731763a37 (table rebalance_test_table_4 [id=e242e42da20d4458a49a269a9569307a]) successfully deleted
I20260807 13:55:02.655576 26525 ts_tablet_manager.cc:933] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:55:02.661028 26525 tablet_copy_client.cc:323] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:55:02.663884 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet d27ce55f2acc4513a9fd90a338098eeb from peer c9d2944272bc447dafce7620ac2dbd4b ({username='slave'} at 127.23.107.130:47105)
I20260807 13:55:02.664064 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet d27ce55f2acc4513a9fd90a338098eeb from peer c9d2944272bc447dafce7620ac2dbd4b at {username='slave'} at 127.23.107.130:47105: session id = c9d2944272bc447dafce7620ac2dbd4b-d27ce55f2acc4513a9fd90a338098eeb
I20260807 13:55:02.668147 5101 tablet_copy_source_session.cc:215] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:55:02.670004 26525 ts_tablet_manager.cc:1916] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:55:02.687438 26525 ts_tablet_manager.cc:1929] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.4
I20260807 13:55:02.691171 26525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27ce55f2acc4513a9fd90a338098eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:55:02.701804 26525 tablet_copy_client.cc:806] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Starting download of 0 data blocks...
I20260807 13:55:02.706346 26525 tablet_copy_client.cc:670] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Starting download of 1 WAL segments...
I20260807 13:55:02.708892 26525 tablet_copy_client.cc:538] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:55:02.720283 26525 tablet_bootstrap.cc:492] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:55:02.853365 26525 tablet_bootstrap.cc:492] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:55:02.854295 26525 tablet_bootstrap.cc:492] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap complete.
I20260807 13:55:02.854709 26525 ts_tablet_manager.cc:1403] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.135s user 0.057s sys 0.007s
I20260807 13:55:02.856560 26525 raft_consensus.cc:359] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:55:02.856871 26525 raft_consensus.cc:740] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:55:02.857263 26525 consensus_queue.cc:260] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:55:02.858364 26525 ts_tablet_manager.cc:1434] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 13:55:02.860941 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:02.861617 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session c9d2944272bc447dafce7620ac2dbd4b-d27ce55f2acc4513a9fd90a338098eeb received from {username='slave'} at 127.23.107.130:47105
I20260807 13:55:02.861790 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session c9d2944272bc447dafce7620ac2dbd4b-d27ce55f2acc4513a9fd90a338098eeb on tablet d27ce55f2acc4513a9fd90a338098eeb with peer c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:55:02.918529 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:02.948002 7158 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:03.009262 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260807 13:55:03.032709 4805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.133:38075, user_credentials={real_user=slave}} blocked reactor thread for 73269.3us
I20260807 13:55:03.042594 4865 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:03.079533 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:03.089569 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:03.148602 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:55:03.158784 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:03.168011 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:03.211611 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:03.228727 4897 raft_consensus.cc:1217] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.9->[1.10-1.10] Dedup: 1.10->[]
I20260807 13:55:03.249398 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:03.273146 7158 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:03.286038 4865 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:03.346596 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:55:03.396580 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:03.517091 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:03.523232 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:03.538000 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:03.586905 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:55:03.591701 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:03.598284 7158 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:03.621131 4865 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:03.637909 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:03.829201 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:03.852527 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:03.898584 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:03.927179 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:03.957306 4865 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:03.974164 7158 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:03.996217 5246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96bc42d66fa04fb69afa630969dbb579"
dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:35304
I20260807 13:55:03.996551 5246 raft_consensus.cc:606] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Received request to transfer leadership
I20260807 13:55:04.019133 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:04.042135 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:04.058458 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:55:04.059733 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:04.066039 7327 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:04.077906 7158 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:04.086040 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:04.145349 4865 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:04.185649 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:04.298715 5214 tablet_service.cc:1467] Tablet server has 8 leaders and 0 scanners
I20260807 13:55:04.312211 26635 raft_consensus.cc:993] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: : Instructing follower 12ab71778f2f4b378765aaed1a0676a5 to start an election
I20260807 13:55:04.314291 26240 raft_consensus.cc:1081] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Signalling peer 12ab71778f2f4b378765aaed1a0676a5 to start an election
I20260807 13:55:04.315217 7354 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96bc42d66fa04fb69afa630969dbb579"
dest_uuid: "12ab71778f2f4b378765aaed1a0676a5"
from {username='slave'} at 127.23.107.132:37747
I20260807 13:55:04.315467 7354 raft_consensus.cc:493] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:55:04.315572 7354 raft_consensus.cc:3060] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:04.320905 7354 raft_consensus.cc:515] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:55:04.325414 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bc42d66fa04fb69afa630969dbb579" candidate_uuid: "12ab71778f2f4b378765aaed1a0676a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: true dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179"
I20260807 13:55:04.325640 5248 raft_consensus.cc:3055] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:55:04.325704 5248 raft_consensus.cc:740] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Running, Role: LEADER
I20260807 13:55:04.325975 5248 consensus_queue.cc:260] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:55:04.326206 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bc42d66fa04fb69afa630969dbb579" candidate_uuid: "12ab71778f2f4b378765aaed1a0676a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: true dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
I20260807 13:55:04.326411 5248 raft_consensus.cc:3060] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:04.326490 4897 raft_consensus.cc:3060] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:04.330735 4897 raft_consensus.cc:2468] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12ab71778f2f4b378765aaed1a0676a5 in term 2.
I20260807 13:55:04.332500 7688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bc42d66fa04fb69afa630969dbb579" candidate_uuid: "12ab71778f2f4b378765aaed1a0676a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: true dest_uuid: "31d7630573c8475a9f84978d4ebfb879"
I20260807 13:55:04.332729 7688 raft_consensus.cc:3060] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:04.335003 5248 raft_consensus.cc:2468] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12ab71778f2f4b378765aaed1a0676a5 in term 2.
I20260807 13:55:04.335861 7688 raft_consensus.cc:2468] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12ab71778f2f4b378765aaed1a0676a5 in term 2.
I20260807 13:55:04.342159 7271 leader_election.cc:304] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5, 31d7630573c8475a9f84978d4ebfb879, c9d2944272bc447dafce7620ac2dbd4b; no voters:
I20260807 13:55:04.342543 22994 raft_consensus.cc:2804] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:55:04.350661 7354 leader_election.cc:290] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 election: Requested vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729)
I20260807 13:55:04.361492 22994 raft_consensus.cc:697] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 LEADER]: Becoming Leader. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Running, Role: LEADER
I20260807 13:55:04.361954 22994 consensus_queue.cc:237] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:55:04.375778 4514 catalog_manager.cc:5697] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: term changed from 1 to 2, leader changed from edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) to 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134). New cstate: current_term: 2 leader_uuid: "12ab71778f2f4b378765aaed1a0676a5" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:55:04.479290 4897 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "312c7ed04e334b08b506c8908224a7da"
dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:39280
I20260807 13:55:04.479537 4897 raft_consensus.cc:606] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Received request to transfer leadership
I20260807 13:55:04.570627 26802 raft_consensus.cc:993] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b: : Instructing follower b77f2b2eade540c6bfd4f75e5229a3cd to start an election
I20260807 13:55:04.570976 26802 raft_consensus.cc:1081] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Signalling peer b77f2b2eade540c6bfd4f75e5229a3cd to start an election
I20260807 13:55:04.572009 7180 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "312c7ed04e334b08b506c8908224a7da"
dest_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd"
from {username='slave'} at 127.23.107.130:42083
I20260807 13:55:04.572289 7180 raft_consensus.cc:493] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:55:04.572427 7180 raft_consensus.cc:3060] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:04.580026 7180 raft_consensus.cc:515] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:55:04.581678 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312c7ed04e334b08b506c8908224a7da" candidate_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: true dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
I20260807 13:55:04.582506 7180 leader_election.cc:290] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 election: Requested vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:55:04.586218 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312c7ed04e334b08b506c8908224a7da" candidate_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: true dest_uuid: "01adf83af3e04875b5fac9470d4da915"
I20260807 13:55:04.586452 5074 raft_consensus.cc:3060] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:04.588959 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "312c7ed04e334b08b506c8908224a7da" candidate_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: true dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179"
I20260807 13:55:04.589450 5248 raft_consensus.cc:3060] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:04.593879 4897 raft_consensus.cc:3055] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:55:04.593997 4897 raft_consensus.cc:740] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Running, Role: LEADER
I20260807 13:55:04.594285 4897 consensus_queue.cc:260] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:55:04.594748 4897 raft_consensus.cc:3060] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:04.598717 4897 raft_consensus.cc:2468] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77f2b2eade540c6bfd4f75e5229a3cd in term 2.
I20260807 13:55:04.601910 5248 raft_consensus.cc:2468] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77f2b2eade540c6bfd4f75e5229a3cd in term 2.
I20260807 13:55:04.607971 7102 leader_election.cc:304] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b77f2b2eade540c6bfd4f75e5229a3cd, c9d2944272bc447dafce7620ac2dbd4b, edf940ebcc1140cfa0c23214e0c0f179; no voters:
I20260807 13:55:04.608316 26279 raft_consensus.cc:2804] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:55:04.613086 5074 raft_consensus.cc:2468] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77f2b2eade540c6bfd4f75e5229a3cd in term 2.
I20260807 13:55:04.632599 26279 raft_consensus.cc:697] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 LEADER]: Becoming Leader. State: Replica: b77f2b2eade540c6bfd4f75e5229a3cd, State: Running, Role: LEADER
I20260807 13:55:04.633064 26279 consensus_queue.cc:237] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:55:04.697418 4510 catalog_manager.cc:5697] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: term changed from 1 to 2, leader changed from c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) to b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133). New cstate: current_term: 2 leader_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:55:04.732815 5074 consensus_queue.cc:237] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:55:04.758374 4897 raft_consensus.cc:1275] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260807 13:55:04.760941 7180 raft_consensus.cc:1275] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260807 13:55:04.761973 26758 consensus_queue.cc:1048] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:55:04.767606 4892 raft_consensus.cc:1275] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 13. (index mismatch)
I20260807 13:55:04.768275 22994 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260807 13:55:04.775836 26758 consensus_queue.cc:1048] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:55:04.798238 26750 raft_consensus.cc:2955] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:55:04.806406 7180 raft_consensus.cc:2955] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:55:04.811431 5248 raft_consensus.cc:1275] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 13. (index mismatch)
I20260807 13:55:04.812772 22994 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260807 13:55:04.813429 4514 catalog_manager.cc:5697] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: config changed from index 10 to 11, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) evicted. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:55:04.819741 7502 tablet_service.cc:1558] Processing DeleteTablet for tablet d27ce55f2acc4513a9fd90a338098eeb with delete_type TABLET_DATA_TOMBSTONED (TS 8a9903f009ff46b4a6875490823076c4 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:39618
I20260807 13:55:04.823082 4897 raft_consensus.cc:2955] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:55:04.835448 26855 tablet_replica.cc:333] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4: stopping tablet replica
I20260807 13:55:04.837226 26855 raft_consensus.cc:2243] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:55:04.837612 26855 raft_consensus.cc:2272] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:55:04.839941 26855 ts_tablet_manager.cc:1916] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:55:04.862437 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:04.904995 7688 raft_consensus.cc:1275] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 13. (index mismatch)
I20260807 13:55:04.905915 22994 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260807 13:55:04.910903 26855 ts_tablet_manager.cc:1929] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.10
I20260807 13:55:04.912725 26855 log.cc:1199] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/wal/wals/d27ce55f2acc4513a9fd90a338098eeb
I20260807 13:55:04.915735 4506 catalog_manager.cc:5028] TS 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): tablet d27ce55f2acc4513a9fd90a338098eeb (table rebalance_test_table_9 [id=96e83925faa542ffa4808b01a5adbbb3]) successfully deleted
I20260807 13:55:04.932315 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:04.933041 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:05.018005 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:05.031009 5074 raft_consensus.cc:1275] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 2 index: 11. (index mismatch)
I20260807 13:55:05.032107 26279 consensus_queue.cc:1048] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260807 13:55:05.049638 4629 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.136:43729, user_credentials={real_user=slave}} blocked reactor thread for 84557.1us
I20260807 13:55:05.051707 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:05.117425 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:05.118013 4865 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:05.126056 5246 raft_consensus.cc:1275] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 2 index: 11. (index mismatch)
I20260807 13:55:05.128474 26279 consensus_queue.cc:1048] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:55:05.220383 5214 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:55:05.294468 4897 raft_consensus.cc:1275] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 2 index: 11. (index mismatch)
I20260807 13:55:05.297487 26279 consensus_queue.cc:1048] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:55:05.356017 7354 consensus_queue.cc:237] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 2.13, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:55:05.359807 5246 raft_consensus.cc:1275] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 13. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260807 13:55:05.367298 26754 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260807 13:55:05.368202 4897 raft_consensus.cc:1275] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 13. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260807 13:55:05.372947 26754 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260807 13:55:05.379240 26754 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 LEADER]: Committing config change with OpId 2.14: config changed from index 12 to 14, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:55:05.382179 5246 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Committing config change with OpId 2.14: config changed from index 12 to 14, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:55:05.389285 4897 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Committing config change with OpId 2.14: config changed from index 12 to 14, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:55:05.397713 4511 catalog_manager.cc:5697] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: config changed from index 12 to 14, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) evicted. New cstate: current_term: 2 leader_uuid: "12ab71778f2f4b378765aaed1a0676a5" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:55:05.423632 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:05.462442 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:05.543139 7669 tablet_service.cc:1558] Processing DeleteTablet for tablet 96bc42d66fa04fb69afa630969dbb579 with delete_type TABLET_DATA_TOMBSTONED (TS 31d7630573c8475a9f84978d4ebfb879 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:56664
I20260807 13:55:05.576756 4865 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:05.581378 7668 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:05.581880 5214 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:55:05.603570 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:05.611153 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:05.645025 27003 tablet_replica.cc:333] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: stopping tablet replica
I20260807 13:55:05.645663 27003 raft_consensus.cc:2243] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:55:05.646052 27003 raft_consensus.cc:2272] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:55:05.647471 27003 ts_tablet_manager.cc:1916] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:55:05.653898 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:05.661118 27003 ts_tablet_manager.cc:1929] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.13
I20260807 13:55:05.663105 27003 log.cc:1199] T 96bc42d66fa04fb69afa630969dbb579 P 31d7630573c8475a9f84978d4ebfb879: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/wal/wals/96bc42d66fa04fb69afa630969dbb579
I20260807 13:55:05.664637 4503 catalog_manager.cc:5028] TS 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729): tablet 96bc42d66fa04fb69afa630969dbb579 (table rebalance_test_table_4 [id=e242e42da20d4458a49a269a9569307a]) successfully deleted
I20260807 13:55:05.686913 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:05.807297 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:05.852705 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:05.889642 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:05.904078 4865 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
W20260807 13:55:05.916725 5151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.136:43729, user_credentials={real_user=slave}} blocked reactor thread for 83249.1us
I20260807 13:55:05.965986 5214 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:55:05.986344 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
W20260807 13:55:06.074978 7613 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.129:32841, user_credentials={real_user=slave}} blocked reactor thread for 53882.9us
I20260807 13:55:06.081821 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:06.269408 7354 consensus_queue.cc:237] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:55:06.272764 4897 raft_consensus.cc:1275] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 14. Preceding OpId from leader: term: 2 index: 15. (index mismatch)
I20260807 13:55:06.274479 26754 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260807 13:55:06.329053 7102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.132:41217, user_credentials={real_user=slave}} blocked reactor thread for 99142.3us
I20260807 13:55:06.357895 27113 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 LEADER]: Committing config change with OpId 2.15: config changed from index 14 to 15, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:55:06.376976 4897 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Committing config change with OpId 2.15: config changed from index 14 to 15, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
W20260807 13:55:06.384765 7100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.131:40441, user_credentials={real_user=slave}} blocked reactor thread for 112843us
I20260807 13:55:06.386880 4514 catalog_manager.cc:5697] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index 14 to 15, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New cstate: current_term: 2 leader_uuid: "12ab71778f2f4b378765aaed1a0676a5" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
W20260807 13:55:06.442874 7101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.130:37489, user_credentials={real_user=slave}} blocked reactor thread for 91061.9us
W20260807 13:55:06.445531 4630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.131:40441, user_credentials={real_user=slave}} blocked reactor thread for 48462.9us
W20260807 13:55:06.447324 7272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.131:40441, user_credentials={real_user=slave}} blocked reactor thread for 86048.9us
I20260807 13:55:06.528700 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:06.529702 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 96bc42d66fa04fb69afa630969dbb579 with delete_type TABLET_DATA_TOMBSTONED (TS edf940ebcc1140cfa0c23214e0c0f179 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:53540
I20260807 13:55:06.532559 7354 consensus_queue.cc:237] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 2.15, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
W20260807 13:55:06.543833 7274 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:55:06.541301 4897 raft_consensus.cc:1275] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 15. Preceding OpId from leader: term: 2 index: 16. (index mismatch)
I20260807 13:55:06.544992 26754 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260807 13:55:06.550490 26754 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 LEADER]: Committing config change with OpId 2.16: config changed from index 15 to 16, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:55:06.554366 4897 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Committing config change with OpId 2.16: config changed from index 15 to 16, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:55:06.579180 4506 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet 96bc42d66fa04fb69afa630969dbb579 with cas_config_opid_index 15: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260807 13:55:06.582188 5246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50a090faa58e4f91961c9251030efacf"
dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:35380
I20260807 13:55:06.582468 5246 raft_consensus.cc:606] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Received request to transfer leadership
I20260807 13:55:06.586596 4514 catalog_manager.cc:5697] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: config changed from index 15 to 16, VOTER fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) added. New cstate: current_term: 2 leader_uuid: "12ab71778f2f4b378765aaed1a0676a5" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } }
I20260807 13:55:06.651438 27171 tablet_replica.cc:333] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: stopping tablet replica
I20260807 13:55:06.652863 27171 raft_consensus.cc:2243] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:55:06.653198 27171 raft_consensus.cc:2272] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:55:06.654613 27171 ts_tablet_manager.cc:1916] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:55:06.687136 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:06.734050 27171 ts_tablet_manager.cc:1929] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.14
I20260807 13:55:06.739880 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:06.745807 27171 log.cc:1199] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal/wals/96bc42d66fa04fb69afa630969dbb579
I20260807 13:55:06.750419 4506 catalog_manager.cc:5028] TS edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): tablet 96bc42d66fa04fb69afa630969dbb579 (table rebalance_test_table_4 [id=e242e42da20d4458a49a269a9569307a]) successfully deleted
I20260807 13:55:06.751446 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:06.769201 7180 consensus_queue.cc:237] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 2.11, Last appended by leader: 10, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:55:06.776275 5214 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:55:06.789997 4865 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:06.805799 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:06.843010 5074 raft_consensus.cc:1275] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
I20260807 13:55:06.843894 27118 consensus_queue.cc:1048] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260807 13:55:06.861543 5246 raft_consensus.cc:1275] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
I20260807 13:55:06.862408 27118 consensus_queue.cc:1048] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260807 13:55:06.886581 27118 raft_consensus.cc:2955] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 LEADER]: Committing config change with OpId 2.12: config changed from index 10 to 12, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:55:06.888398 4688 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:06.890254 5068 raft_consensus.cc:2955] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Committing config change with OpId 2.12: config changed from index 10 to 12, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:55:06.898663 4511 catalog_manager.cc:5697] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: config changed from index 10 to 12, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New cstate: current_term: 2 leader_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:55:06.906023 5248 raft_consensus.cc:2955] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Committing config change with OpId 2.12: config changed from index 10 to 12, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
I20260807 13:55:06.910709 4865 tablet_service.cc:1558] Processing DeleteTablet for tablet 312c7ed04e334b08b506c8908224a7da with delete_type TABLET_DATA_TOMBSTONED (TS c9d2944272bc447dafce7620ac2dbd4b not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:36624
I20260807 13:55:06.916767 27222 tablet_replica.cc:333] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b: stopping tablet replica
I20260807 13:55:06.917543 27222 raft_consensus.cc:2243] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:55:06.917836 27222 raft_consensus.cc:2272] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:55:06.918975 27222 ts_tablet_manager.cc:1916] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:55:06.935942 27222 ts_tablet_manager.cc:1929] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.11
I20260807 13:55:06.936580 27222 log.cc:1199] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/wal/wals/312c7ed04e334b08b506c8908224a7da
I20260807 13:55:06.937673 4505 catalog_manager.cc:5028] TS c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): tablet 312c7ed04e334b08b506c8908224a7da (table rebalance_test_table_5 [id=b6c061acc30c4e5aa6bee1f054e3a59a]) successfully deleted
I20260807 13:55:06.954023 27056 raft_consensus.cc:993] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179: : Instructing follower fa83b7af134b4e3b949ac3b4e4bcb5e7 to start an election
I20260807 13:55:06.954221 27056 raft_consensus.cc:1081] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Signalling peer fa83b7af134b4e3b949ac3b4e4bcb5e7 to start an election
I20260807 13:55:06.955192 27223 ts_tablet_manager.cc:933] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Initiating tablet copy from peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975)
I20260807 13:55:06.955127 4715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50a090faa58e4f91961c9251030efacf"
dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7"
from {username='slave'} at 127.23.107.132:57653
I20260807 13:55:06.955646 4715 raft_consensus.cc:493] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:55:06.955755 4715 raft_consensus.cc:3060] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:06.958812 4715 raft_consensus.cc:515] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:55:06.961922 4715 leader_election.cc:290] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 2 election: Requested vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729)
I20260807 13:55:06.962198 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a090faa58e4f91961c9251030efacf" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: true dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179"
I20260807 13:55:06.962392 5248 raft_consensus.cc:3055] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:55:06.962467 5248 raft_consensus.cc:740] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Running, Role: LEADER
I20260807 13:55:06.962716 5248 consensus_queue.cc:260] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:55:06.963155 5248 raft_consensus.cc:3060] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:06.965561 7690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a090faa58e4f91961c9251030efacf" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: true dest_uuid: "31d7630573c8475a9f84978d4ebfb879"
I20260807 13:55:06.965746 7690 raft_consensus.cc:3060] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:06.970564 5248 raft_consensus.cc:2468] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 2.
I20260807 13:55:06.979383 4897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a090faa58e4f91961c9251030efacf" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: true dest_uuid: "c9d2944272bc447dafce7620ac2dbd4b"
I20260807 13:55:06.979592 4897 raft_consensus.cc:3060] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:06.982615 4897 raft_consensus.cc:2468] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 2.
I20260807 13:55:06.983225 4631 leader_election.cc:304] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: c9d2944272bc447dafce7620ac2dbd4b, edf940ebcc1140cfa0c23214e0c0f179, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:55:06.983722 27133 raft_consensus.cc:2804] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:55:06.990917 27223 tablet_copy_client.cc:323] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.134:35975
I20260807 13:55:06.991802 7386 tablet_copy_service.cc:140] P 12ab71778f2f4b378765aaed1a0676a5: Received BeginTabletCopySession request for tablet 96bc42d66fa04fb69afa630969dbb579 from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 ({username='slave'} at 127.23.107.129:53325)
I20260807 13:55:06.991954 7386 tablet_copy_service.cc:161] P 12ab71778f2f4b378765aaed1a0676a5: Beginning new tablet copy session on tablet 96bc42d66fa04fb69afa630969dbb579 from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 at {username='slave'} at 127.23.107.129:53325: session id = fa83b7af134b4e3b949ac3b4e4bcb5e7-96bc42d66fa04fb69afa630969dbb579
I20260807 13:55:06.995525 7386 tablet_copy_source_session.cc:215] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:55:06.999668 27223 ts_tablet_manager.cc:1916] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:55:07.013707 27133 raft_consensus.cc:697] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 LEADER]: Becoming Leader. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Running, Role: LEADER
I20260807 13:55:07.015311 27133 consensus_queue.cc:237] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:55:07.020370 27223 ts_tablet_manager.cc:1929] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.4
I20260807 13:55:07.022611 7690 raft_consensus.cc:2468] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 2.
I20260807 13:55:07.025141 27223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96bc42d66fa04fb69afa630969dbb579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:55:07.035300 27223 tablet_copy_client.cc:806] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Starting download of 0 data blocks...
I20260807 13:55:07.038339 27223 tablet_copy_client.cc:670] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Starting download of 1 WAL segments...
I20260807 13:55:07.040439 27223 tablet_copy_client.cc:538] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:55:07.046963 27223 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap starting.
I20260807 13:55:07.048280 4518 catalog_manager.cc:5697] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: term changed from 1 to 2, leader changed from edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) to fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129). New cstate: current_term: 2 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:55:07.093699 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:07.104568 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:07.121212 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:07.137229 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:07.221410 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:07.243335 27223 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=0 applied=16 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:55:07.244035 27223 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Bootstrap complete.
I20260807 13:55:07.244500 27223 ts_tablet_manager.cc:1403] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent bootstrapping tablet: real 0.198s user 0.069s sys 0.004s
I20260807 13:55:07.244983 4865 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:07.245500 27223 raft_consensus.cc:359] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:55:07.245937 27223 raft_consensus.cc:740] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Initialized, Role: FOLLOWER
I20260807 13:55:07.246313 27223 consensus_queue.cc:260] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 2.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:55:07.247097 27223 ts_tablet_manager.cc:1434] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 13:55:07.248101 7386 tablet_copy_service.cc:342] P 12ab71778f2f4b378765aaed1a0676a5: Request end of tablet copy session fa83b7af134b4e3b949ac3b4e4bcb5e7-96bc42d66fa04fb69afa630969dbb579 received from {username='slave'} at 127.23.107.129:53325
I20260807 13:55:07.248240 7386 tablet_copy_service.cc:434] P 12ab71778f2f4b378765aaed1a0676a5: ending tablet copy session fa83b7af134b4e3b949ac3b4e4bcb5e7-96bc42d66fa04fb69afa630969dbb579 on tablet 96bc42d66fa04fb69afa630969dbb579 with peer fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:07.287843 5214 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:07.291127 4688 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:55:07.432821 5248 raft_consensus.cc:1275] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 2 index: 11. (index mismatch)
I20260807 13:55:07.433712 27238 consensus_queue.cc:1048] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:55:07.448812 4897 raft_consensus.cc:1275] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 2 index: 11. (index mismatch)
I20260807 13:55:07.449653 27238 consensus_queue.cc:1048] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:55:07.501098 4715 raft_consensus.cc:1217] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 2.15->[2.16-2.16] Dedup: 2.16->[]
I20260807 13:55:07.508946 7690 raft_consensus.cc:1275] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 2 index: 11. (index mismatch)
I20260807 13:55:07.510047 27238 consensus_queue.cc:1048] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:55:07.624106 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:07.648666 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:07.664969 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:07.671799 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:07.741698 5214 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:07.745617 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:07.750706 4688 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:55:07.752368 4865 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:08.082544 5074 consensus_queue.cc:237] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
W20260807 13:55:08.137807 4982 consensus_peers.cc:597] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 -> Peer 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): Couldn't send request to peer 8a9903f009ff46b4a6875490823076c4. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:55:08.141415 4892 raft_consensus.cc:1275] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20260807 13:55:08.144016 27384 consensus_queue.cc:1048] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260807 13:55:08.149374 7180 raft_consensus.cc:1275] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20260807 13:55:08.150260 27384 consensus_queue.cc:1048] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260807 13:55:08.180034 27384 raft_consensus.cc:2955] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:55:08.184962 7178 raft_consensus.cc:2955] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:55:08.186233 7179 consensus_queue.cc:237] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 2.12, Last appended by leader: 8, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:55:08.198619 4511 catalog_manager.cc:5697] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 11 to 12, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New cstate: current_term: 1 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:55:08.210240 4892 raft_consensus.cc:2955] T d27ce55f2acc4513a9fd90a338098eeb P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
W20260807 13:55:08.233276 7099 consensus_peers.cc:597] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729): Couldn't send request to peer 31d7630573c8475a9f84978d4ebfb879. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 541201ddfdf041ed87b3d0e731763a37. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:55:08.233973 5074 raft_consensus.cc:1275] T 541201ddfdf041ed87b3d0e731763a37 P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 12. Preceding OpId from leader: term: 2 index: 13. (index mismatch)
I20260807 13:55:08.234862 27118 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260807 13:55:08.242571 7354 raft_consensus.cc:1275] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 12. Preceding OpId from leader: term: 2 index: 13. (index mismatch)
I20260807 13:55:08.243485 27118 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260807 13:55:08.300483 27118 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 LEADER]: Committing config change with OpId 2.13: config changed from index 12 to 13, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:55:08.302657 5068 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Committing config change with OpId 2.13: config changed from index 12 to 13, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:55:08.304198 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:08.332959 4518 catalog_manager.cc:5697] T 541201ddfdf041ed87b3d0e731763a37 P 01adf83af3e04875b5fac9470d4da915 reported cstate change: config changed from index 12 to 13, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New cstate: current_term: 2 leader_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:55:08.336969 7354 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Committing config change with OpId 2.13: config changed from index 12 to 13, VOTER 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:55:08.490608 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:08.517143 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:08.518404 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:08.551280 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:08.585422 5214 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:08.628104 4688 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:55:08.630568 27534 ts_tablet_manager.cc:933] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4: Initiating tablet copy from peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:55:08.644006 4865 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:08.699353 27534 tablet_copy_client.cc:323] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.131:40441
I20260807 13:55:08.700251 5101 tablet_copy_service.cc:140] P 01adf83af3e04875b5fac9470d4da915: Received BeginTabletCopySession request for tablet d27ce55f2acc4513a9fd90a338098eeb from peer 8a9903f009ff46b4a6875490823076c4 ({username='slave'} at 127.23.107.135:53271)
I20260807 13:55:08.700419 5101 tablet_copy_service.cc:161] P 01adf83af3e04875b5fac9470d4da915: Beginning new tablet copy session on tablet d27ce55f2acc4513a9fd90a338098eeb from peer 8a9903f009ff46b4a6875490823076c4 at {username='slave'} at 127.23.107.135:53271: session id = 8a9903f009ff46b4a6875490823076c4-d27ce55f2acc4513a9fd90a338098eeb
I20260807 13:55:08.703549 5101 tablet_copy_source_session.cc:215] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:55:08.705976 27534 ts_tablet_manager.cc:1916] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:55:08.719300 27534 ts_tablet_manager.cc:1929] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.10
I20260807 13:55:08.723376 27534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27ce55f2acc4513a9fd90a338098eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:55:08.733423 27534 tablet_copy_client.cc:806] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 0 data blocks...
I20260807 13:55:08.733789 27534 tablet_copy_client.cc:670] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 1 WAL segments...
I20260807 13:55:08.735626 27534 tablet_copy_client.cc:538] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:55:08.739251 27534 tablet_bootstrap.cc:492] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4: Bootstrap starting.
I20260807 13:55:08.745718 4715 consensus_queue.cc:237] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 2.11, Last appended by leader: 10, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:55:08.746408 5248 consensus_queue.cc:237] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:55:08.762701 7179 raft_consensus.cc:1275] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:55:08.764303 27462 consensus_queue.cc:1048] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:55:08.774991 7688 raft_consensus.cc:1275] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 2 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
W20260807 13:55:08.775223 5154 consensus_peers.cc:597] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 -> Peer 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): Couldn't send request to peer 8a9903f009ff46b4a6875490823076c4. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:55:08.776355 27238 consensus_queue.cc:1048] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260807 13:55:08.781790 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:08.790225 4892 raft_consensus.cc:1275] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:55:08.791126 27462 consensus_queue.cc:1048] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:55:08.814046 4897 raft_consensus.cc:1275] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 2 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
I20260807 13:55:08.815436 27568 consensus_queue.cc:1048] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260807 13:55:08.817984 27566 raft_consensus.cc:2955] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 LEADER]: Committing config change with OpId 2.12: config changed from index 10 to 12, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:55:08.818955 7690 raft_consensus.cc:2955] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Committing config change with OpId 2.12: config changed from index 10 to 12, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:55:08.821079 27462 raft_consensus.cc:2955] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:55:08.825156 4518 catalog_manager.cc:5697] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 reported cstate change: config changed from index 10 to 12, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New cstate: current_term: 2 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:55:08.829587 7178 raft_consensus.cc:2955] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:55:08.837520 5214 tablet_service.cc:1558] Processing DeleteTablet for tablet 50a090faa58e4f91961c9251030efacf with delete_type TABLET_DATA_TOMBSTONED (TS edf940ebcc1140cfa0c23214e0c0f179 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:53540
I20260807 13:55:08.840636 4518 catalog_manager.cc:5697] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: config changed from index 7 to 8, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:55:08.852648 27567 ts_tablet_manager.cc:933] T 541201ddfdf041ed87b3d0e731763a37 P 31d7630573c8475a9f84978d4ebfb879: Initiating tablet copy from peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075)
I20260807 13:55:08.860579 27567 tablet_copy_client.cc:323] T 541201ddfdf041ed87b3d0e731763a37 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.133:38075
I20260807 13:55:08.862011 7213 tablet_copy_service.cc:140] P b77f2b2eade540c6bfd4f75e5229a3cd: Received BeginTabletCopySession request for tablet 541201ddfdf041ed87b3d0e731763a37 from peer 31d7630573c8475a9f84978d4ebfb879 ({username='slave'} at 127.23.107.136:41183)
I20260807 13:55:08.862176 7213 tablet_copy_service.cc:161] P b77f2b2eade540c6bfd4f75e5229a3cd: Beginning new tablet copy session on tablet 541201ddfdf041ed87b3d0e731763a37 from peer 31d7630573c8475a9f84978d4ebfb879 at {username='slave'} at 127.23.107.136:41183: session id = 31d7630573c8475a9f84978d4ebfb879-541201ddfdf041ed87b3d0e731763a37
I20260807 13:55:08.870410 7213 tablet_copy_source_session.cc:215] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:55:08.872331 27567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541201ddfdf041ed87b3d0e731763a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:55:08.894140 27567 tablet_copy_client.cc:806] T 541201ddfdf041ed87b3d0e731763a37 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 0 data blocks...
I20260807 13:55:08.899947 27567 tablet_copy_client.cc:670] T 541201ddfdf041ed87b3d0e731763a37 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Starting download of 1 WAL segments...
I20260807 13:55:08.900081 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:08.908550 27575 tablet_replica.cc:333] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179: stopping tablet replica
I20260807 13:55:08.908882 27575 raft_consensus.cc:2243] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:55:08.909180 27575 raft_consensus.cc:2272] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:55:08.910184 27575 ts_tablet_manager.cc:1916] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260807 13:55:08.918551 7100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.131:40441, user_credentials={real_user=slave}} blocked reactor thread for 75935.1us
W20260807 13:55:08.919158 5153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.133:38075, user_credentials={real_user=slave}} blocked reactor thread for 79764.9us
I20260807 13:55:08.920135 4897 raft_consensus.cc:2955] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER 8a9903f009ff46b4a6875490823076c4 (127.23.107.135) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:55:08.930086 4892 raft_consensus.cc:2955] T 50a090faa58e4f91961c9251030efacf P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Committing config change with OpId 2.12: config changed from index 10 to 12, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:55:08.944895 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:08.948086 27567 tablet_copy_client.cc:538] T 541201ddfdf041ed87b3d0e731763a37 P 31d7630573c8475a9f84978d4ebfb879: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:55:08.953060 27567 tablet_bootstrap.cc:492] T 541201ddfdf041ed87b3d0e731763a37 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap starting.
I20260807 13:55:08.969628 27575 ts_tablet_manager.cc:1929] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.11
I20260807 13:55:08.970239 27575 log.cc:1199] T 50a090faa58e4f91961c9251030efacf P edf940ebcc1140cfa0c23214e0c0f179: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/wal/wals/50a090faa58e4f91961c9251030efacf
I20260807 13:55:08.971451 4506 catalog_manager.cc:5028] TS edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): tablet 50a090faa58e4f91961c9251030efacf (table rebalance_test_table_8 [id=91303cf8b9064e06b8c4165942b287f2]) successfully deleted
I20260807 13:55:08.994216 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:08.998557 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:09.080819 4865 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:09.112236 5214 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:09.116161 27567 tablet_bootstrap.cc:492] T 541201ddfdf041ed87b3d0e731763a37 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:55:09.116961 27567 tablet_bootstrap.cc:492] T 541201ddfdf041ed87b3d0e731763a37 P 31d7630573c8475a9f84978d4ebfb879: Bootstrap complete.
I20260807 13:55:09.117380 27567 ts_tablet_manager.cc:1403] T 541201ddfdf041ed87b3d0e731763a37 P 31d7630573c8475a9f84978d4ebfb879: Time spent bootstrapping tablet: real 0.164s user 0.055s sys 0.023s
I20260807 13:55:09.118315 27567 raft_consensus.cc:359] T 541201ddfdf041ed87b3d0e731763a37 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:55:09.118643 27567 raft_consensus.cc:740] T 541201ddfdf041ed87b3d0e731763a37 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d7630573c8475a9f84978d4ebfb879, State: Initialized, Role: FOLLOWER
I20260807 13:55:09.118993 27567 consensus_queue.cc:260] T 541201ddfdf041ed87b3d0e731763a37 P 31d7630573c8475a9f84978d4ebfb879 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 2.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:55:09.120472 27567 ts_tablet_manager.cc:1434] T 541201ddfdf041ed87b3d0e731763a37 P 31d7630573c8475a9f84978d4ebfb879: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260807 13:55:09.121973 7213 tablet_copy_service.cc:342] P b77f2b2eade540c6bfd4f75e5229a3cd: Request end of tablet copy session 31d7630573c8475a9f84978d4ebfb879-541201ddfdf041ed87b3d0e731763a37 received from {username='slave'} at 127.23.107.136:41183
I20260807 13:55:09.122138 7213 tablet_copy_service.cc:434] P b77f2b2eade540c6bfd4f75e5229a3cd: ending tablet copy session 31d7630573c8475a9f84978d4ebfb879-541201ddfdf041ed87b3d0e731763a37 on tablet 541201ddfdf041ed87b3d0e731763a37 with peer 31d7630573c8475a9f84978d4ebfb879
I20260807 13:55:09.134653 4688 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:55:09.142609 27534 tablet_bootstrap.cc:492] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:55:09.143078 27534 tablet_bootstrap.cc:492] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4: Bootstrap complete.
I20260807 13:55:09.143371 27534 ts_tablet_manager.cc:1403] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4: Time spent bootstrapping tablet: real 0.404s user 0.060s sys 0.019s
I20260807 13:55:09.144127 27534 raft_consensus.cc:359] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:55:09.147285 27534 raft_consensus.cc:740] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a9903f009ff46b4a6875490823076c4, State: Initialized, Role: FOLLOWER
I20260807 13:55:09.147588 27534 consensus_queue.cc:260] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:55:09.148231 27534 ts_tablet_manager.cc:1434] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260807 13:55:09.149473 5101 tablet_copy_service.cc:342] P 01adf83af3e04875b5fac9470d4da915: Request end of tablet copy session 8a9903f009ff46b4a6875490823076c4-d27ce55f2acc4513a9fd90a338098eeb received from {username='slave'} at 127.23.107.135:53271
I20260807 13:55:09.149605 5101 tablet_copy_service.cc:434] P 01adf83af3e04875b5fac9470d4da915: ending tablet copy session 8a9903f009ff46b4a6875490823076c4-d27ce55f2acc4513a9fd90a338098eeb on tablet d27ce55f2acc4513a9fd90a338098eeb with peer 8a9903f009ff46b4a6875490823076c4
I20260807 13:55:09.174889 27534 ts_tablet_manager.cc:933] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:55:09.260842 27534 tablet_copy_client.cc:323] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:55:09.262919 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet e93615e4fb61416d8740ce61970610af from peer 8a9903f009ff46b4a6875490823076c4 ({username='slave'} at 127.23.107.135:38881)
I20260807 13:55:09.263091 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet e93615e4fb61416d8740ce61970610af from peer 8a9903f009ff46b4a6875490823076c4 at {username='slave'} at 127.23.107.135:38881: session id = 8a9903f009ff46b4a6875490823076c4-e93615e4fb61416d8740ce61970610af
I20260807 13:55:09.267107 5272 tablet_copy_source_session.cc:215] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:55:09.268532 27534 ts_tablet_manager.cc:1916] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:55:09.276414 27534 ts_tablet_manager.cc:1929] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.6
I20260807 13:55:09.280468 27534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93615e4fb61416d8740ce61970610af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:55:09.290867 27534 tablet_copy_client.cc:806] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 0 data blocks...
I20260807 13:55:09.291514 27534 tablet_copy_client.cc:670] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4: tablet copy: Starting download of 1 WAL segments...
I20260807 13:55:09.295446 27534 tablet_copy_client.cc:538] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:55:09.302641 7688 raft_consensus.cc:1217] T 541201ddfdf041ed87b3d0e731763a37 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 2.12->[2.13-2.13] Dedup: 2.13->[]
I20260807 13:55:09.302791 27534 tablet_bootstrap.cc:492] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4: Bootstrap starting.
I20260807 13:55:09.385824 27534 tablet_bootstrap.cc:492] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:55:09.386458 27534 tablet_bootstrap.cc:492] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4: Bootstrap complete.
I20260807 13:55:09.386885 27534 ts_tablet_manager.cc:1403] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4: Time spent bootstrapping tablet: real 0.084s user 0.057s sys 0.018s
I20260807 13:55:09.388024 27534 raft_consensus.cc:359] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:55:09.389760 27534 raft_consensus.cc:740] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a9903f009ff46b4a6875490823076c4, State: Initialized, Role: FOLLOWER
I20260807 13:55:09.390087 27534 consensus_queue.cc:260] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:55:09.390760 27534 ts_tablet_manager.cc:1434] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260807 13:55:09.392396 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session 8a9903f009ff46b4a6875490823076c4-e93615e4fb61416d8740ce61970610af received from {username='slave'} at 127.23.107.135:38881
I20260807 13:55:09.392539 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session 8a9903f009ff46b4a6875490823076c4-e93615e4fb61416d8740ce61970610af on tablet e93615e4fb61416d8740ce61970610af with peer 8a9903f009ff46b4a6875490823076c4
I20260807 13:55:09.553282 7522 raft_consensus.cc:1217] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.11->[1.12-1.12] Dedup: 1.12->[]
I20260807 13:55:09.587216 7522 raft_consensus.cc:1217] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20260807 13:55:09.787889 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:09.821919 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:09.822836 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:09.857162 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:09.878294 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
W20260807 13:55:09.890415 7102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.134:35975, user_credentials={real_user=slave}} blocked reactor thread for 55398us
I20260807 13:55:09.908964 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:09.915235 5214 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:09.925366 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:09.980407 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:09.993822 7688 consensus_queue.cc:237] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 2.10, Last appended by leader: 7, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:55:10.003595 4865 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:10.008056 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:10.018157 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:10.049433 4688 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:55:10.051397 7522 raft_consensus.cc:1275] T a29bfc37eabb411f845203c281444086 P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Refusing update from remote peer 31d7630573c8475a9f84978d4ebfb879: Log matching property violated. Preceding OpId in replica: term: 2 index: 10. Preceding OpId from leader: term: 2 index: 11. (index mismatch)
I20260807 13:55:10.066972 4865 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
W20260807 13:55:10.073470 7612 consensus_peers.cc:597] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:55:10.073853 23021 consensus_queue.cc:1048] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260807 13:55:10.083897 5214 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:10.126022 4688 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:55:10.164614 7179 raft_consensus.cc:1275] T a29bfc37eabb411f845203c281444086 P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Refusing update from remote peer 31d7630573c8475a9f84978d4ebfb879: Log matching property violated. Preceding OpId in replica: term: 2 index: 10. Preceding OpId from leader: term: 2 index: 11. (index mismatch)
I20260807 13:55:10.165436 23021 consensus_queue.cc:1048] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 13:55:10.186689 27792 raft_consensus.cc:2955] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 [term 2 LEADER]: Committing config change with OpId 2.11: config changed from index 10 to 11, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:55:10.187901 7178 raft_consensus.cc:2955] T a29bfc37eabb411f845203c281444086 P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Committing config change with OpId 2.11: config changed from index 10 to 11, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:55:10.194711 4514 catalog_manager.cc:5697] T a29bfc37eabb411f845203c281444086 P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: config changed from index 10 to 11, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New cstate: current_term: 2 leader_uuid: "31d7630573c8475a9f84978d4ebfb879" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:55:10.201761 7522 raft_consensus.cc:2955] T a29bfc37eabb411f845203c281444086 P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Committing config change with OpId 2.11: config changed from index 10 to 11, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:55:10.347846 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:10.380084 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:10.461834 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:10.467417 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:10.490477 5306 maintenance_manager.cc:419] P edf940ebcc1140cfa0c23214e0c0f179: Scheduling FlushMRSOp(e22d4edb78d24783bae07928b6c95fc2): perf score=0.033335
I20260807 13:55:10.494679 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:10.508677 4779 maintenance_manager.cc:419] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Scheduling FlushMRSOp(d06f352d0ff34b45b753a2c20f65574f): perf score=0.033333
I20260807 13:55:10.561507 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:10.598330 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:10.624538 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:10.654305 5129 maintenance_manager.cc:419] P 01adf83af3e04875b5fac9470d4da915: Scheduling FlushMRSOp(16afb6ff06704a8795f1de84ffa81de0): perf score=0.033391
I20260807 13:55:10.672281 27865 ts_tablet_manager.cc:933] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b: Initiating tablet copy from peer 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729)
I20260807 13:55:10.705686 4865 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:10.736954 27865 tablet_copy_client.cc:323] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.136:43729
I20260807 13:55:10.737890 7712 tablet_copy_service.cc:140] P 31d7630573c8475a9f84978d4ebfb879: Received BeginTabletCopySession request for tablet a29bfc37eabb411f845203c281444086 from peer c9d2944272bc447dafce7620ac2dbd4b ({username='slave'} at 127.23.107.130:42829)
I20260807 13:55:10.738065 7712 tablet_copy_service.cc:161] P 31d7630573c8475a9f84978d4ebfb879: Beginning new tablet copy session on tablet a29bfc37eabb411f845203c281444086 from peer c9d2944272bc447dafce7620ac2dbd4b at {username='slave'} at 127.23.107.130:42829: session id = c9d2944272bc447dafce7620ac2dbd4b-a29bfc37eabb411f845203c281444086
I20260807 13:55:10.742228 7712 tablet_copy_source_session.cc:215] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:55:10.752441 27865 ts_tablet_manager.cc:1916] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:55:10.753129 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:10.760371 4865 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:10.775676 5214 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:10.799150 5214 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:10.830899 4688 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:55:10.858784 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:10.873734 27865 ts_tablet_manager.cc:1929] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 2.8
I20260807 13:55:10.880770 4688 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:55:10.884012 7354 consensus_queue.cc:237] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 2.16, Last appended by leader: 12, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:55:10.923941 4715 raft_consensus.cc:1275] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 16. Preceding OpId from leader: term: 2 index: 17. (index mismatch)
I20260807 13:55:10.924857 26754 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260807 13:55:10.933912 7274 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:55:10.935252 4892 raft_consensus.cc:1275] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 16. Preceding OpId from leader: term: 2 index: 17. (index mismatch)
I20260807 13:55:10.954136 26754 consensus_queue.cc:1048] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260807 13:55:10.979435 27865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a29bfc37eabb411f845203c281444086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:55:11.007783 27910 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 LEADER]: Committing config change with OpId 2.17: config changed from index 16 to 17, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:55:11.009651 4892 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Committing config change with OpId 2.17: config changed from index 16 to 17, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:55:11.018603 4511 catalog_manager.cc:5697] T 96bc42d66fa04fb69afa630969dbb579 P c9d2944272bc447dafce7620ac2dbd4b reported cstate change: config changed from index 16 to 17, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New cstate: current_term: 2 leader_uuid: "12ab71778f2f4b378765aaed1a0676a5" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:55:11.056077 5248 consensus_queue.cc:237] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:55:11.071377 7522 raft_consensus.cc:1275] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:55:11.072199 27861 consensus_queue.cc:1048] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:55:11.079578 4892 raft_consensus.cc:1275] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 13:55:11.080726 27861 consensus_queue.cc:1048] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:55:11.092813 27576 raft_consensus.cc:2955] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:55:11.098728 7522 raft_consensus.cc:2955] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:55:11.110934 4897 raft_consensus.cc:2955] T e93615e4fb61416d8740ce61970610af P c9d2944272bc447dafce7620ac2dbd4b [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:55:11.125438 27865 tablet_copy_client.cc:806] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Starting download of 0 data blocks...
I20260807 13:55:11.125805 27865 tablet_copy_client.cc:670] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Starting download of 1 WAL segments...
I20260807 13:55:11.128113 27865 tablet_copy_client.cc:538] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:55:11.166453 4715 raft_consensus.cc:2955] T 96bc42d66fa04fb69afa630969dbb579 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Committing config change with OpId 2.17: config changed from index 16 to 17, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:55:11.194707 4510 catalog_manager.cc:5697] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 reported cstate change: config changed from index 8 to 9, VOTER b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133) evicted. New cstate: current_term: 1 leader_uuid: "edf940ebcc1140cfa0c23214e0c0f179" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:55:11.209259 7158 tablet_service.cc:1558] Processing DeleteTablet for tablet e93615e4fb61416d8740ce61970610af with delete_type TABLET_DATA_TOMBSTONED (TS b77f2b2eade540c6bfd4f75e5229a3cd not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:33148
I20260807 13:55:11.238312 27939 tablet_replica.cc:333] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: stopping tablet replica
I20260807 13:55:11.238686 27939 raft_consensus.cc:2243] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:55:11.240654 27939 raft_consensus.cc:2272] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:55:11.245738 27865 tablet_bootstrap.cc:492] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap starting.
I20260807 13:55:11.248591 27939 ts_tablet_manager.cc:1916] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:55:11.291843 27939 ts_tablet_manager.cc:1929] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260807 13:55:11.299383 27939 log.cc:1199] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/wal/wals/e93615e4fb61416d8740ce61970610af
I20260807 13:55:11.301024 4505 catalog_manager.cc:5028] TS b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): tablet e93615e4fb61416d8740ce61970610af (table rebalance_test_table_9 [id=96e83925faa542ffa4808b01a5adbbb3]) successfully deleted
I20260807 13:55:11.379200 4983 maintenance_manager.cc:643] P 01adf83af3e04875b5fac9470d4da915: FlushMRSOp(16afb6ff06704a8795f1de84ffa81de0) complete. Timing: real 0.722s user 0.086s sys 0.061s Metrics: {"bytes_written":6062,"cfile_init":1,"compiler_manager_pool.queue_time_us":17051,"dirs.queue_time_us":6636,"dirs.run_cpu_time_us":253,"dirs.run_wall_time_us":7180,"drs_written":1,"lbm_read_time_us":136,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1245,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":635,"thread_start_us":31530,"threads_started":3,"wal-append.queue_time_us":7225}
I20260807 13:55:11.381801 5129 maintenance_manager.cc:419] P 01adf83af3e04875b5fac9470d4da915: Scheduling UndoDeltaBlockGCOp(16afb6ff06704a8795f1de84ffa81de0): 4583 bytes on disk
I20260807 13:55:11.387584 4983 maintenance_manager.cc:643] P 01adf83af3e04875b5fac9470d4da915: UndoDeltaBlockGCOp(16afb6ff06704a8795f1de84ffa81de0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":246,"lbm_reads_lt_1ms":4}
I20260807 13:55:11.402202 27958 ts_tablet_manager.cc:933] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: Initiating tablet copy from peer 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975)
I20260807 13:55:11.409575 27958 tablet_copy_client.cc:323] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.134:35975
I20260807 13:55:11.410753 7386 tablet_copy_service.cc:140] P 12ab71778f2f4b378765aaed1a0676a5: Received BeginTabletCopySession request for tablet 96bc42d66fa04fb69afa630969dbb579 from peer edf940ebcc1140cfa0c23214e0c0f179 ({username='slave'} at 127.23.107.132:37747)
I20260807 13:55:11.410915 7386 tablet_copy_service.cc:161] P 12ab71778f2f4b378765aaed1a0676a5: Beginning new tablet copy session on tablet 96bc42d66fa04fb69afa630969dbb579 from peer edf940ebcc1140cfa0c23214e0c0f179 at {username='slave'} at 127.23.107.132:37747: session id = edf940ebcc1140cfa0c23214e0c0f179-96bc42d66fa04fb69afa630969dbb579
I20260807 13:55:11.410851 4634 maintenance_manager.cc:643] P fa83b7af134b4e3b949ac3b4e4bcb5e7: FlushMRSOp(d06f352d0ff34b45b753a2c20f65574f) complete. Timing: real 0.901s user 0.114s sys 0.034s Metrics: {"bytes_written":6144,"cfile_init":1,"compiler_manager_pool.queue_time_us":11951,"dirs.queue_time_us":10903,"dirs.run_cpu_time_us":264,"dirs.run_wall_time_us":1013,"drs_written":1,"lbm_read_time_us":161,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1348,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":84008,"threads_started":3,"wal-append.queue_time_us":25959}
I20260807 13:55:11.413363 4779 maintenance_manager.cc:419] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Scheduling UndoDeltaBlockGCOp(d06f352d0ff34b45b753a2c20f65574f): 4924 bytes on disk
I20260807 13:55:11.414161 7386 tablet_copy_source_session.cc:215] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:55:11.417805 27958 ts_tablet_manager.cc:1916] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:55:11.418008 4634 maintenance_manager.cc:643] P fa83b7af134b4e3b949ac3b4e4bcb5e7: UndoDeltaBlockGCOp(d06f352d0ff34b45b753a2c20f65574f) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":98,"lbm_reads_lt_1ms":4}
I20260807 13:55:11.426323 5155 maintenance_manager.cc:643] P edf940ebcc1140cfa0c23214e0c0f179: FlushMRSOp(e22d4edb78d24783bae07928b6c95fc2) complete. Timing: real 0.935s user 0.145s sys 0.123s Metrics: {"bytes_written":6152,"cfile_init":1,"compiler_manager_pool.queue_time_us":67353,"dirs.queue_time_us":146219,"dirs.run_cpu_time_us":364,"dirs.run_wall_time_us":3763,"drs_written":1,"lbm_read_time_us":128,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1204,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":247234,"threads_started":3,"wal-append.queue_time_us":29547}
I20260807 13:55:11.442077 5306 maintenance_manager.cc:419] P edf940ebcc1140cfa0c23214e0c0f179: Scheduling UndoDeltaBlockGCOp(e22d4edb78d24783bae07928b6c95fc2): 4840 bytes on disk
I20260807 13:55:11.443147 5155 maintenance_manager.cc:643] P edf940ebcc1140cfa0c23214e0c0f179: UndoDeltaBlockGCOp(e22d4edb78d24783bae07928b6c95fc2) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":110,"lbm_reads_lt_1ms":4}
I20260807 13:55:11.465898 27958 ts_tablet_manager.cc:1929] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 2.14
I20260807 13:55:11.466329 27958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96bc42d66fa04fb69afa630969dbb579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:55:11.490965 27958 tablet_copy_client.cc:806] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Starting download of 0 data blocks...
I20260807 13:55:11.491355 27958 tablet_copy_client.cc:670] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Starting download of 1 WAL segments...
I20260807 13:55:11.493268 27958 tablet_copy_client.cc:538] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:55:11.497324 27958 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap starting.
I20260807 13:55:11.592717 27865 tablet_bootstrap.cc:492] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260807 13:55:11.602888 4805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.133:38075, user_credentials={real_user=slave}} blocked reactor thread for 44439.4us
I20260807 13:55:11.604838 27865 tablet_bootstrap.cc:492] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b: Bootstrap complete.
I20260807 13:55:11.605293 27865 ts_tablet_manager.cc:1403] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b: Time spent bootstrapping tablet: real 0.360s user 0.059s sys 0.001s
I20260807 13:55:11.607012 27865 raft_consensus.cc:359] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:55:11.608946 27865 raft_consensus.cc:740] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2944272bc447dafce7620ac2dbd4b, State: Initialized, Role: FOLLOWER
I20260807 13:55:11.610347 27865 consensus_queue.cc:260] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 2.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:55:11.617216 27865 ts_tablet_manager.cc:1434] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260807 13:55:11.626420 7712 tablet_copy_service.cc:342] P 31d7630573c8475a9f84978d4ebfb879: Request end of tablet copy session c9d2944272bc447dafce7620ac2dbd4b-a29bfc37eabb411f845203c281444086 received from {username='slave'} at 127.23.107.130:42829
I20260807 13:55:11.626648 7712 tablet_copy_service.cc:434] P 31d7630573c8475a9f84978d4ebfb879: ending tablet copy session c9d2944272bc447dafce7620ac2dbd4b-a29bfc37eabb411f845203c281444086 on tablet a29bfc37eabb411f845203c281444086 with peer c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:55:11.643054 7179 consensus_queue.cc:237] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 2.12, Last appended by leader: 10, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:55:11.660151 5074 raft_consensus.cc:1275] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 12. Preceding OpId from leader: term: 2 index: 13. (index mismatch)
W20260807 13:55:11.661892 7101 consensus_peers.cc:597] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:55:11.662238 27950 consensus_queue.cc:1048] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260807 13:55:11.664299 5248 raft_consensus.cc:1275] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 12. Preceding OpId from leader: term: 2 index: 13. (index mismatch)
I20260807 13:55:11.665076 27950 consensus_queue.cc:1048] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260807 13:55:11.671890 4779 maintenance_manager.cc:419] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Scheduling FlushMRSOp(68717842b14e4f06b528c08a65acd3b7): perf score=0.033339
I20260807 13:55:11.695623 5306 maintenance_manager.cc:419] P edf940ebcc1140cfa0c23214e0c0f179: Scheduling FlushMRSOp(80898a5a2cf046f1b7344dfceb175bbd): perf score=0.033341
I20260807 13:55:11.726464 27950 raft_consensus.cc:2955] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 LEADER]: Committing config change with OpId 2.13: config changed from index 12 to 13, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:55:11.730171 5068 raft_consensus.cc:2955] T 312c7ed04e334b08b506c8908224a7da P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Committing config change with OpId 2.13: config changed from index 12 to 13, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:55:11.736822 5248 raft_consensus.cc:2955] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Committing config change with OpId 2.13: config changed from index 12 to 13, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:55:11.743369 4510 catalog_manager.cc:5697] T 312c7ed04e334b08b506c8908224a7da P edf940ebcc1140cfa0c23214e0c0f179 reported cstate change: config changed from index 12 to 13, VOTER c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) added. New cstate: current_term: 2 leader_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } }
I20260807 13:55:11.790899 4897 raft_consensus.cc:1217] T a29bfc37eabb411f845203c281444086 P c9d2944272bc447dafce7620ac2dbd4b [term 2 FOLLOWER]: Deduplicated request from leader. Original: 2.10->[2.11-2.11] Dedup: 2.11->[]
I20260807 13:55:11.830140 4955 maintenance_manager.cc:419] P c9d2944272bc447dafce7620ac2dbd4b: Scheduling FlushMRSOp(bdac11c33b2b486eb34bc93def74489c): perf score=0.033374
I20260807 13:55:11.888747 27958 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=0 applied=17 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:55:11.895107 27958 tablet_bootstrap.cc:492] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: Bootstrap complete.
I20260807 13:55:11.895432 27958 ts_tablet_manager.cc:1403] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: Time spent bootstrapping tablet: real 0.398s user 0.068s sys 0.000s
I20260807 13:55:11.896402 27958 raft_consensus.cc:359] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:55:11.896658 27958 raft_consensus.cc:740] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf940ebcc1140cfa0c23214e0c0f179, State: Initialized, Role: FOLLOWER
I20260807 13:55:11.896987 27958 consensus_queue.cc:260] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 17, Last appended: 2.17, Last appended by leader: 17, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:55:11.904918 27958 ts_tablet_manager.cc:1434] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260807 13:55:11.907426 7386 tablet_copy_service.cc:342] P 12ab71778f2f4b378765aaed1a0676a5: Request end of tablet copy session edf940ebcc1140cfa0c23214e0c0f179-96bc42d66fa04fb69afa630969dbb579 received from {username='slave'} at 127.23.107.132:37747
I20260807 13:55:11.907583 7386 tablet_copy_service.cc:434] P 12ab71778f2f4b378765aaed1a0676a5: ending tablet copy session edf940ebcc1140cfa0c23214e0c0f179-96bc42d66fa04fb69afa630969dbb579 on tablet 96bc42d66fa04fb69afa630969dbb579 with peer edf940ebcc1140cfa0c23214e0c0f179
W20260807 13:55:11.925558 4807 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/data (492564480 bytes available vs 518351011 bytes reserved) (error 28)
I20260807 13:55:11.980973 5155 maintenance_manager.cc:643] P edf940ebcc1140cfa0c23214e0c0f179: FlushMRSOp(80898a5a2cf046f1b7344dfceb175bbd) complete. Timing: real 0.285s user 0.029s sys 0.035s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":18106,"dirs.run_cpu_time_us":261,"dirs.run_wall_time_us":12757,"drs_written":1,"lbm_read_time_us":81,"lbm_reads_lt_1ms":4,"lbm_write_time_us":974,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":635,"thread_start_us":75190,"threads_started":2,"wal-append.queue_time_us":57020}
W20260807 13:55:11.983202 4807 tablet_replica_mm_ops.cc:214] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b: failed to flush MRS: IO error: Failed to open DiskRowSet for flush: tablet bdac11c33b2b486eb34bc93def74489c: unable to open output file for column int_val INT32 NOT NULL: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in bdac11c33b2b486eb34bc93def74489c's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
F20260807 13:55:11.983342 4807 tablet_replica_mm_ops.cc:215] Check failed: tablet->HasBeenStopped() Unrecoverable flush failure caused by error: IO error: Failed to open DiskRowSet for flush: tablet bdac11c33b2b486eb34bc93def74489c: unable to open output file for column int_val INT32 NOT NULL: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in bdac11c33b2b486eb34bc93def74489c's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
I20260807 13:55:11.983650 5306 maintenance_manager.cc:419] P edf940ebcc1140cfa0c23214e0c0f179: Scheduling UndoDeltaBlockGCOp(80898a5a2cf046f1b7344dfceb175bbd): 4583 bytes on disk
*** Check failure stack trace: ***
@ 0x7f570af19d5d google::LogMessage::Fail() at ??:0
@ 0x7f570af1db23 google::LogMessage::SendToLog() at ??:0
I20260807 13:55:12.003753 5155 maintenance_manager.cc:643] P edf940ebcc1140cfa0c23214e0c0f179: UndoDeltaBlockGCOp(80898a5a2cf046f1b7344dfceb175bbd) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":161,"lbm_reads_lt_1ms":4}
@ 0x7f570af1975c google::LogMessage::Flush() at ??:0
@ 0x7f570af1aee9 google::LogMessageFatal::~LogMessageFatal() at ??:0
I20260807 13:55:12.062260 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:12.090212 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:12.113227 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:12.174961 4634 maintenance_manager.cc:643] P fa83b7af134b4e3b949ac3b4e4bcb5e7: FlushMRSOp(68717842b14e4f06b528c08a65acd3b7) complete. Timing: real 0.503s user 0.047s sys 0.012s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":20290,"dirs.run_cpu_time_us":285,"dirs.run_wall_time_us":1989,"drs_written":1,"lbm_read_time_us":77,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1013,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":23030,"threads_started":2,"wal-append.queue_time_us":1314}
I20260807 13:55:12.177999 4779 maintenance_manager.cc:419] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Scheduling UndoDeltaBlockGCOp(68717842b14e4f06b528c08a65acd3b7): 4840 bytes on disk
I20260807 13:55:12.187122 28133 ts_tablet_manager.cc:933] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b: Initiating tablet copy from peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075)
I20260807 13:55:12.192605 4634 maintenance_manager.cc:643] P fa83b7af134b4e3b949ac3b4e4bcb5e7: UndoDeltaBlockGCOp(68717842b14e4f06b528c08a65acd3b7) complete. Timing: real 0.014s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":145,"lbm_reads_lt_1ms":4}
I20260807 13:55:12.225948 28133 tablet_copy_client.cc:323] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.133:38075
I20260807 13:55:12.235762 7213 tablet_copy_service.cc:140] P b77f2b2eade540c6bfd4f75e5229a3cd: Received BeginTabletCopySession request for tablet 312c7ed04e334b08b506c8908224a7da from peer c9d2944272bc447dafce7620ac2dbd4b ({username='slave'} at 127.23.107.130:42083)
I20260807 13:55:12.235981 7213 tablet_copy_service.cc:161] P b77f2b2eade540c6bfd4f75e5229a3cd: Beginning new tablet copy session on tablet 312c7ed04e334b08b506c8908224a7da from peer c9d2944272bc447dafce7620ac2dbd4b at {username='slave'} at 127.23.107.130:42083: session id = c9d2944272bc447dafce7620ac2dbd4b-312c7ed04e334b08b506c8908224a7da
I20260807 13:55:12.241024 7213 tablet_copy_source_session.cc:215] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:55:12.249233 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:12.261972 5214 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:12.277294 28133 ts_tablet_manager.cc:1916] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:55:12.332490 4688 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
W20260807 13:55:12.366725 7612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.133:38075, user_credentials={real_user=slave}} blocked reactor thread for 151369us
I20260807 13:55:12.369812 5248 raft_consensus.cc:1217] T 96bc42d66fa04fb69afa630969dbb579 P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 2.16->[2.17-2.17] Dedup: 2.17->[]
@ 0x7f571b0828bd kudu::tablet::FlushMRSOp::Perform() at ??:0
I20260807 13:55:12.402426 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:12.430156 4897 consensus_queue.cc:237] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
@ 0x7f570dcebb09 kudu::MaintenanceManager::LaunchOp() at ??:0
I20260807 13:55:12.524837 28133 ts_tablet_manager.cc:1929] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 2.11
W20260807 13:55:12.525166 28133 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-1/data/data (492331008 bytes available vs 518351011 bytes reserved) (error 28)
@ 0x7f570dceea43 kudu::MaintenanceManager::RunSchedulerThread()::$_3::operator()() at ??:0
W20260807 13:55:12.531968 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: error { code: UNKNOWN_ERROR status { code: IO_ERROR message: "Init tablet metadata failed: Could not create a new directory group for tablet copy: All healthy data directories are full" posix_code: 28 } }
I20260807 13:55:12.532888 7213 tablet_copy_service.cc:342] P b77f2b2eade540c6bfd4f75e5229a3cd: Request end of tablet copy session c9d2944272bc447dafce7620ac2dbd4b-312c7ed04e334b08b506c8908224a7da received from {username='slave'} at 127.23.107.130:42083
I20260807 13:55:12.533033 7213 tablet_copy_service.cc:434] P b77f2b2eade540c6bfd4f75e5229a3cd: ending tablet copy session c9d2944272bc447dafce7620ac2dbd4b-312c7ed04e334b08b506c8908224a7da on tablet 312c7ed04e334b08b506c8908224a7da with peer c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:55:12.536300 28133 ts_tablet_manager.cc:1916] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:55:12.566200 4715 raft_consensus.cc:1275] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:55:12.566849 26802 consensus_queue.cc:1048] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:55:12.581115 4865 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
W20260807 13:55:12.611114 4806 consensus_peers.cc:597] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:55:12.612306 7522 raft_consensus.cc:1275] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer c9d2944272bc447dafce7620ac2dbd4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 13:55:12.612937 26802 consensus_queue.cc:1048] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:55:12.654392 28183 raft_consensus.cc:2955] T bdac11c33b2b486eb34bc93def74489c P c9d2944272bc447dafce7620ac2dbd4b [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:55:12.658378 7522 raft_consensus.cc:2955] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:55:12.665185 4518 catalog_manager.cc:5697] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 reported cstate change: config changed from index 7 to 8, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New cstate: current_term: 1 leader_uuid: "c9d2944272bc447dafce7620ac2dbd4b" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
@ 0x7f570dcee8d9 std::_Function_handler<>::_M_invoke() at ??:0
I20260807 13:55:12.745182 4715 raft_consensus.cc:2955] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:55:12.765172 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:12.792793 28133 ts_tablet_manager.cc:1929] T 312c7ed04e334b08b506c8908224a7da P c9d2944272bc447dafce7620ac2dbd4b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.11
I20260807 13:55:12.794659 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
@ 0xaa68ad std::function<>::operator()() at ??:?
I20260807 13:55:12.865826 4865 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:12.877455 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:12.878253 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:12.895840 5129 maintenance_manager.cc:419] P 01adf83af3e04875b5fac9470d4da915: Scheduling FlushMRSOp(b414c896ad884facb339e5e4a0329065): perf score=0.033345
I20260807 13:55:12.932467 5214 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:12.947359 4779 maintenance_manager.cc:419] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Scheduling FlushMRSOp(782ac4fa94fb4183940fca514cc068b0): perf score=0.033349
@ 0x7f570dc62850 kudu::ThreadPool::DispatchThread() at ??:0
I20260807 13:55:13.010192 5306 maintenance_manager.cc:419] P edf940ebcc1140cfa0c23214e0c0f179: Scheduling FlushMRSOp(1715828a5d96455abecae985d1dca004): perf score=0.033366
I20260807 13:55:13.034796 4688 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:55:13.046936 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:13.117585 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:13.123936 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
@ 0x7f570dc65b4c kudu::ThreadPool::CreateThread()::$_1::operator()() at ??:0
@ 0x7f570dc659c9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa68ad std::function<>::operator()() at ??:?
I20260807 13:55:13.204114 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:13.204666 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:13.210166 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
@ 0x7f570dc41dd9 kudu::Thread::SuperviseThread() at ??:0
I20260807 13:55:13.228654 5214 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:13.246851 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
@ 0x7f57113116db start_thread at ??:0
@ 0x7f5709dc861f clone at ??:0
I20260807 13:55:13.253012 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:13.276240 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:13.284265 4688 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:55:13.301491 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:13.309562 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:13.367733 5214 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:13.491830 4688 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:55:13.743139 4634 maintenance_manager.cc:643] P fa83b7af134b4e3b949ac3b4e4bcb5e7: FlushMRSOp(782ac4fa94fb4183940fca514cc068b0) complete. Timing: real 0.795s user 0.052s sys 0.032s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":4956,"dirs.run_cpu_time_us":211,"dirs.run_wall_time_us":15023,"drs_written":1,"lbm_read_time_us":70,"lbm_reads_lt_1ms":4,"lbm_write_time_us":52126,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":689,"thread_start_us":35189,"threads_started":2,"wal-append.queue_time_us":25907}
I20260807 13:55:13.744619 4779 maintenance_manager.cc:419] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Scheduling UndoDeltaBlockGCOp(782ac4fa94fb4183940fca514cc068b0): 4923 bytes on disk
I20260807 13:55:13.747484 4634 maintenance_manager.cc:643] P fa83b7af134b4e3b949ac3b4e4bcb5e7: UndoDeltaBlockGCOp(782ac4fa94fb4183940fca514cc068b0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":103,"lbm_reads_lt_1ms":4}
I20260807 13:55:13.748243 5155 maintenance_manager.cc:643] P edf940ebcc1140cfa0c23214e0c0f179: FlushMRSOp(1715828a5d96455abecae985d1dca004) complete. Timing: real 0.738s user 0.061s sys 0.022s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":12856,"dirs.run_cpu_time_us":282,"dirs.run_wall_time_us":22036,"drs_written":1,"lbm_read_time_us":84,"lbm_reads_lt_1ms":4,"lbm_write_time_us":931,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":59114,"threads_started":2,"wal-append.queue_time_us":806}
I20260807 13:55:13.750178 5306 maintenance_manager.cc:419] P edf940ebcc1140cfa0c23214e0c0f179: Scheduling UndoDeltaBlockGCOp(1715828a5d96455abecae985d1dca004): 4840 bytes on disk
I20260807 13:55:13.750764 5155 maintenance_manager.cc:643] P edf940ebcc1140cfa0c23214e0c0f179: UndoDeltaBlockGCOp(1715828a5d96455abecae985d1dca004) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":101,"lbm_reads_lt_1ms":4}
I20260807 13:55:13.886891 4983 maintenance_manager.cc:643] P 01adf83af3e04875b5fac9470d4da915: FlushMRSOp(b414c896ad884facb339e5e4a0329065) complete. Timing: real 0.989s user 0.044s sys 0.033s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":48467,"dirs.run_cpu_time_us":323,"dirs.run_wall_time_us":5611,"drs_written":1,"lbm_read_time_us":95,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3384,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":635,"thread_start_us":86611,"threads_started":2,"wal-append.queue_time_us":36527}
I20260807 13:55:13.888330 5129 maintenance_manager.cc:419] P 01adf83af3e04875b5fac9470d4da915: Scheduling UndoDeltaBlockGCOp(b414c896ad884facb339e5e4a0329065): 4583 bytes on disk
I20260807 13:55:13.896072 4983 maintenance_manager.cc:643] P 01adf83af3e04875b5fac9470d4da915: UndoDeltaBlockGCOp(b414c896ad884facb339e5e4a0329065) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":119,"lbm_reads_lt_1ms":4}
I20260807 13:55:14.000213 4779 maintenance_manager.cc:419] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Scheduling FlushMRSOp(0c1327c8461e44f2ac5d77f10c390eeb): perf score=0.033356
I20260807 13:55:14.005193 5306 maintenance_manager.cc:419] P edf940ebcc1140cfa0c23214e0c0f179: Scheduling FlushMRSOp(c10b910e9f354933b60ae70f1baa9b6f): perf score=0.033343
I20260807 13:55:14.013491 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:14.018448 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:14.034696 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:14.057586 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260807 13:55:14.089233 7612 connection.cc:573] client connection to 127.23.107.130:37489 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 13:55:14.089371 7273 connection.cc:573] client connection to 127.23.107.130:37489 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 13:55:14.089555 7612 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 13:55:14.089572 7273 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 13:55:14.091143 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
W20260807 13:55:14.095232 7101 connection.cc:573] client connection to 127.23.107.130:37489 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 13:55:14.095547 7101 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 13:55:14.133595 5214 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:14.148550 5129 maintenance_manager.cc:419] P 01adf83af3e04875b5fac9470d4da915: Scheduling FlushMRSOp(739f4f0207104455bf3e87bc04f8d13c): perf score=0.033382
W20260807 13:55:14.165270 5153 connection.cc:573] client connection to 127.23.107.130:37489 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 13:55:14.165529 5153 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 13:55:14.167160 4688 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
W20260807 13:55:14.206818 4631 connection.cc:573] client connection to 127.23.107.130:37489 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 13:55:14.207031 4631 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 13:55:14.210031 4981 connection.cc:573] client connection to 127.23.107.130:37489 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 13:55:14.210253 4981 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 13:55:14.220188 7101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.23.107.130:37489, user_credentials={real_user=slave}} blocked reactor thread for 124676us
W20260807 13:55:14.228368 28360 negotiation.cc:336] Failed RPC negotiation. Trace:
0807 13:55:14.103128 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.23.107.130:37489 (local address 127.23.107.134:55997)
0807 13:55:14.108490 (+ 5362us) negotiation.cc:107] Waiting for socket to connect
0807 13:55:14.108509 (+ 19us) client_negotiation.cc:175] Beginning negotiation
0807 13:55:14.108653 (+ 144us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0807 13:55:14.227503 (+118850us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":5236,"thread_start_us":9207,"threads_started":1}
W20260807 13:55:14.228701 7273 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:55:14.250547 28379 negotiation.cc:336] Failed RPC negotiation. Trace:
0807 13:55:14.210175 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.23.107.130:37489 (local address 127.23.107.129:60663)
0807 13:55:14.249832 (+ 39657us) negotiation.cc:107] Waiting for socket to connect
0807 13:55:14.249971 (+ 139us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":39531,"threads_started":1}
W20260807 13:55:14.252964 5153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.130:37489, user_credentials={real_user=slave}} blocked reactor thread for 87450.9us
W20260807 13:55:14.255515 28362 negotiation.cc:336] Failed RPC negotiation. Trace:
0807 13:55:14.117221 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.23.107.130:37489 (local address 127.23.107.136:50931)
0807 13:55:14.254450 (+137229us) negotiation.cc:107] Waiting for socket to connect
0807 13:55:14.254592 (+ 142us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":137090,"threads_started":1}
W20260807 13:55:14.263295 4631 consensus_peers.cc:597] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection reset by peer (error 104). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:55:14.263561 4631 consensus_peers.cc:597] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection reset by peer (error 104). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:55:14.264493 5153 consensus_peers.cc:597] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:55:14.255484 4634 maintenance_manager.cc:643] P fa83b7af134b4e3b949ac3b4e4bcb5e7: FlushMRSOp(0c1327c8461e44f2ac5d77f10c390eeb) complete. Timing: real 0.255s user 0.080s sys 0.006s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":9341,"dirs.run_cpu_time_us":231,"dirs.run_wall_time_us":11487,"drs_written":1,"lbm_read_time_us":86,"lbm_reads_lt_1ms":4,"lbm_write_time_us":944,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":26312,"threads_started":2,"wal-append.queue_time_us":16701}
W20260807 13:55:14.264753 5153 consensus_peers.cc:597] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:55:14.266367 4779 maintenance_manager.cc:419] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Scheduling UndoDeltaBlockGCOp(0c1327c8461e44f2ac5d77f10c390eeb): 4921 bytes on disk
I20260807 13:55:14.267179 4634 maintenance_manager.cc:643] P fa83b7af134b4e3b949ac3b4e4bcb5e7: UndoDeltaBlockGCOp(0c1327c8461e44f2ac5d77f10c390eeb) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":131,"lbm_reads_lt_1ms":4}
W20260807 13:55:14.275789 7612 consensus_peers.cc:597] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection reset by peer (error 104). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:55:14.280779 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:14.364765 4981 consensus_peers.cc:597] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:55:14.364944 4981 consensus_peers.cc:597] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:55:14.412904 27950 raft_consensus.cc:493] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9d2944272bc447dafce7620ac2dbd4b)
I20260807 13:55:14.413111 27950 raft_consensus.cc:515] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:55:14.413947 27950 leader_election.cc:290] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:55:14.415601 4715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02aa7a26c024b4083421b5d742f7bcb" candidate_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" is_pre_election: true
W20260807 13:55:14.418270 7101 leader_election.cc:336] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:14.418417 7101 leader_election.cc:304] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b77f2b2eade540c6bfd4f75e5229a3cd; no voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:14.419031 27950 raft_consensus.cc:2749] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:14.431764 5155 maintenance_manager.cc:643] P edf940ebcc1140cfa0c23214e0c0f179: FlushMRSOp(c10b910e9f354933b60ae70f1baa9b6f) complete. Timing: real 0.425s user 0.045s sys 0.021s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":7388,"dirs.run_cpu_time_us":256,"dirs.run_wall_time_us":7826,"drs_written":1,"lbm_read_time_us":75,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1997,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":48319,"threads_started":2,"wal-append.queue_time_us":38987}
I20260807 13:55:14.435657 5306 maintenance_manager.cc:419] P edf940ebcc1140cfa0c23214e0c0f179: Scheduling UndoDeltaBlockGCOp(c10b910e9f354933b60ae70f1baa9b6f): 4840 bytes on disk
I20260807 13:55:14.440083 5155 maintenance_manager.cc:643] P edf940ebcc1140cfa0c23214e0c0f179: UndoDeltaBlockGCOp(c10b910e9f354933b60ae70f1baa9b6f) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":102,"lbm_reads_lt_1ms":4}
I20260807 13:55:14.501922 7179 consensus_queue.cc:237] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 2.13, Last appended by leader: 8, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:55:14.506414 7690 raft_consensus.cc:1275] T 541201ddfdf041ed87b3d0e731763a37 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 13. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260807 13:55:14.507261 7353 raft_consensus.cc:1275] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 13. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260807 13:55:14.508122 28409 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260807 13:55:14.508638 28409 consensus_queue.cc:1048] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260807 13:55:14.544013 27950 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 LEADER]: Committing config change with OpId 2.14: config changed from index 13 to 14, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:55:14.548087 7688 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Committing config change with OpId 2.14: config changed from index 13 to 14, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:55:14.551218 27277 raft_consensus.cc:493] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9d2944272bc447dafce7620ac2dbd4b)
I20260807 13:55:14.551441 27277 raft_consensus.cc:515] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:55:14.552752 27277 leader_election.cc:290] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
W20260807 13:55:14.557319 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:14.559449 4511 catalog_manager.cc:5697] T 541201ddfdf041ed87b3d0e731763a37 P 31d7630573c8475a9f84978d4ebfb879 reported cstate change: config changed from index 13 to 14, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New cstate: current_term: 2 leader_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:55:14.566344 28301 raft_consensus.cc:493] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9d2944272bc447dafce7620ac2dbd4b)
I20260807 13:55:14.566570 28301 raft_consensus.cc:515] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:55:14.567492 28301 leader_election.cc:290] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075)
I20260807 13:55:14.568619 7354 raft_consensus.cc:2955] T 541201ddfdf041ed87b3d0e731763a37 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Committing config change with OpId 2.14: config changed from index 13 to 14, VOTER 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
I20260807 13:55:14.568879 7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02aa7a26c024b4083421b5d742f7bcb" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" is_pre_election: true
I20260807 13:55:14.569135 7179 raft_consensus.cc:2468] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 1.
I20260807 13:55:14.569823 4631 leader_election.cc:304] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b77f2b2eade540c6bfd4f75e5229a3cd, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
W20260807 13:55:14.570654 4631 leader_election.cc:336] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:14.571038 28301 raft_consensus.cc:2804] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:55:14.571113 28301 raft_consensus.cc:493] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c9d2944272bc447dafce7620ac2dbd4b)
I20260807 13:55:14.571189 28301 raft_consensus.cc:3060] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:14.574755 28301 raft_consensus.cc:515] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:55:14.577330 7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02aa7a26c024b4083421b5d742f7bcb" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd"
I20260807 13:55:14.577577 7179 raft_consensus.cc:3060] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:14.577775 4983 maintenance_manager.cc:643] P 01adf83af3e04875b5fac9470d4da915: FlushMRSOp(739f4f0207104455bf3e87bc04f8d13c) complete. Timing: real 0.429s user 0.065s sys 0.009s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":22962,"dirs.run_cpu_time_us":216,"dirs.run_wall_time_us":2556,"drs_written":1,"lbm_read_time_us":72,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3412,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":635,"thread_start_us":81554,"threads_started":2,"wal-append.queue_time_us":47427}
I20260807 13:55:14.579394 5129 maintenance_manager.cc:419] P 01adf83af3e04875b5fac9470d4da915: Scheduling UndoDeltaBlockGCOp(739f4f0207104455bf3e87bc04f8d13c): 4583 bytes on disk
I20260807 13:55:14.580052 27277 raft_consensus.cc:493] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9d2944272bc447dafce7620ac2dbd4b)
I20260807 13:55:14.580224 27277 raft_consensus.cc:515] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:55:14.580827 7179 raft_consensus.cc:2468] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 2.
I20260807 13:55:14.581130 27277 leader_election.cc:290] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
W20260807 13:55:14.581759 4631 leader_election.cc:336] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:14.581804 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdac11c33b2b486eb34bc93def74489c" candidate_uuid: "8a9903f009ff46b4a6875490823076c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179" is_pre_election: true
I20260807 13:55:14.581990 5248 raft_consensus.cc:1803] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: voting while tombstoned based on last-logged opid 1.4
I20260807 13:55:14.582028 4631 leader_election.cc:304] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b77f2b2eade540c6bfd4f75e5229a3cd, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters: c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:55:14.582121 5248 raft_consensus.cc:2468] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a9903f009ff46b4a6875490823076c4 in term 1.
I20260807 13:55:14.582424 28301 leader_election.cc:290] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 2 election: Requested vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075)
I20260807 13:55:14.582602 28301 raft_consensus.cc:2804] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:55:14.582755 28301 raft_consensus.cc:697] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 LEADER]: Becoming Leader. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Running, Role: LEADER
I20260807 13:55:14.583084 28301 consensus_queue.cc:237] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:55:14.583321 4983 maintenance_manager.cc:643] P 01adf83af3e04875b5fac9470d4da915: UndoDeltaBlockGCOp(739f4f0207104455bf3e87bc04f8d13c) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":103,"lbm_reads_lt_1ms":4}
W20260807 13:55:14.589026 7443 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:14.613884 4510 catalog_manager.cc:5697] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: term changed from 1 to 2, leader changed from c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) to fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129). New cstate: current_term: 2 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
W20260807 13:55:14.613497 7443 leader_election.cc:336] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:14.620502 4715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "782ac4fa94fb4183940fca514cc068b0" candidate_uuid: "8a9903f009ff46b4a6875490823076c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" is_pre_election: true
I20260807 13:55:14.620537 4716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdac11c33b2b486eb34bc93def74489c" candidate_uuid: "8a9903f009ff46b4a6875490823076c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" is_pre_election: true
W20260807 13:55:14.621892 7443 leader_election.cc:336] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:14.625638 7444 leader_election.cc:304] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4; no voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:14.626153 7444 leader_election.cc:304] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4, edf940ebcc1140cfa0c23214e0c0f179; no voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:14.626513 27277 raft_consensus.cc:2749] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:14.626706 27277 raft_consensus.cc:2749] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:14.644454 4716 consensus_queue.cc:237] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 1.13, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
W20260807 13:55:14.659504 4632 consensus_peers.cc:597] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 68717842b14e4f06b528c08a65acd3b7. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:55:14.660919 7353 raft_consensus.cc:1275] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
I20260807 13:55:14.661329 7179 raft_consensus.cc:1275] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
I20260807 13:55:14.662118 28460 consensus_queue.cc:1048] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260807 13:55:14.662738 28460 consensus_queue.cc:1048] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260807 13:55:14.665647 5039 tablet_service.cc:1558] Processing DeleteTablet for tablet 541201ddfdf041ed87b3d0e731763a37 with delete_type TABLET_DATA_TOMBSTONED (TS 01adf83af3e04875b5fac9470d4da915 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:36810
I20260807 13:55:14.683880 28460 raft_consensus.cc:493] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9d2944272bc447dafce7620ac2dbd4b)
I20260807 13:55:14.684036 28460 raft_consensus.cc:515] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:55:14.684828 28460 leader_election.cc:290] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:55:14.685706 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdac11c33b2b486eb34bc93def74489c" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179" is_pre_election: true
I20260807 13:55:14.685738 7522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdac11c33b2b486eb34bc93def74489c" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "8a9903f009ff46b4a6875490823076c4" is_pre_election: true
I20260807 13:55:14.685911 5248 raft_consensus.cc:1803] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: voting while tombstoned based on last-logged opid 1.4
I20260807 13:55:14.686015 5248 raft_consensus.cc:1813] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Handling vote request from an unknown peer fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:14.685997 7522 raft_consensus.cc:2468] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 1.
I20260807 13:55:14.686101 5248 raft_consensus.cc:2468] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 1.
I20260807 13:55:14.686573 4632 leader_election.cc:304] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4, edf940ebcc1140cfa0c23214e0c0f179, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:55:14.686911 28460 raft_consensus.cc:2804] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:55:14.686997 28460 raft_consensus.cc:493] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c9d2944272bc447dafce7620ac2dbd4b)
I20260807 13:55:14.687063 28460 raft_consensus.cc:3060] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:14.690461 28460 raft_consensus.cc:515] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
W20260807 13:55:14.690510 4631 leader_election.cc:336] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:14.691596 7522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdac11c33b2b486eb34bc93def74489c" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "8a9903f009ff46b4a6875490823076c4"
I20260807 13:55:14.691803 7522 raft_consensus.cc:3060] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:14.694929 7522 raft_consensus.cc:2468] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 2.
W20260807 13:55:14.695251 4631 leader_election.cc:336] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:14.697724 28460 leader_election.cc:290] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 2 election: Requested vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:55:14.698011 5248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdac11c33b2b486eb34bc93def74489c" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "edf940ebcc1140cfa0c23214e0c0f179"
I20260807 13:55:14.698200 5248 raft_consensus.cc:1803] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: voting while tombstoned based on last-logged opid 1.4
I20260807 13:55:14.698287 5248 raft_consensus.cc:1813] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Handling vote request from an unknown peer fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:14.698345 5248 raft_consensus.cc:3060] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:14.703132 5248 raft_consensus.cc:2468] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 2.
I20260807 13:55:14.704190 4632 leader_election.cc:304] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4, edf940ebcc1140cfa0c23214e0c0f179, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters: c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:55:14.706236 28460 raft_consensus.cc:2804] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:55:14.706394 28460 raft_consensus.cc:697] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 LEADER]: Becoming Leader. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Running, Role: LEADER
I20260807 13:55:14.706737 28460 consensus_queue.cc:237] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:55:14.734666 28301 raft_consensus.cc:493] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9d2944272bc447dafce7620ac2dbd4b)
I20260807 13:55:14.734866 28301 raft_consensus.cc:515] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:55:14.735610 28301 leader_election.cc:290] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385)
W20260807 13:55:14.737792 4631 leader_election.cc:336] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:14.739923 7522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "782ac4fa94fb4183940fca514cc068b0" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "8a9903f009ff46b4a6875490823076c4" is_pre_election: true
I20260807 13:55:14.740166 7522 raft_consensus.cc:2468] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 1.
I20260807 13:55:14.740687 4632 leader_election.cc:304] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters: c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:55:14.740885 4510 catalog_manager.cc:5697] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: term changed from 1 to 2, leader changed from c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) to fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129). New cstate: current_term: 2 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:55:14.743463 28301 raft_consensus.cc:2804] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:55:14.743563 28301 raft_consensus.cc:493] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c9d2944272bc447dafce7620ac2dbd4b)
I20260807 13:55:14.743633 28301 raft_consensus.cc:3060] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:14.747059 28301 raft_consensus.cc:515] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:55:14.747836 28301 leader_election.cc:290] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 2 election: Requested vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385)
I20260807 13:55:14.748539 7522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "782ac4fa94fb4183940fca514cc068b0" candidate_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "8a9903f009ff46b4a6875490823076c4"
I20260807 13:55:14.748787 7522 raft_consensus.cc:3060] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:14.752858 7522 raft_consensus.cc:2468] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa83b7af134b4e3b949ac3b4e4bcb5e7 in term 2.
I20260807 13:55:14.753507 4632 leader_election.cc:304] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4, fa83b7af134b4e3b949ac3b4e4bcb5e7; no voters:
I20260807 13:55:14.754037 28301 raft_consensus.cc:2804] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:55:14.754243 28301 raft_consensus.cc:697] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 2 LEADER]: Becoming Leader. State: Replica: fa83b7af134b4e3b949ac3b4e4bcb5e7, State: Running, Role: LEADER
I20260807 13:55:14.754567 28301 consensus_queue.cc:237] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
W20260807 13:55:14.755792 4631 leader_election.cc:336] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:14.757843 28485 tablet_replica.cc:333] T 541201ddfdf041ed87b3d0e731763a37 P 01adf83af3e04875b5fac9470d4da915: stopping tablet replica
I20260807 13:55:14.758302 28485 raft_consensus.cc:2243] T 541201ddfdf041ed87b3d0e731763a37 P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:55:14.758692 28485 raft_consensus.cc:2272] T 541201ddfdf041ed87b3d0e731763a37 P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:55:14.765388 28485 ts_tablet_manager.cc:1916] T 541201ddfdf041ed87b3d0e731763a37 P 01adf83af3e04875b5fac9470d4da915: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:55:14.785171 28301 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [term 1 LEADER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:55:14.787457 4510 catalog_manager.cc:5697] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 reported cstate change: term changed from 1 to 2, leader changed from c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130) to fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129). New cstate: current_term: 2 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:55:14.805718 28485 ts_tablet_manager.cc:1929] T 541201ddfdf041ed87b3d0e731763a37 P 01adf83af3e04875b5fac9470d4da915: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.13
I20260807 13:55:14.805974 28485 log.cc:1199] T 541201ddfdf041ed87b3d0e731763a37 P 01adf83af3e04875b5fac9470d4da915: Deleting WAL directory at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/wal/wals/541201ddfdf041ed87b3d0e731763a37
I20260807 13:55:14.807026 4504 catalog_manager.cc:5028] TS 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): tablet 541201ddfdf041ed87b3d0e731763a37 (table rebalance_test_table_4 [id=e242e42da20d4458a49a269a9569307a]) successfully deleted
I20260807 13:55:14.823557 7353 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:55:14.830909 4510 catalog_manager.cc:5697] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: config changed from index 13 to 14, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New cstate: current_term: 1 leader_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
I20260807 13:55:14.832803 7179 raft_consensus.cc:2955] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } }
W20260807 13:55:14.984620 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:15.007841 4631 consensus_peers.cc:597] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:55:15.111828 5248 consensus_queue.cc:237] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:55:15.123183 7522 raft_consensus.cc:1275] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Refusing update from remote peer edf940ebcc1140cfa0c23214e0c0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260807 13:55:15.124053 28275 consensus_queue.cc:1048] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260807 13:55:15.125795 5153 consensus_peers.cc:597] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 -> Peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): Couldn't send request to peer b77f2b2eade540c6bfd4f75e5229a3cd. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260807 13:55:15.127122 5153 consensus_peers.cc:597] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:55:15.146921 7179 raft_consensus.cc:1275] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20260807 13:55:15.148000 28460 consensus_queue.cc:1048] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260807 13:55:15.169757 4631 consensus_peers.cc:597] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:55:15.177380 4632 consensus_peers.cc:597] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:55:15.187958 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:15.208611 7522 raft_consensus.cc:1275] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260807 13:55:15.209518 28460 consensus_queue.cc:1048] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:55:15.235100 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:15.241142 28606 ts_tablet_manager.cc:933] T 68717842b14e4f06b528c08a65acd3b7 P edf940ebcc1140cfa0c23214e0c0f179: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:55:15.251892 28606 tablet_copy_client.cc:323] T 68717842b14e4f06b528c08a65acd3b7 P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:55:15.252714 4746 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet 68717842b14e4f06b528c08a65acd3b7 from peer edf940ebcc1140cfa0c23214e0c0f179 ({username='slave'} at 127.23.107.132:57653)
I20260807 13:55:15.252892 4746 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet 68717842b14e4f06b528c08a65acd3b7 from peer edf940ebcc1140cfa0c23214e0c0f179 at {username='slave'} at 127.23.107.132:57653: session id = edf940ebcc1140cfa0c23214e0c0f179-68717842b14e4f06b528c08a65acd3b7
I20260807 13:55:15.256986 4746 tablet_copy_source_session.cc:215] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 5 blocks and 1 log segments
W20260807 13:55:15.267976 28606 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data (499769344 bytes available vs 518351011 bytes reserved) (error 28)
W20260807 13:55:15.269820 4632 consensus_peers.cc:576] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Unable to start Tablet Copy on peer: error { code: UNKNOWN_ERROR status { code: IO_ERROR message: "Init tablet metadata failed: Failed to create TabletMetadata: All healthy data directories are full" posix_code: 28 } }
I20260807 13:55:15.287719 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:15.307086 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:15.331348 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:15.339610 5129 maintenance_manager.cc:419] P 01adf83af3e04875b5fac9470d4da915: Scheduling FlushMRSOp(43f5461808a646c885d593f782538930): perf score=0.033354
W20260807 13:55:15.353900 4631 consensus_peers.cc:597] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:55:15.374318 7522 raft_consensus.cc:1275] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Refusing update from remote peer fa83b7af134b4e3b949ac3b4e4bcb5e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260807 13:55:15.376897 28301 consensus_queue.cc:1048] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:55:15.402827 5214 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
W20260807 13:55:15.415905 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:15.434123 4688 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260807 13:55:15.581732 28635 ts_tablet_manager.cc:933] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:55:15.590829 28606 ts_tablet_manager.cc:933] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:55:15.598884 28635 tablet_copy_client.cc:323] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:55:15.600841 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet e93615e4fb61416d8740ce61970610af from peer b77f2b2eade540c6bfd4f75e5229a3cd ({username='slave'} at 127.23.107.133:38087)
I20260807 13:55:15.601042 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet e93615e4fb61416d8740ce61970610af from peer b77f2b2eade540c6bfd4f75e5229a3cd at {username='slave'} at 127.23.107.133:38087: session id = b77f2b2eade540c6bfd4f75e5229a3cd-e93615e4fb61416d8740ce61970610af
I20260807 13:55:15.614864 5272 tablet_copy_source_session.cc:215] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:55:15.658372 28635 ts_tablet_manager.cc:1916] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: Deleting tablet data with delete state TABLET_DATA_COPYING
W20260807 13:55:15.666242 7273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.130:37489, user_credentials={real_user=slave}} blocked reactor thread for 83192.9us
W20260807 13:55:15.712464 7611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.131:40441, user_credentials={real_user=slave}} blocked reactor thread for 101474us
I20260807 13:55:15.713117 28606 tablet_copy_client.cc:323] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:55:15.714093 4746 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet bdac11c33b2b486eb34bc93def74489c from peer edf940ebcc1140cfa0c23214e0c0f179 ({username='slave'} at 127.23.107.132:57653)
I20260807 13:55:15.714287 4746 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet bdac11c33b2b486eb34bc93def74489c from peer edf940ebcc1140cfa0c23214e0c0f179 at {username='slave'} at 127.23.107.132:57653: session id = edf940ebcc1140cfa0c23214e0c0f179-bdac11c33b2b486eb34bc93def74489c
I20260807 13:55:15.718271 4746 tablet_copy_source_session.cc:215] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:55:15.721841 28606 ts_tablet_manager.cc:1916] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:55:15.732720 28661 ts_tablet_manager.cc:933] T 68717842b14e4f06b528c08a65acd3b7 P edf940ebcc1140cfa0c23214e0c0f179: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:55:15.778841 28661 tablet_copy_client.cc:323] T 68717842b14e4f06b528c08a65acd3b7 P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:55:15.779884 4746 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet 68717842b14e4f06b528c08a65acd3b7 from peer edf940ebcc1140cfa0c23214e0c0f179 ({username='slave'} at 127.23.107.132:57653)
I20260807 13:55:15.780053 4746 tablet_copy_service.cc:171] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Re-sending initialization info for existing tablet copy session on tablet 68717842b14e4f06b528c08a65acd3b7 from peer edf940ebcc1140cfa0c23214e0c0f179 at {username='slave'} at 127.23.107.132:57653: session_id = edf940ebcc1140cfa0c23214e0c0f179-68717842b14e4f06b528c08a65acd3b7
W20260807 13:55:15.782051 28661 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data (499572736 bytes available vs 518351011 bytes reserved) (error 28)
W20260807 13:55:15.784117 4632 consensus_peers.cc:576] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Unable to start Tablet Copy on peer: error { code: UNKNOWN_ERROR status { code: IO_ERROR message: "Init tablet metadata failed: Failed to create TabletMetadata: All healthy data directories are full" posix_code: 28 } }
I20260807 13:55:15.787698 28635 ts_tablet_manager.cc:1929] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.8
I20260807 13:55:15.792303 4983 maintenance_manager.cc:643] P 01adf83af3e04875b5fac9470d4da915: FlushMRSOp(43f5461808a646c885d593f782538930) complete. Timing: real 0.452s user 0.115s sys 0.106s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":6665,"dirs.run_cpu_time_us":205,"dirs.run_wall_time_us":13336,"drs_written":1,"lbm_read_time_us":71,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1064,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":164061,"threads_started":2,"wal-append.queue_time_us":157329}
I20260807 13:55:15.792215 7745 rebalancer_tool-test.cc:1258] rebalancer run info: Runtime error: /tmp/dist-test-task2KnpY3/build/asan/bin/kudu: process exited with non-zero status 1
stdout: Per-server replica distribution summary:
Statistic | Value
-----------------------+-----------
Minimum Replica Count | 0
Maximum Replica Count | 23
Average Replica Count | 11.250000
Per-table replica distribution summary:
Replica Skew | Value
--------------+----------
Minimum | 3
Maximum | 3
Average | 3.000000
stderr: W20260807 13:53:25.185122 7751 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:25.185673 7751 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260807 13:53:28.216311 7751 rebalancer_tool.cc:215] running whole-cluster rebalancing
W20260807 13:53:30.250976 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 96e83925faa542ffa4808b01a5adbbb3: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:30.251225 7751 rebalancer_tool.cc:1212] table b6c061acc30c4e5aa6bee1f054e3a59a: no follower replicas available on c9d2944272bc447dafce7620ac2dbd4b, falling back to leader replicas
W20260807 13:53:30.251452 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 14867b014aab43119171102f60bb134d: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:30.251744 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 96e83925faa542ffa4808b01a5adbbb3: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:30.251928 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 91303cf8b9064e06b8c4165942b287f2: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:30.252107 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c2c7db1795a1414c8299bebbeaf60404: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:30.252346 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 35d13981f3a742dd9369d1e7bf18498c: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:30.253059 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 7f1d26639edd4cb398339b2b0d3659a3: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:30.253207 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 14867b014aab43119171102f60bb134d: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:30.253494 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e242e42da20d4458a49a269a9569307a: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:30.253720 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b6c061acc30c4e5aa6bee1f054e3a59a: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:30.253836 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 6008038c907645199b055dacb5772621: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:30.253947 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 2ff801ea568346e096cc895a279c109c: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:30.254189 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c2c7db1795a1414c8299bebbeaf60404: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:30.254317 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 91303cf8b9064e06b8c4165942b287f2: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:30.254458 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 6008038c907645199b055dacb5772621: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:30.254599 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 2ff801ea568346e096cc895a279c109c: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 31d7630573c8475a9f84978d4ebfb879
I20260807 13:53:30.845952 7751 rebalancer_tool.cc:1090] tablet e22d4edb78d24783bae07928b6c95fc2: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '31d7630573c8475a9f84978d4ebfb879' move scheduled
I20260807 13:53:31.376509 7751 rebalancer_tool.cc:1090] tablet 0c1327c8461e44f2ac5d77f10c390eeb: '01adf83af3e04875b5fac9470d4da915' -> '8a9903f009ff46b4a6875490823076c4' move scheduled
I20260807 13:53:32.036399 7751 rebalancer_tool.cc:1090] tablet 966ebd287fc14e498e5bd3e6542194ca: 'edf940ebcc1140cfa0c23214e0c0f179' -> 'b77f2b2eade540c6bfd4f75e5229a3cd' move scheduled
I20260807 13:53:32.679302 7751 rebalancer_tool.cc:1090] tablet d06f352d0ff34b45b753a2c20f65574f: 'c9d2944272bc447dafce7620ac2dbd4b' -> '12ab71778f2f4b378765aaed1a0676a5' move scheduled
I20260807 13:53:33.436609 7751 rebalancer_tool.cc:1090] tablet 43f5461808a646c885d593f782538930: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '31d7630573c8475a9f84978d4ebfb879' move scheduled
I20260807 13:53:33.963363 7751 rebalancer_tool.cc:1090] tablet bdac11c33b2b486eb34bc93def74489c: '01adf83af3e04875b5fac9470d4da915' -> '8a9903f009ff46b4a6875490823076c4' move scheduled
I20260807 13:53:34.553524 7751 rebalancer_tool.cc:1090] tablet 04dac80fea124c25b34af8cc290c0d7f: 'edf940ebcc1140cfa0c23214e0c0f179' -> 'b77f2b2eade540c6bfd4f75e5229a3cd' move scheduled
I20260807 13:53:35.498597 7751 rebalancer_tool.cc:1090] tablet d27ce55f2acc4513a9fd90a338098eeb: 'c9d2944272bc447dafce7620ac2dbd4b' -> '12ab71778f2f4b378765aaed1a0676a5' move scheduled
I20260807 13:53:36.001066 7751 rebalancer_tool.cc:1090] tablet 522c3523f2af4eb29e30fa55da2acd3e: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '31d7630573c8475a9f84978d4ebfb879' move scheduled
I20260807 13:53:36.234511 7751 rebalancer_tool.cc:1100] tablet d02aa7a26c024b4083421b5d742f7bcb: '01adf83af3e04875b5fac9470d4da915' -> 'b77f2b2eade540c6bfd4f75e5229a3cd' move ignored: Illegal state: tablet d02aa7a26c024b4083421b5d742f7bcb: replica b77f2b2eade540c6bfd4f75e5229a3cd is already present
I20260807 13:53:36.234763 7751 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260807 13:53:37.919523 7751 rebalancer_tool.cc:1212] table 96e83925faa542ffa4808b01a5adbbb3: no follower replicas available on 01adf83af3e04875b5fac9470d4da915, falling back to leader replicas
W20260807 13:53:37.919771 7751 rebalancer_tool.cc:1212] table b6c061acc30c4e5aa6bee1f054e3a59a: no follower replicas available on c9d2944272bc447dafce7620ac2dbd4b, falling back to leader replicas
W20260807 13:53:37.919890 7751 rebalancer_tool.cc:1212] table 35d13981f3a742dd9369d1e7bf18498c: no follower replicas available on edf940ebcc1140cfa0c23214e0c0f179, falling back to leader replicas
W20260807 13:53:37.920015 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 35d13981f3a742dd9369d1e7bf18498c: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:37.920188 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 91303cf8b9064e06b8c4165942b287f2: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:37.920388 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 14867b014aab43119171102f60bb134d: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:37.920490 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 96e83925faa542ffa4808b01a5adbbb3: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:37.920611 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 14867b014aab43119171102f60bb134d: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:37.920830 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 6008038c907645199b055dacb5772621: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:37.920928 7751 rebalancer_tool.cc:1212] table 35d13981f3a742dd9369d1e7bf18498c: no follower replicas available on edf940ebcc1140cfa0c23214e0c0f179, falling back to leader replicas
W20260807 13:53:37.921051 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 35d13981f3a742dd9369d1e7bf18498c: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:37.921157 7751 rebalancer_tool.cc:1212] table 2ff801ea568346e096cc895a279c109c: no follower replicas available on 01adf83af3e04875b5fac9470d4da915, falling back to leader replicas
W20260807 13:53:37.921271 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 2ff801ea568346e096cc895a279c109c: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:37.921425 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e242e42da20d4458a49a269a9569307a: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:37.921600 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b6c061acc30c4e5aa6bee1f054e3a59a: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:37.921738 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 91303cf8b9064e06b8c4165942b287f2: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:37.921864 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 7f1d26639edd4cb398339b2b0d3659a3: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:37.922111 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 35d13981f3a742dd9369d1e7bf18498c: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:53:38.010170 7751 rebalancer_tool.cc:1090] tablet d02aa7a26c024b4083421b5d742f7bcb: '01adf83af3e04875b5fac9470d4da915' -> '' move scheduled
I20260807 13:53:38.081872 7751 rebalancer_tool.cc:1090] tablet 80898a5a2cf046f1b7344dfceb175bbd: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:53:38.710538 7751 rebalancer_tool.cc:1100] tablet 50a090faa58e4f91961c9251030efacf: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '8a9903f009ff46b4a6875490823076c4' move ignored: Illegal state: Request specified cas_config_opid_index of -1 but the committed config has opid_index of 4
I20260807 13:53:38.710774 7751 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260807 13:53:40.565680 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 14867b014aab43119171102f60bb134d: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:40.565963 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c2c7db1795a1414c8299bebbeaf60404: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:40.566094 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 14867b014aab43119171102f60bb134d: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:40.566219 7751 rebalancer_tool.cc:1212] table b6c061acc30c4e5aa6bee1f054e3a59a: no follower replicas available on c9d2944272bc447dafce7620ac2dbd4b, falling back to leader replicas
W20260807 13:53:40.566386 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 7f1d26639edd4cb398339b2b0d3659a3: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:40.566527 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 2ff801ea568346e096cc895a279c109c: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:40.566704 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 14867b014aab43119171102f60bb134d: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:40.566829 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e242e42da20d4458a49a269a9569307a: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:40.566932 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c2c7db1795a1414c8299bebbeaf60404: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:40.567059 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 91303cf8b9064e06b8c4165942b287f2: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 31d7630573c8475a9f84978d4ebfb879
I20260807 13:53:40.702925 7751 rebalancer_tool.cc:1090] tablet 782ac4fa94fb4183940fca514cc068b0: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move scheduled
I20260807 13:53:41.501122 7751 rebalancer_tool.cc:1090] tablet 739f4f0207104455bf3e87bc04f8d13c: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '8a9903f009ff46b4a6875490823076c4' move scheduled
I20260807 13:53:41.845537 7751 rebalancer_tool.cc:1090] tablet 069a5f0089b24a609b27d4a07a3c4353: '01adf83af3e04875b5fac9470d4da915' -> '' move scheduled
I20260807 13:53:42.029927 7751 rebalancer_tool.cc:1090] tablet c10b910e9f354933b60ae70f1baa9b6f: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:53:49.646929 7751 rebalancer_tool.cc:1152] tablet d02aa7a26c024b4083421b5d742f7bcb: '01adf83af3e04875b5fac9470d4da915' -> '' move completed: OK
W20260807 13:53:51.469321 12413 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.GetTabletLocations -> {remote=127.23.107.190:41317, user_credentials={real_user=slave}} blocked reactor thread for 53039.4us
I20260807 13:54:00.087028 7751 rebalancer_tool.cc:1152] tablet 966ebd287fc14e498e5bd3e6542194ca: 'edf940ebcc1140cfa0c23214e0c0f179' -> 'b77f2b2eade540c6bfd4f75e5229a3cd' move completed: OK
I20260807 13:54:02.413471 7751 rebalancer_tool.cc:1152] tablet d27ce55f2acc4513a9fd90a338098eeb: 'c9d2944272bc447dafce7620ac2dbd4b' -> '12ab71778f2f4b378765aaed1a0676a5' move completed: OK
W20260807 13:54:08.177917 15438 outbound_call.cc:321] RPC callback for RPC call kudu.server.GenericService.GetStatus -> {remote=127.23.107.135:40385, user_credentials={real_user=slave}} blocked reactor thread for 62751.3us
I20260807 13:54:11.275908 7751 rebalancer_tool.cc:1090] tablet eab259b597a64c04869543ccb1d9038c: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move scheduled
I20260807 13:54:11.447150 7751 rebalancer_tool.cc:1152] tablet eab259b597a64c04869543ccb1d9038c: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move completed: OK
I20260807 13:54:11.500200 7751 rebalancer_tool.cc:1152] tablet 739f4f0207104455bf3e87bc04f8d13c: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '8a9903f009ff46b4a6875490823076c4' move completed: OK
I20260807 13:54:11.728089 7751 rebalancer_tool.cc:1152] tablet 782ac4fa94fb4183940fca514cc068b0: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move completed: OK
I20260807 13:54:11.763639 7751 rebalancer_tool.cc:1152] tablet 80898a5a2cf046f1b7344dfceb175bbd: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
I20260807 13:54:11.967293 7751 rebalancer_tool.cc:1152] tablet 522c3523f2af4eb29e30fa55da2acd3e: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '31d7630573c8475a9f84978d4ebfb879' move completed: OK
I20260807 13:54:12.043530 7751 rebalancer_tool.cc:1152] tablet 04dac80fea124c25b34af8cc290c0d7f: 'edf940ebcc1140cfa0c23214e0c0f179' -> 'b77f2b2eade540c6bfd4f75e5229a3cd' move completed: OK
I20260807 13:54:12.225373 7751 rebalancer_tool.cc:1152] tablet 0c1327c8461e44f2ac5d77f10c390eeb: '01adf83af3e04875b5fac9470d4da915' -> '8a9903f009ff46b4a6875490823076c4' move completed: OK
I20260807 13:54:12.338220 7751 rebalancer_tool.cc:1152] tablet e22d4edb78d24783bae07928b6c95fc2: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '31d7630573c8475a9f84978d4ebfb879' move completed: OK
I20260807 13:54:12.699764 7751 rebalancer_tool.cc:1152] tablet 069a5f0089b24a609b27d4a07a3c4353: '01adf83af3e04875b5fac9470d4da915' -> '' move completed: OK
I20260807 13:54:13.027778 7751 rebalancer_tool.cc:1152] tablet d06f352d0ff34b45b753a2c20f65574f: 'c9d2944272bc447dafce7620ac2dbd4b' -> '12ab71778f2f4b378765aaed1a0676a5' move completed: OK
I20260807 13:54:13.174286 7751 rebalancer_tool.cc:1152] tablet c10b910e9f354933b60ae70f1baa9b6f: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
I20260807 13:54:13.315683 7751 rebalancer_tool.cc:1152] tablet 43f5461808a646c885d593f782538930: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '31d7630573c8475a9f84978d4ebfb879' move completed: OK
I20260807 13:54:13.463279 7751 rebalancer_tool.cc:1152] tablet bdac11c33b2b486eb34bc93def74489c: '01adf83af3e04875b5fac9470d4da915' -> '8a9903f009ff46b4a6875490823076c4' move completed: OK
I20260807 13:54:13.490377 7751 rebalancer_tool.cc:1090] tablet 312c7ed04e334b08b506c8908224a7da: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move scheduled
I20260807 13:54:13.610608 7751 rebalancer_tool.cc:1090] tablet 68717842b14e4f06b528c08a65acd3b7: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:54:13.703579 7751 rebalancer_tool.cc:1090] tablet ffa98a163d7540e3a911a39334657138: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move scheduled
I20260807 13:54:13.818181 7751 rebalancer_tool.cc:1090] tablet e93615e4fb61416d8740ce61970610af: '01adf83af3e04875b5fac9470d4da915' -> '' move scheduled
I20260807 13:54:13.887981 7751 rebalancer_tool.cc:1090] tablet 81cbb42cd4954383976169ec16ef2416: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:54:13.912484 7751 rebalancer_tool.cc:1152] tablet 81cbb42cd4954383976169ec16ef2416: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
I20260807 13:54:13.988623 7751 rebalancer_tool.cc:1152] tablet e93615e4fb61416d8740ce61970610af: '01adf83af3e04875b5fac9470d4da915' -> '' move completed: OK
I20260807 13:54:14.139612 7751 rebalancer_tool.cc:1152] tablet ffa98a163d7540e3a911a39334657138: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move completed: OK
I20260807 13:54:14.305606 7751 rebalancer_tool.cc:1152] tablet 68717842b14e4f06b528c08a65acd3b7: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
I20260807 13:54:17.037016 7751 rebalancer_tool.cc:1090] tablet 96bc42d66fa04fb69afa630969dbb579: '01adf83af3e04875b5fac9470d4da915' -> '' move scheduled
I20260807 13:54:17.160862 7751 rebalancer_tool.cc:1090] tablet 50a090faa58e4f91961c9251030efacf: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move scheduled
I20260807 13:54:17.450138 7751 rebalancer_tool.cc:1090] tablet a29bfc37eabb411f845203c281444086: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:54:17.524369 7751 rebalancer_tool.cc:1090] tablet 1715828a5d96455abecae985d1dca004: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move scheduled
I20260807 13:54:17.663383 7751 rebalancer_tool.cc:1152] tablet 1715828a5d96455abecae985d1dca004: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move completed: OK
I20260807 13:54:22.117910 7751 rebalancer_tool.cc:1152] tablet 50a090faa58e4f91961c9251030efacf: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move completed: OK
I20260807 13:54:22.255335 7751 rebalancer_tool.cc:1152] tablet 96bc42d66fa04fb69afa630969dbb579: '01adf83af3e04875b5fac9470d4da915' -> '' move completed: OK
I20260807 13:54:22.298863 7751 rebalancer_tool.cc:1152] tablet 312c7ed04e334b08b506c8908224a7da: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move completed: OK
I20260807 13:54:22.510594 7751 rebalancer_tool.cc:1152] tablet a29bfc37eabb411f845203c281444086: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
W20260807 13:54:23.459977 18961 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.GetTableLocations -> {remote=127.23.107.190:41317, user_credentials={real_user=slave}} blocked reactor thread for 46193.3us
I20260807 13:54:24.721303 7751 rebalancer_tool.cc:1090] tablet 966ebd287fc14e498e5bd3e6542194ca: '01adf83af3e04875b5fac9470d4da915' -> '' move scheduled
I20260807 13:54:25.192022 7751 rebalancer_tool.cc:1090] tablet 50a090faa58e4f91961c9251030efacf: '31d7630573c8475a9f84978d4ebfb879' -> 'fa83b7af134b4e3b949ac3b4e4bcb5e7' move scheduled
I20260807 13:54:25.591333 7751 rebalancer_tool.cc:1090] tablet eab259b597a64c04869543ccb1d9038c: 'b77f2b2eade540c6bfd4f75e5229a3cd' -> '8a9903f009ff46b4a6875490823076c4' move scheduled
I20260807 13:54:26.080451 7751 rebalancer_tool.cc:1090] tablet 312c7ed04e334b08b506c8908224a7da: '12ab71778f2f4b378765aaed1a0676a5' -> 'edf940ebcc1140cfa0c23214e0c0f179' move scheduled
I20260807 13:54:26.200613 7751 rebalancer_tool.cc:1100] tablet e22d4edb78d24783bae07928b6c95fc2: '01adf83af3e04875b5fac9470d4da915' -> 'c9d2944272bc447dafce7620ac2dbd4b' move ignored: Illegal state: tablet e22d4edb78d24783bae07928b6c95fc2: replica c9d2944272bc447dafce7620ac2dbd4b is already present
I20260807 13:54:26.200783 7751 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260807 13:54:27.819995 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 35d13981f3a742dd9369d1e7bf18498c: could not find any suitable replica to move from server 8a9903f009ff46b4a6875490823076c4 to server b77f2b2eade540c6bfd4f75e5229a3cd
I20260807 13:54:28.768858 7751 rebalancer_tool.cc:1090] tablet ffa98a163d7540e3a911a39334657138: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> 'c9d2944272bc447dafce7620ac2dbd4b' move scheduled
I20260807 13:54:28.972311 7751 rebalancer_tool.cc:1100] tablet 242a68df09cb4c7d9522a33d259ebf78: '01adf83af3e04875b5fac9470d4da915' -> '12ab71778f2f4b378765aaed1a0676a5' move ignored: Illegal state: tablet 242a68df09cb4c7d9522a33d259ebf78: replica 12ab71778f2f4b378765aaed1a0676a5 is already present
I20260807 13:54:28.972527 7751 rebalancer_tool.cc:772] re-synchronizing cluster state
I20260807 13:54:31.093668 7751 rebalancer_tool.cc:1090] tablet 96bc42d66fa04fb69afa630969dbb579: '8a9903f009ff46b4a6875490823076c4' -> '' move scheduled
I20260807 13:54:31.967478 7751 rebalancer_tool.cc:1090] tablet 68717842b14e4f06b528c08a65acd3b7: '12ab71778f2f4b378765aaed1a0676a5' -> 'c9d2944272bc447dafce7620ac2dbd4b' move scheduled
I20260807 13:54:32.067348 7751 rebalancer_tool.cc:1090] tablet b414c896ad884facb339e5e4a0329065: '12ab71778f2f4b378765aaed1a0676a5' -> '' move scheduled
I20260807 13:54:32.232200 7751 rebalancer_tool.cc:1090] tablet 04dac80fea124c25b34af8cc290c0d7f: '12ab71778f2f4b378765aaed1a0676a5' -> '' move scheduled
I20260807 13:54:36.976320 7751 rebalancer_tool.cc:1139] tablet b414c896ad884facb339e5e4a0329065: '12ab71778f2f4b378765aaed1a0676a5' -> '' move is abandoned: Not found: Server with UUID 12ab71778f2f4b378765aaed1a0676a5 not a member of the config. RaftConfig: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:54:49.243906 7751 rebalancer_tool.cc:1152] tablet 50a090faa58e4f91961c9251030efacf: '31d7630573c8475a9f84978d4ebfb879' -> 'fa83b7af134b4e3b949ac3b4e4bcb5e7' move completed: OK
I20260807 13:54:49.556227 7751 rebalancer_tool.cc:1152] tablet 966ebd287fc14e498e5bd3e6542194ca: '01adf83af3e04875b5fac9470d4da915' -> '' move completed: OK
I20260807 13:54:49.678252 7751 rebalancer_tool.cc:1152] tablet 04dac80fea124c25b34af8cc290c0d7f: '12ab71778f2f4b378765aaed1a0676a5' -> '' move completed: OK
I20260807 13:54:51.901631 7751 rebalancer_tool.cc:1152] tablet 96bc42d66fa04fb69afa630969dbb579: '8a9903f009ff46b4a6875490823076c4' -> '' move completed: OK
I20260807 13:54:52.115191 7751 rebalancer_tool.cc:1152] tablet ffa98a163d7540e3a911a39334657138: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> 'c9d2944272bc447dafce7620ac2dbd4b' move completed: OK
I20260807 13:54:52.195968 7751 rebalancer_tool.cc:1152] tablet 312c7ed04e334b08b506c8908224a7da: '12ab71778f2f4b378765aaed1a0676a5' -> 'edf940ebcc1140cfa0c23214e0c0f179' move completed: OK
I20260807 13:54:52.282027 7751 rebalancer_tool.cc:1152] tablet eab259b597a64c04869543ccb1d9038c: 'b77f2b2eade540c6bfd4f75e5229a3cd' -> '8a9903f009ff46b4a6875490823076c4' move completed: OK
I20260807 13:54:52.441514 7751 rebalancer_tool.cc:1152] tablet 68717842b14e4f06b528c08a65acd3b7: '12ab71778f2f4b378765aaed1a0676a5' -> 'c9d2944272bc447dafce7620ac2dbd4b' move completed: OK
W20260807 13:54:53.578253 24591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.23.107.131:40441, user_credentials={real_user=slave}} blocked reactor thread for 46629.5us
W20260807 13:54:54.381536 7751 rebalancer_tool.cc:1212] table 91303cf8b9064e06b8c4165942b287f2: no follower replicas available on edf940ebcc1140cfa0c23214e0c0f179, falling back to leader replicas
I20260807 13:54:55.314697 7751 rebalancer_tool.cc:1090] tablet 68717842b14e4f06b528c08a65acd3b7: 'c9d2944272bc447dafce7620ac2dbd4b' -> '12ab71778f2f4b378765aaed1a0676a5' move scheduled
I20260807 13:54:55.844403 7751 rebalancer_tool.cc:1090] tablet 50a090faa58e4f91961c9251030efacf: 'edf940ebcc1140cfa0c23214e0c0f179' -> '31d7630573c8475a9f84978d4ebfb879' move scheduled
I20260807 13:54:56.563164 7751 rebalancer_tool.cc:1090] tablet 0c1327c8461e44f2ac5d77f10c390eeb: '8a9903f009ff46b4a6875490823076c4' -> '01adf83af3e04875b5fac9470d4da915' move scheduled
I20260807 13:54:56.786799 7751 rebalancer_tool.cc:1100] tablet 069a5f0089b24a609b27d4a07a3c4353: 'c9d2944272bc447dafce7620ac2dbd4b' -> '12ab71778f2f4b378765aaed1a0676a5' move ignored: Illegal state: tablet 069a5f0089b24a609b27d4a07a3c4353: replica 12ab71778f2f4b378765aaed1a0676a5 is already present
I20260807 13:54:56.786974 7751 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260807 13:54:58.754159 7751 rebalancer_tool.cc:1212] table e242e42da20d4458a49a269a9569307a: no follower replicas available on edf940ebcc1140cfa0c23214e0c0f179, falling back to leader replicas
I20260807 13:54:59.477770 7751 rebalancer_tool.cc:1100] tablet 96bc42d66fa04fb69afa630969dbb579: 'edf940ebcc1140cfa0c23214e0c0f179' -> '31d7630573c8475a9f84978d4ebfb879' move ignored: Illegal state: Request specified cas_config_opid_index of 11 but the committed config has opid_index of 12
I20260807 13:54:59.477886 7751 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260807 13:55:01.990592 7751 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c2c7db1795a1414c8299bebbeaf60404: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:55:04.245688 7751 rebalancer_tool.cc:1139] tablet 0c1327c8461e44f2ac5d77f10c390eeb: '8a9903f009ff46b4a6875490823076c4' -> '01adf83af3e04875b5fac9470d4da915' move is abandoned: Not found: Server with UUI
I20260807 13:55:15.793993 5129 maintenance_manager.cc:419] P 01adf83af3e04875b5fac9470d4da915: Scheduling UndoDeltaBlockGCOp(43f5461808a646c885d593f782538930): 4923 bytes on disk
I20260807 13:55:15.795761 4983 maintenance_manager.cc:643] P 01adf83af3e04875b5fac9470d4da915: UndoDeltaBlockGCOp(43f5461808a646c885d593f782538930) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":96,"lbm_reads_lt_1ms":4}
W20260807 13:55:15.818876 28635 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/data (499572736 bytes available vs 518351011 bytes reserved) (error 28)
I20260807 13:55:15.821687 28606 ts_tablet_manager.cc:1929] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.4
W20260807 13:55:15.822248 28606 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data (499572736 bytes available vs 518351011 bytes reserved) (error 28)
W20260807 13:55:15.822804 5153 consensus_peers.cc:576] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 -> Peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): Unable to start Tablet Copy on peer: error { code: UNKNOWN_ERROR status { code: IO_ERROR message: "Init tablet metadata failed: Could not create a new directory group for tablet copy: All healthy data directories are full" posix_code: 28 } }
I20260807 13:55:15.824481 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-e93615e4fb61416d8740ce61970610af received from {username='slave'} at 127.23.107.133:38087
I20260807 13:55:15.824626 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-e93615e4fb61416d8740ce61970610af on tablet e93615e4fb61416d8740ce61970610af with peer b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:55:15.824950 4632 consensus_peers.cc:576] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Unable to start Tablet Copy on peer: error { code: UNKNOWN_ERROR status { code: IO_ERROR message: "Init tablet metadata failed: Could not create a new directory group for tablet copy: All healthy data directories are full" posix_code: 28 } }
I20260807 13:55:15.827502 28635 ts_tablet_manager.cc:1916] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:55:15.828385 4746 tablet_copy_service.cc:342] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Request end of tablet copy session edf940ebcc1140cfa0c23214e0c0f179-bdac11c33b2b486eb34bc93def74489c received from {username='slave'} at 127.23.107.132:57653
I20260807 13:55:15.828505 4746 tablet_copy_service.cc:434] P fa83b7af134b4e3b949ac3b4e4bcb5e7: ending tablet copy session edf940ebcc1140cfa0c23214e0c0f179-bdac11c33b2b486eb34bc93def74489c on tablet bdac11c33b2b486eb34bc93def74489c with peer edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:55:15.829692 28606 ts_tablet_manager.cc:1916] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:55:15.840512 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:15.853010 28606 ts_tablet_manager.cc:1929] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:55:15.866364 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:15.874445 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:15.946115 5214 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:15.947319 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:15.956784 28635 ts_tablet_manager.cc:1929] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260807 13:55:15.970664 4688 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260807 13:55:15.990724 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:16.042222 28606 ts_tablet_manager.cc:933] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:55:16.069157 28606 tablet_copy_client.cc:323] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:55:16.069934 4746 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet bdac11c33b2b486eb34bc93def74489c from peer edf940ebcc1140cfa0c23214e0c0f179 ({username='slave'} at 127.23.107.132:57653)
I20260807 13:55:16.070098 4746 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet bdac11c33b2b486eb34bc93def74489c from peer edf940ebcc1140cfa0c23214e0c0f179 at {username='slave'} at 127.23.107.132:57653: session id = edf940ebcc1140cfa0c23214e0c0f179-bdac11c33b2b486eb34bc93def74489c
I20260807 13:55:16.073570 4746 tablet_copy_source_session.cc:215] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:55:16.074664 28606 ts_tablet_manager.cc:1916] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:55:16.085019 28606 ts_tablet_manager.cc:1929] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.4
W20260807 13:55:16.085383 28606 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data (499392512 bytes available vs 518351011 bytes reserved) (error 28)
W20260807 13:55:16.086398 4632 consensus_peers.cc:576] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Unable to start Tablet Copy on peer: error { code: UNKNOWN_ERROR status { code: IO_ERROR message: "Init tablet metadata failed: Could not create a new directory group for tablet copy: All healthy data directories are full" posix_code: 28 } }
I20260807 13:55:16.087231 4746 tablet_copy_service.cc:342] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Request end of tablet copy session edf940ebcc1140cfa0c23214e0c0f179-bdac11c33b2b486eb34bc93def74489c received from {username='slave'} at 127.23.107.132:57653
I20260807 13:55:16.087387 4746 tablet_copy_service.cc:434] P fa83b7af134b4e3b949ac3b4e4bcb5e7: ending tablet copy session edf940ebcc1140cfa0c23214e0c0f179-bdac11c33b2b486eb34bc93def74489c on tablet bdac11c33b2b486eb34bc93def74489c with peer edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:55:16.088531 28606 ts_tablet_manager.cc:1916] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260807 13:55:16.095152 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:16.130626 28606 ts_tablet_manager.cc:1929] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:55:16.150133 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:16.158739 28635 ts_tablet_manager.cc:933] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:55:16.200654 28635 tablet_copy_client.cc:323] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:55:16.201613 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet e93615e4fb61416d8740ce61970610af from peer b77f2b2eade540c6bfd4f75e5229a3cd ({username='slave'} at 127.23.107.133:38087)
I20260807 13:55:16.201810 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet e93615e4fb61416d8740ce61970610af from peer b77f2b2eade540c6bfd4f75e5229a3cd at {username='slave'} at 127.23.107.133:38087: session id = b77f2b2eade540c6bfd4f75e5229a3cd-e93615e4fb61416d8740ce61970610af
I20260807 13:55:16.211267 5272 tablet_copy_source_session.cc:215] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:55:16.212311 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:16.212605 28635 ts_tablet_manager.cc:1916] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:55:16.222244 28635 ts_tablet_manager.cc:1929] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.8
W20260807 13:55:16.222504 28635 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/data (499392512 bytes available vs 518351011 bytes reserved) (error 28)
W20260807 13:55:16.223227 5153 consensus_peers.cc:576] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 -> Peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): Unable to start Tablet Copy on peer: error { code: UNKNOWN_ERROR status { code: IO_ERROR message: "Init tablet metadata failed: Could not create a new directory group for tablet copy: All healthy data directories are full" posix_code: 28 } }
I20260807 13:55:16.235741 28606 ts_tablet_manager.cc:933] T 68717842b14e4f06b528c08a65acd3b7 P edf940ebcc1140cfa0c23214e0c0f179: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:55:16.239539 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-e93615e4fb61416d8740ce61970610af received from {username='slave'} at 127.23.107.133:38087
I20260807 13:55:16.239693 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-e93615e4fb61416d8740ce61970610af on tablet e93615e4fb61416d8740ce61970610af with peer b77f2b2eade540c6bfd4f75e5229a3cd
I20260807 13:55:16.240716 28635 ts_tablet_manager.cc:1916] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260807 13:55:16.246047 4631 consensus_peers.cc:597] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 13:55:16.246209 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:16.252058 28606 tablet_copy_client.cc:323] T 68717842b14e4f06b528c08a65acd3b7 P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:55:16.252771 4746 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet 68717842b14e4f06b528c08a65acd3b7 from peer edf940ebcc1140cfa0c23214e0c0f179 ({username='slave'} at 127.23.107.132:57653)
I20260807 13:55:16.252933 4746 tablet_copy_service.cc:171] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Re-sending initialization info for existing tablet copy session on tablet 68717842b14e4f06b528c08a65acd3b7 from peer edf940ebcc1140cfa0c23214e0c0f179 at {username='slave'} at 127.23.107.132:57653: session_id = edf940ebcc1140cfa0c23214e0c0f179-68717842b14e4f06b528c08a65acd3b7
I20260807 13:55:16.253453 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260807 13:55:16.254686 28606 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data (499392512 bytes available vs 518351011 bytes reserved) (error 28)
W20260807 13:55:16.256398 4632 consensus_peers.cc:576] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Unable to start Tablet Copy on peer: error { code: UNKNOWN_ERROR status { code: IO_ERROR message: "Init tablet metadata failed: Failed to create TabletMetadata: All healthy data directories are full" posix_code: 28 } }
I20260807 13:55:16.276136 28635 ts_tablet_manager.cc:1929] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260807 13:55:16.279310 5214 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:16.330238 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:16.363862 4688 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260807 13:55:16.476874 28606 ts_tablet_manager.cc:933] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:55:16.482291 28606 tablet_copy_client.cc:323] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:55:16.483075 4746 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet bdac11c33b2b486eb34bc93def74489c from peer edf940ebcc1140cfa0c23214e0c0f179 ({username='slave'} at 127.23.107.132:57653)
I20260807 13:55:16.483244 4746 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet bdac11c33b2b486eb34bc93def74489c from peer edf940ebcc1140cfa0c23214e0c0f179 at {username='slave'} at 127.23.107.132:57653: session id = edf940ebcc1140cfa0c23214e0c0f179-bdac11c33b2b486eb34bc93def74489c
I20260807 13:55:16.485980 4746 tablet_copy_source_session.cc:215] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:55:16.487157 28606 ts_tablet_manager.cc:1916] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:55:16.495374 28606 ts_tablet_manager.cc:1929] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.4
W20260807 13:55:16.495702 28606 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data (499224576 bytes available vs 518351011 bytes reserved) (error 28)
W20260807 13:55:16.497694 4632 consensus_peers.cc:576] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Unable to start Tablet Copy on peer: error { code: UNKNOWN_ERROR status { code: IO_ERROR message: "Init tablet metadata failed: Could not create a new directory group for tablet copy: All healthy data directories are full" posix_code: 28 } }
I20260807 13:55:16.498840 4746 tablet_copy_service.cc:342] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Request end of tablet copy session edf940ebcc1140cfa0c23214e0c0f179-bdac11c33b2b486eb34bc93def74489c received from {username='slave'} at 127.23.107.132:57653
I20260807 13:55:16.498991 4746 tablet_copy_service.cc:434] P fa83b7af134b4e3b949ac3b4e4bcb5e7: ending tablet copy session edf940ebcc1140cfa0c23214e0c0f179-bdac11c33b2b486eb34bc93def74489c on tablet bdac11c33b2b486eb34bc93def74489c with peer edf940ebcc1140cfa0c23214e0c0f179
W20260807 13:55:16.499833 4981 consensus_peers.cc:597] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 13:55:16.500605 28606 ts_tablet_manager.cc:1916] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:55:16.507732 28606 ts_tablet_manager.cc:1929] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:55:16.532114 4779 maintenance_manager.cc:419] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Scheduling FlushMRSOp(069a5f0089b24a609b27d4a07a3c4353): perf score=0.033344
W20260807 13:55:16.572316 7273 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 13:55:16.574410 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:16.603502 4631 consensus_peers.cc:597] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 13:55:16.683519 4634 maintenance_manager.cc:643] P fa83b7af134b4e3b949ac3b4e4bcb5e7: FlushMRSOp(069a5f0089b24a609b27d4a07a3c4353) complete. Timing: real 0.151s user 0.077s sys 0.037s Metrics: {"bytes_written":6152,"cfile_init":1,"drs_written":1,"lbm_read_time_us":86,"lbm_reads_lt_1ms":4,"lbm_write_time_us":992,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":46961,"threads_started":2,"wal-append.queue_time_us":37286}
I20260807 13:55:16.685184 4779 maintenance_manager.cc:419] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Scheduling UndoDeltaBlockGCOp(069a5f0089b24a609b27d4a07a3c4353): 4840 bytes on disk
I20260807 13:55:16.686555 4634 maintenance_manager.cc:643] P fa83b7af134b4e3b949ac3b4e4bcb5e7: UndoDeltaBlockGCOp(069a5f0089b24a609b27d4a07a3c4353) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":622,"lbm_reads_lt_1ms":4}
W20260807 13:55:16.697460 7612 consensus_peers.cc:597] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 13:55:16.704775 28606 ts_tablet_manager.cc:933] T 68717842b14e4f06b528c08a65acd3b7 P edf940ebcc1140cfa0c23214e0c0f179: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:55:16.739739 28606 tablet_copy_client.cc:323] T 68717842b14e4f06b528c08a65acd3b7 P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:55:16.740662 4746 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet 68717842b14e4f06b528c08a65acd3b7 from peer edf940ebcc1140cfa0c23214e0c0f179 ({username='slave'} at 127.23.107.132:57653)
I20260807 13:55:16.740881 4746 tablet_copy_service.cc:171] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Re-sending initialization info for existing tablet copy session on tablet 68717842b14e4f06b528c08a65acd3b7 from peer edf940ebcc1140cfa0c23214e0c0f179 at {username='slave'} at 127.23.107.132:57653: session_id = edf940ebcc1140cfa0c23214e0c0f179-68717842b14e4f06b528c08a65acd3b7
W20260807 13:55:16.744560 28606 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data (499191808 bytes available vs 518351011 bytes reserved) (error 28)
W20260807 13:55:16.746553 4632 consensus_peers.cc:576] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Unable to start Tablet Copy on peer: error { code: UNKNOWN_ERROR status { code: IO_ERROR message: "Init tablet metadata failed: Failed to create TabletMetadata: All healthy data directories are full" posix_code: 28 } }
I20260807 13:55:16.753648 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:16.771775 28635 ts_tablet_manager.cc:933] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:55:16.796398 28635 tablet_copy_client.cc:323] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:55:16.804065 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet e93615e4fb61416d8740ce61970610af from peer b77f2b2eade540c6bfd4f75e5229a3cd ({username='slave'} at 127.23.107.133:38087)
I20260807 13:55:16.804217 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet e93615e4fb61416d8740ce61970610af from peer b77f2b2eade540c6bfd4f75e5229a3cd at {username='slave'} at 127.23.107.133:38087: session id = b77f2b2eade540c6bfd4f75e5229a3cd-e93615e4fb61416d8740ce61970610af
I20260807 13:55:16.807502 5272 tablet_copy_source_session.cc:215] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
W20260807 13:55:16.810743 5153 consensus_peers.cc:597] T e22d4edb78d24783bae07928b6c95fc2 P edf940ebcc1140cfa0c23214e0c0f179 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 13:55:16.811342 28635 ts_tablet_manager.cc:1916] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: Deleting tablet data with delete state TABLET_DATA_COPYING
W20260807 13:55:16.811465 4981 consensus_peers.cc:597] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 13:55:16.825157 28635 ts_tablet_manager.cc:1929] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.8
I20260807 13:55:16.827643 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
W20260807 13:55:16.840008 28635 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/data (499154944 bytes available vs 518351011 bytes reserved) (error 28)
W20260807 13:55:16.841617 5153 consensus_peers.cc:576] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 -> Peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): Unable to start Tablet Copy on peer: error { code: UNKNOWN_ERROR status { code: IO_ERROR message: "Init tablet metadata failed: Could not create a new directory group for tablet copy: All healthy data directories are full" posix_code: 28 } }
I20260807 13:55:16.842408 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-e93615e4fb61416d8740ce61970610af received from {username='slave'} at 127.23.107.133:38087
I20260807 13:55:16.842541 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-e93615e4fb61416d8740ce61970610af on tablet e93615e4fb61416d8740ce61970610af with peer b77f2b2eade540c6bfd4f75e5229a3cd
I20260807 13:55:16.848760 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:16.857525 28635 ts_tablet_manager.cc:1916] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:55:16.892724 28635 ts_tablet_manager.cc:1929] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20260807 13:55:16.957384 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:16.970428 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:16.979450 4688 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260807 13:55:16.994033 5214 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:16.997682 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:17.077793 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:17.092288 28606 ts_tablet_manager.cc:933] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:55:17.126325 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:17.126936 28606 tablet_copy_client.cc:323] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:55:17.127949 4746 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet bdac11c33b2b486eb34bc93def74489c from peer edf940ebcc1140cfa0c23214e0c0f179 ({username='slave'} at 127.23.107.132:57653)
I20260807 13:55:17.128147 4746 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet bdac11c33b2b486eb34bc93def74489c from peer edf940ebcc1140cfa0c23214e0c0f179 at {username='slave'} at 127.23.107.132:57653: session id = edf940ebcc1140cfa0c23214e0c0f179-bdac11c33b2b486eb34bc93def74489c
I20260807 13:55:17.133738 4746 tablet_copy_source_session.cc:215] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:55:17.135103 28606 ts_tablet_manager.cc:1916] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:55:17.151628 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:17.161666 28606 ts_tablet_manager.cc:1929] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.4
W20260807 13:55:17.163282 28606 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data (499064832 bytes available vs 518351011 bytes reserved) (error 28)
W20260807 13:55:17.164439 4632 consensus_peers.cc:576] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Unable to start Tablet Copy on peer: error { code: UNKNOWN_ERROR status { code: IO_ERROR message: "Init tablet metadata failed: Could not create a new directory group for tablet copy: All healthy data directories are full" posix_code: 28 } }
I20260807 13:55:17.165307 4746 tablet_copy_service.cc:342] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Request end of tablet copy session edf940ebcc1140cfa0c23214e0c0f179-bdac11c33b2b486eb34bc93def74489c received from {username='slave'} at 127.23.107.132:57653
I20260807 13:55:17.165477 4746 tablet_copy_service.cc:434] P fa83b7af134b4e3b949ac3b4e4bcb5e7: ending tablet copy session edf940ebcc1140cfa0c23214e0c0f179-bdac11c33b2b486eb34bc93def74489c on tablet bdac11c33b2b486eb34bc93def74489c with peer edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:55:17.166633 28606 ts_tablet_manager.cc:1916] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:55:17.188869 5214 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
W20260807 13:55:17.197974 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:17.209842 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:17.218912 28606 ts_tablet_manager.cc:1929] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
W20260807 13:55:17.228729 7273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.130:37489, user_credentials={real_user=slave}} blocked reactor thread for 110296us
I20260807 13:55:17.243110 4688 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260807 13:55:17.269122 28606 ts_tablet_manager.cc:933] T 68717842b14e4f06b528c08a65acd3b7 P edf940ebcc1140cfa0c23214e0c0f179: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:55:17.283250 28606 tablet_copy_client.cc:323] T 68717842b14e4f06b528c08a65acd3b7 P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:55:17.284204 4746 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet 68717842b14e4f06b528c08a65acd3b7 from peer edf940ebcc1140cfa0c23214e0c0f179 ({username='slave'} at 127.23.107.132:57653)
I20260807 13:55:17.284360 4746 tablet_copy_service.cc:171] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Re-sending initialization info for existing tablet copy session on tablet 68717842b14e4f06b528c08a65acd3b7 from peer edf940ebcc1140cfa0c23214e0c0f179 at {username='slave'} at 127.23.107.132:57653: session_id = edf940ebcc1140cfa0c23214e0c0f179-68717842b14e4f06b528c08a65acd3b7
W20260807 13:55:17.286401 28606 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data (499019776 bytes available vs 518351011 bytes reserved) (error 28)
I20260807 13:55:17.287875 7746 rebalancer_tool-test.cc:1258] rebalancer run info: Runtime error: /tmp/dist-test-task2KnpY3/build/asan/bin/kudu: process exited with non-zero status 1
stdout: Per-server replica distribution summary:
Statistic | Value
-----------------------+-----------
Minimum Replica Count | 0
Maximum Replica Count | 23
Average Replica Count | 11.250000
Per-table replica distribution summary:
Replica Skew | Value
--------------+----------
Minimum | 3
Maximum | 3
Average | 3.000000
stderr: W20260807 13:53:25.686311 7753 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:25.688024 7753 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260807 13:53:29.018687 7753 rebalancer_tool.cc:215] running whole-cluster rebalancing
W20260807 13:53:31.333141 7753 rebalancer_tool.cc:1212] table b6c061acc30c4e5aa6bee1f054e3a59a: no follower replicas available on c9d2944272bc447dafce7620ac2dbd4b, falling back to leader replicas
W20260807 13:53:31.333806 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 96e83925faa542ffa4808b01a5adbbb3: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:31.334278 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 2ff801ea568346e096cc895a279c109c: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:31.334614 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 6008038c907645199b055dacb5772621: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:31.334784 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 35d13981f3a742dd9369d1e7bf18498c: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:31.334985 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 14867b014aab43119171102f60bb134d: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:31.335206 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 91303cf8b9064e06b8c4165942b287f2: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:31.335347 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 7f1d26639edd4cb398339b2b0d3659a3: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:31.335598 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b6c061acc30c4e5aa6bee1f054e3a59a: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:31.335741 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e242e42da20d4458a49a269a9569307a: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:31.335911 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e242e42da20d4458a49a269a9569307a: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:31.336115 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c2c7db1795a1414c8299bebbeaf60404: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:31.336328 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 91303cf8b9064e06b8c4165942b287f2: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:31.336472 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 2ff801ea568346e096cc895a279c109c: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:31.336617 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 35d13981f3a742dd9369d1e7bf18498c: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:31.336762 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 7f1d26639edd4cb398339b2b0d3659a3: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server b77f2b2eade540c6bfd4f75e5229a3cd
I20260807 13:53:32.009769 7753 rebalancer_tool.cc:1090] tablet d02aa7a26c024b4083421b5d742f7bcb: '01adf83af3e04875b5fac9470d4da915' -> 'b77f2b2eade540c6bfd4f75e5229a3cd' move scheduled
I20260807 13:53:32.437856 7753 rebalancer_tool.cc:1090] tablet 1715828a5d96455abecae985d1dca004: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '8a9903f009ff46b4a6875490823076c4' move scheduled
I20260807 13:53:33.058452 7753 rebalancer_tool.cc:1090] tablet 68717842b14e4f06b528c08a65acd3b7: 'c9d2944272bc447dafce7620ac2dbd4b' -> '12ab71778f2f4b378765aaed1a0676a5' move scheduled
I20260807 13:53:33.671777 7753 rebalancer_tool.cc:1100] tablet 782ac4fa94fb4183940fca514cc068b0: 'edf940ebcc1140cfa0c23214e0c0f179' -> '31d7630573c8475a9f84978d4ebfb879' move ignored: Illegal state: Request specified cas_config_opid_index of -1 but the committed config has opid_index of 4
I20260807 13:53:33.671986 7753 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260807 13:53:35.666246 7753 rebalancer_tool.cc:1212] table b6c061acc30c4e5aa6bee1f054e3a59a: no follower replicas available on c9d2944272bc447dafce7620ac2dbd4b, falling back to leader replicas
W20260807 13:53:35.666404 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b6c061acc30c4e5aa6bee1f054e3a59a: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:35.666560 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 35d13981f3a742dd9369d1e7bf18498c: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:35.666816 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 2ff801ea568346e096cc895a279c109c: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:35.666962 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 96e83925faa542ffa4808b01a5adbbb3: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:35.667074 7753 rebalancer_tool.cc:1212] table b6c061acc30c4e5aa6bee1f054e3a59a: no follower replicas available on edf940ebcc1140cfa0c23214e0c0f179, falling back to leader replicas
W20260807 13:53:35.667169 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b6c061acc30c4e5aa6bee1f054e3a59a: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:35.667332 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 7f1d26639edd4cb398339b2b0d3659a3: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:35.667440 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 91303cf8b9064e06b8c4165942b287f2: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:35.667542 7753 rebalancer_tool.cc:1212] table 91303cf8b9064e06b8c4165942b287f2: no follower replicas available on edf940ebcc1140cfa0c23214e0c0f179, falling back to leader replicas
W20260807 13:53:35.667618 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 91303cf8b9064e06b8c4165942b287f2: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:35.667836 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 91303cf8b9064e06b8c4165942b287f2: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:35.667945 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c2c7db1795a1414c8299bebbeaf60404: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:35.668052 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 6008038c907645199b055dacb5772621: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:35.668206 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 96e83925faa542ffa4808b01a5adbbb3: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:35.668327 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 35d13981f3a742dd9369d1e7bf18498c: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 31d7630573c8475a9f84978d4ebfb879
I20260807 13:53:36.103684 7753 rebalancer_tool.cc:1100] tablet 069a5f0089b24a609b27d4a07a3c4353: '01adf83af3e04875b5fac9470d4da915' -> '31d7630573c8475a9f84978d4ebfb879' move ignored: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }.
Pending config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:53:36.103828 7753 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260807 13:53:37.715719 7753 rebalancer_tool.cc:1212] table 96e83925faa542ffa4808b01a5adbbb3: no follower replicas available on 01adf83af3e04875b5fac9470d4da915, falling back to leader replicas
W20260807 13:53:37.716054 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 6008038c907645199b055dacb5772621: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:37.716325 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 35d13981f3a742dd9369d1e7bf18498c: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:37.716548 7753 rebalancer_tool.cc:1212] table 2ff801ea568346e096cc895a279c109c: no follower replicas available on edf940ebcc1140cfa0c23214e0c0f179, falling back to leader replicas
W20260807 13:53:37.716639 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 2ff801ea568346e096cc895a279c109c: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:37.716746 7753 rebalancer_tool.cc:1212] table b6c061acc30c4e5aa6bee1f054e3a59a: no follower replicas available on c9d2944272bc447dafce7620ac2dbd4b, falling back to leader replicas
W20260807 13:53:37.716918 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 7f1d26639edd4cb398339b2b0d3659a3: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:37.717052 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b6c061acc30c4e5aa6bee1f054e3a59a: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:37.717163 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b6c061acc30c4e5aa6bee1f054e3a59a: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:37.717254 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 2ff801ea568346e096cc895a279c109c: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:37.717381 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 91303cf8b9064e06b8c4165942b287f2: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:37.717546 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c2c7db1795a1414c8299bebbeaf60404: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:37.717643 7753 rebalancer_tool.cc:1212] table 6008038c907645199b055dacb5772621: no follower replicas available on c9d2944272bc447dafce7620ac2dbd4b, falling back to leader replicas
W20260807 13:53:37.717751 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 6008038c907645199b055dacb5772621: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:37.717972 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 35d13981f3a742dd9369d1e7bf18498c: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 31d7630573c8475a9f84978d4ebfb879
I20260807 13:53:37.848639 7753 rebalancer_tool.cc:1090] tablet ffa98a163d7540e3a911a39334657138: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move scheduled
I20260807 13:53:38.189116 7753 rebalancer_tool.cc:1090] tablet 50a090faa58e4f91961c9251030efacf: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '31d7630573c8475a9f84978d4ebfb879' move scheduled
I20260807 13:53:38.390525 7753 rebalancer_tool.cc:1090] tablet 312c7ed04e334b08b506c8908224a7da: '01adf83af3e04875b5fac9470d4da915' -> '' move scheduled
I20260807 13:53:39.422379 7753 rebalancer_tool.cc:1090] tablet faef317e47a244c6965864f82f21edfa: 'c9d2944272bc447dafce7620ac2dbd4b' -> '12ab71778f2f4b378765aaed1a0676a5' move scheduled
I20260807 13:53:39.958624 7753 rebalancer_tool.cc:1100] tablet 16afb6ff06704a8795f1de84ffa81de0: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '8a9903f009ff46b4a6875490823076c4' move ignored: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }.
Pending config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:53:39.958851 7753 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260807 13:53:42.353892 7753 rebalancer_tool.cc:1212] table b6c061acc30c4e5aa6bee1f054e3a59a: no follower replicas available on c9d2944272bc447dafce7620ac2dbd4b, falling back to leader replicas
W20260807 13:53:42.354305 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 35d13981f3a742dd9369d1e7bf18498c: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:42.354475 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 7f1d26639edd4cb398339b2b0d3659a3: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:42.354590 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 2ff801ea568346e096cc895a279c109c: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:42.354735 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 96e83925faa542ffa4808b01a5adbbb3: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:42.354885 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 35d13981f3a742dd9369d1e7bf18498c: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:42.355086 7753 rebalancer_tool.cc:1212] table c2c7db1795a1414c8299bebbeaf60404: no follower replicas available on edf940ebcc1140cfa0c23214e0c0f179, falling back to leader replicas
W20260807 13:53:42.355180 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c2c7db1795a1414c8299bebbeaf60404: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:42.355371 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e242e42da20d4458a49a269a9569307a: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:53:42.435246 7753 rebalancer_tool.cc:1090] tablet 782ac4fa94fb4183940fca514cc068b0: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move scheduled
I20260807 13:53:42.526051 7753 rebalancer_tool.cc:1090] tablet 96bc42d66fa04fb69afa630969dbb579: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move scheduled
I20260807 13:53:42.625761 7753 rebalancer_tool.cc:1090] tablet 80898a5a2cf046f1b7344dfceb175bbd: '01adf83af3e04875b5fac9470d4da915' -> '' move scheduled
W20260807 13:53:46.363350 11402 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.GetTableLocations -> {remote=127.23.107.190:41317, user_credentials={real_user=slave}} blocked reactor thread for 79944.4us
I20260807 13:53:50.495625 7753 rebalancer_tool.cc:1152] tablet faef317e47a244c6965864f82f21edfa: 'c9d2944272bc447dafce7620ac2dbd4b' -> '12ab71778f2f4b378765aaed1a0676a5' move completed: OK
I20260807 13:53:53.678889 7753 rebalancer_tool.cc:1152] tablet d02aa7a26c024b4083421b5d742f7bcb: '01adf83af3e04875b5fac9470d4da915' -> 'b77f2b2eade540c6bfd4f75e5229a3cd' move completed: OK
I20260807 13:53:57.079000 7753 rebalancer_tool.cc:1152] tablet 782ac4fa94fb4183940fca514cc068b0: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move completed: OK
I20260807 13:53:59.513032 7753 rebalancer_tool.cc:1152] tablet ffa98a163d7540e3a911a39334657138: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move completed: OK
I20260807 13:53:59.644518 7753 rebalancer_tool.cc:1090] tablet eab259b597a64c04869543ccb1d9038c: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move scheduled
I20260807 13:53:59.751464 7753 rebalancer_tool.cc:1090] tablet d27ce55f2acc4513a9fd90a338098eeb: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:54:04.559705 7753 rebalancer_tool.cc:1139] tablet eab259b597a64c04869543ccb1d9038c: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move is abandoned: Not found: Server with UUID edf940ebcc1140cfa0c23214e0c0f179 not a member of the config. RaftConfig: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:04.669896 7753 rebalancer_tool.cc:1152] tablet 80898a5a2cf046f1b7344dfceb175bbd: '01adf83af3e04875b5fac9470d4da915' -> '' move completed: OK
I20260807 13:54:04.756850 7753 rebalancer_tool.cc:1152] tablet 96bc42d66fa04fb69afa630969dbb579: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move completed: OK
I20260807 13:54:04.833137 7753 rebalancer_tool.cc:1152] tablet 1715828a5d96455abecae985d1dca004: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '8a9903f009ff46b4a6875490823076c4' move completed: OK
I20260807 13:54:04.928105 7753 rebalancer_tool.cc:1152] tablet 50a090faa58e4f91961c9251030efacf: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '31d7630573c8475a9f84978d4ebfb879' move completed: OK
I20260807 13:54:05.009294 7753 rebalancer_tool.cc:1152] tablet 312c7ed04e334b08b506c8908224a7da: '01adf83af3e04875b5fac9470d4da915' -> '' move completed: OK
I20260807 13:54:05.064647 7753 rebalancer_tool.cc:1152] tablet 68717842b14e4f06b528c08a65acd3b7: 'c9d2944272bc447dafce7620ac2dbd4b' -> '12ab71778f2f4b378765aaed1a0676a5' move completed: OK
I20260807 13:54:05.091630 7753 rebalancer_tool.cc:1090] tablet 242a68df09cb4c7d9522a33d259ebf78: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move scheduled
I20260807 13:54:05.178953 7753 rebalancer_tool.cc:1090] tablet c10b910e9f354933b60ae70f1baa9b6f: '01adf83af3e04875b5fac9470d4da915' -> '' move scheduled
I20260807 13:54:05.349685 7753 rebalancer_tool.cc:1090] tablet bdac11c33b2b486eb34bc93def74489c: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move scheduled
I20260807 13:54:07.657729 7753 rebalancer_tool.cc:1152] tablet c10b910e9f354933b60ae70f1baa9b6f: '01adf83af3e04875b5fac9470d4da915' -> '' move completed: OK
I20260807 13:54:07.792954 7753 rebalancer_tool.cc:1152] tablet 242a68df09cb4c7d9522a33d259ebf78: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move completed: OK
I20260807 13:54:08.086843 7753 rebalancer_tool.cc:1152] tablet d27ce55f2acc4513a9fd90a338098eeb: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
I20260807 13:54:08.343227 7753 rebalancer_tool.cc:1090] tablet e93615e4fb61416d8740ce61970610af: '01adf83af3e04875b5fac9470d4da915' -> '' move scheduled
I20260807 13:54:08.565842 7753 rebalancer_tool.cc:1090] tablet 16afb6ff06704a8795f1de84ffa81de0: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move scheduled
I20260807 13:54:08.699435 7753 rebalancer_tool.cc:1090] tablet 069a5f0089b24a609b27d4a07a3c4353: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:54:10.769287 7753 rebalancer_tool.cc:1152] tablet 16afb6ff06704a8795f1de84ffa81de0: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move completed: OK
I20260807 13:54:10.878145 7753 rebalancer_tool.cc:1152] tablet e93615e4fb61416d8740ce61970610af: '01adf83af3e04875b5fac9470d4da915' -> '' move completed: OK
I20260807 13:54:10.957023 7753 rebalancer_tool.cc:1152] tablet bdac11c33b2b486eb34bc93def74489c: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move completed: OK
I20260807 13:54:11.108845 7753 rebalancer_tool.cc:1090] tablet e22d4edb78d24783bae07928b6c95fc2: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move scheduled
I20260807 13:54:11.167182 7753 rebalancer_tool.cc:1090] tablet 04dac80fea124c25b34af8cc290c0d7f: '01adf83af3e04875b5fac9470d4da915' -> '' move scheduled
I20260807 13:54:11.233703 7753 rebalancer_tool.cc:1090] tablet 966ebd287fc14e498e5bd3e6542194ca: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:54:18.128575 7753 rebalancer_tool.cc:1152] tablet e22d4edb78d24783bae07928b6c95fc2: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move completed: OK
I20260807 13:54:18.263648 7753 rebalancer_tool.cc:1152] tablet 069a5f0089b24a609b27d4a07a3c4353: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
I20260807 13:54:18.450876 7753 rebalancer_tool.cc:1090] tablet 522c3523f2af4eb29e30fa55da2acd3e: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move scheduled
I20260807 13:54:18.568679 7753 rebalancer_tool.cc:1090] tablet 81cbb42cd4954383976169ec16ef2416: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:54:18.682118 7753 rebalancer_tool.cc:1152] tablet 522c3523f2af4eb29e30fa55da2acd3e: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move completed: OK
I20260807 13:54:18.800542 7753 rebalancer_tool.cc:1152] tablet 81cbb42cd4954383976169ec16ef2416: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
I20260807 13:54:18.881379 7753 rebalancer_tool.cc:1152] tablet 966ebd287fc14e498e5bd3e6542194ca: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
I20260807 13:54:18.958597 7753 rebalancer_tool.cc:1152] tablet 04dac80fea124c25b34af8cc290c0d7f: '01adf83af3e04875b5fac9470d4da915' -> '' move completed: OK
W20260807 13:54:20.795604 7753 rebalancer_tool.cc:1212] table b6c061acc30c4e5aa6bee1f054e3a59a: no follower replicas available on c9d2944272bc447dafce7620ac2dbd4b, falling back to leader replicas
W20260807 13:54:20.795746 7753 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b6c061acc30c4e5aa6bee1f054e3a59a: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server edf940ebcc1140cfa0c23214e0c0f179
W20260807 13:54:20.795858 7753 rebalancer_tool.cc:1212] table 2ff801ea568346e096cc895a279c109c: no follower replicas available on 01adf83af3e04875b5fac9470d4da915, falling back to leader replicas
W20260807 13:54:20.795969 7753 rebalancer_tool.cc:1212] table 96e83925faa542ffa4808b01a5adbbb3: no follower replicas available on 01adf83af3e04875b5fac9470d4da915, falling back to leader replicas
I20260807 13:54:21.229669 7753 rebalancer_tool.cc:1090] tablet 966ebd287fc14e498e5bd3e6542194ca: '01adf83af3e04875b5fac9470d4da915' -> 'c9d2944272bc447dafce7620ac2dbd4b' move scheduled
I20260807 13:54:22.142409 7753 rebalancer_tool.cc:1090] tablet 96bc42d66fa04fb69afa630969dbb579: '8a9903f009ff46b4a6875490823076c4' -> '12ab71778f2f4b378765aaed1a0676a5' move scheduled
I20260807 13:54:22.478351 7753 rebalancer_tool.cc:1090] tablet 43f5461808a646c885d593f782538930: '31d7630573c8475a9f84978d4ebfb879' -> 'fa83b7af134b4e3b949ac3b4e4bcb5e7' move scheduled
I20260807 13:54:23.119227 7753 rebalancer_tool.cc:1090] tablet d27ce55f2acc4513a9fd90a338098eeb: '12ab71778f2f4b378765aaed1a0676a5' -> 'b77f2b2eade540c6bfd4f75e5229a3cd' move scheduled
I20260807 13:54:24.133283 7753 rebalancer_tool.cc:1090] tablet 522c3523f2af4eb29e30fa55da2acd3e: '01adf83af3e04875b5fac9470d4da915' -> '8a9903f009ff46b4a6875490823076c4' move scheduled
I20260807 13:54:24.738947 7753 rebalancer_tool.cc:1090] tablet 1715828a5d96455abecae985d1dca004: '8a9903f009ff46b4a6875490823076c4' -> 'c9d2944272bc447dafce7620ac2dbd4b' move scheduled
I20260807 13:54:25.083099 7753 rebalancer_tool.cc:1090] tablet c10b910e9f354933b60ae70f1baa9b6f: '12ab71778f2f4b378765aaed1a0676a5' -> '31d7630573c8475a9f84978d4ebfb879' move scheduled
I20260807 13:54:25.667171 7753 rebalancer_tool.cc:1090] tablet 81cbb42cd4954383976169ec16ef2416: '01adf83af3e04875b5fac9470d4da915' -> '31d7630573c8475a9f84978d4ebfb879' move scheduled
I20260807 13:54:26.139959 7753 rebalancer_tool.cc:1090] tablet 80898a5a2cf046f1b7344dfceb175bbd: '12ab71778f2f4b378765aaed1a0676a5' -> '01adf83af3e04875b5fac9470d4da915' move scheduled
I20260807 13:54:26.492214 7753 rebalancer_tool.cc:1090] tablet 312c7ed04e334b08b506c8908224a7da: '12ab71778f2f4b378765aaed1a0676a5' -> '01adf83af3e04875b5fac9470d4da915' move scheduled
I20260807 13:54:45.611
W20260807 13:55:17.289968 4632 consensus_peers.cc:576] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Unable to start Tablet Copy on peer: error { code: UNKNOWN_ERROR status { code: IO_ERROR message: "Init tablet metadata failed: Failed to create TabletMetadata: All healthy data directories are full" posix_code: 28 } }
I20260807 13:55:17.324891 28635 ts_tablet_manager.cc:933] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:55:17.325783 28635 tablet_copy_client.cc:323] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:55:17.326539 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet e93615e4fb61416d8740ce61970610af from peer b77f2b2eade540c6bfd4f75e5229a3cd ({username='slave'} at 127.23.107.133:38087)
I20260807 13:55:17.326725 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet e93615e4fb61416d8740ce61970610af from peer b77f2b2eade540c6bfd4f75e5229a3cd at {username='slave'} at 127.23.107.133:38087: session id = b77f2b2eade540c6bfd4f75e5229a3cd-e93615e4fb61416d8740ce61970610af
I20260807 13:55:17.330088 5272 tablet_copy_source_session.cc:215] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:55:17.338042 28635 ts_tablet_manager.cc:1916] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:55:17.347204 28635 ts_tablet_manager.cc:1929] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.8
W20260807 13:55:17.347514 28635 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/data (499019776 bytes available vs 518351011 bytes reserved) (error 28)
W20260807 13:55:17.348294 5153 consensus_peers.cc:576] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 -> Peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): Unable to start Tablet Copy on peer: error { code: UNKNOWN_ERROR status { code: IO_ERROR message: "Init tablet metadata failed: Could not create a new directory group for tablet copy: All healthy data directories are full" posix_code: 28 } }
I20260807 13:55:17.348977 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-e93615e4fb61416d8740ce61970610af received from {username='slave'} at 127.23.107.133:38087
I20260807 13:55:17.349116 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-e93615e4fb61416d8740ce61970610af on tablet e93615e4fb61416d8740ce61970610af with peer b77f2b2eade540c6bfd4f75e5229a3cd
I20260807 13:55:17.350001 28635 ts_tablet_manager.cc:1916] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:55:17.356895 28635 ts_tablet_manager.cc:1929] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
W20260807 13:55:17.415923 4631 consensus_peers.cc:597] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 13:55:17.488116 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:17.513270 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:17.533263 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:17.545156 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:17.559060 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:17.567653 5214 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:17.578032 4688 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260807 13:55:17.671746 28606 ts_tablet_manager.cc:933] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
I20260807 13:55:17.686807 28606 tablet_copy_client.cc:323] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:55:17.687677 4746 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet bdac11c33b2b486eb34bc93def74489c from peer edf940ebcc1140cfa0c23214e0c0f179 ({username='slave'} at 127.23.107.132:57653)
I20260807 13:55:17.687873 4746 tablet_copy_service.cc:161] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Beginning new tablet copy session on tablet bdac11c33b2b486eb34bc93def74489c from peer edf940ebcc1140cfa0c23214e0c0f179 at {username='slave'} at 127.23.107.132:57653: session id = edf940ebcc1140cfa0c23214e0c0f179-bdac11c33b2b486eb34bc93def74489c
I20260807 13:55:17.690819 4746 tablet_copy_source_session.cc:215] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:55:17.692291 28606 ts_tablet_manager.cc:1916] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 13:55:17.692531 4779 maintenance_manager.cc:419] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Scheduling FlushMRSOp(966ebd287fc14e498e5bd3e6542194ca): perf score=0.033367
W20260807 13:55:17.695698 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:17.702090 28606 ts_tablet_manager.cc:1929] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.4
W20260807 13:55:17.702353 28606 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data (498847744 bytes available vs 518351011 bytes reserved) (error 28)
W20260807 13:55:17.702983 4632 consensus_peers.cc:576] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Unable to start Tablet Copy on peer: error { code: UNKNOWN_ERROR status { code: IO_ERROR message: "Init tablet metadata failed: Could not create a new directory group for tablet copy: All healthy data directories are full" posix_code: 28 } }
I20260807 13:55:17.705541 4746 tablet_copy_service.cc:342] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Request end of tablet copy session edf940ebcc1140cfa0c23214e0c0f179-bdac11c33b2b486eb34bc93def74489c received from {username='slave'} at 127.23.107.132:57653
I20260807 13:55:17.705686 4746 tablet_copy_service.cc:434] P fa83b7af134b4e3b949ac3b4e4bcb5e7: ending tablet copy session edf940ebcc1140cfa0c23214e0c0f179-bdac11c33b2b486eb34bc93def74489c on tablet bdac11c33b2b486eb34bc93def74489c with peer edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:55:17.707826 5306 maintenance_manager.cc:419] P edf940ebcc1140cfa0c23214e0c0f179: Scheduling FlushMRSOp(242a68df09cb4c7d9522a33d259ebf78): perf score=0.033373
W20260807 13:55:17.708240 5153 consensus_peers.cc:597] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 13:55:17.713266 5155 tablet_replica_mm_ops.cc:214] T 242a68df09cb4c7d9522a33d259ebf78 P edf940ebcc1140cfa0c23214e0c0f179: failed to flush MRS: IO error: Failed to open DiskRowSet for flush: tablet 242a68df09cb4c7d9522a33d259ebf78: unable to open output file for column key INT32 NOT NULL: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in 242a68df09cb4c7d9522a33d259ebf78's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
F20260807 13:55:17.713413 5155 tablet_replica_mm_ops.cc:215] Check failed: tablet->HasBeenStopped() Unrecoverable flush failure caused by error: IO error: Failed to open DiskRowSet for flush: tablet 242a68df09cb4c7d9522a33d259ebf78: unable to open output file for column key INT32 NOT NULL: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in 242a68df09cb4c7d9522a33d259ebf78's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
*** Check failure stack trace: ***
@ 0x7f5322101d5d google::LogMessage::Fail() at ??:0
@ 0x7f5322105b23 google::LogMessage::SendToLog() at ??:0
@ 0x7f532210175c google::LogMessage::Flush() at ??:0
I20260807 13:55:17.733264 28606 ts_tablet_manager.cc:1916] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
@ 0x7f5322102ee9 google::LogMessageFatal::~LogMessageFatal() at ??:0
I20260807 13:55:17.755467 28944 ts_tablet_manager.cc:933] T 68717842b14e4f06b528c08a65acd3b7 P edf940ebcc1140cfa0c23214e0c0f179: Initiating tablet copy from peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
W20260807 13:55:17.756841 4631 consensus_peers.cc:597] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 13:55:17.764599 7273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.107.130:37489, user_credentials={real_user=slave}} blocked reactor thread for 44410.4us
I20260807 13:55:17.766543 28635 ts_tablet_manager.cc:933] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: Initiating tablet copy from peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
W20260807 13:55:17.768918 4631 consensus_peers.cc:597] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 13:55:17.773064 28944 tablet_copy_client.cc:323] T 68717842b14e4f06b528c08a65acd3b7 P edf940ebcc1140cfa0c23214e0c0f179: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.129:32841
I20260807 13:55:17.773909 4746 tablet_copy_service.cc:140] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Received BeginTabletCopySession request for tablet 68717842b14e4f06b528c08a65acd3b7 from peer edf940ebcc1140cfa0c23214e0c0f179 ({username='slave'} at 127.23.107.132:57653)
I20260807 13:55:17.774127 4746 tablet_copy_service.cc:171] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Re-sending initialization info for existing tablet copy session on tablet 68717842b14e4f06b528c08a65acd3b7 from peer edf940ebcc1140cfa0c23214e0c0f179 at {username='slave'} at 127.23.107.132:57653: session_id = edf940ebcc1140cfa0c23214e0c0f179-68717842b14e4f06b528c08a65acd3b7
W20260807 13:55:17.775949 28944 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-3/data/data (498847744 bytes available vs 518351011 bytes reserved) (error 28)
W20260807 13:55:17.776702 4632 consensus_peers.cc:576] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Unable to start Tablet Copy on peer: error { code: UNKNOWN_ERROR status { code: IO_ERROR message: "Init tablet metadata failed: Failed to create TabletMetadata: All healthy data directories are full" posix_code: 28 } }
I20260807 13:55:17.778962 28635 tablet_copy_client.cc:323] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: tablet copy: Beginning tablet copy session from remote peer at address 127.23.107.132:41217
I20260807 13:55:17.779744 5272 tablet_copy_service.cc:140] P edf940ebcc1140cfa0c23214e0c0f179: Received BeginTabletCopySession request for tablet e93615e4fb61416d8740ce61970610af from peer b77f2b2eade540c6bfd4f75e5229a3cd ({username='slave'} at 127.23.107.133:38087)
I20260807 13:55:17.779898 5272 tablet_copy_service.cc:161] P edf940ebcc1140cfa0c23214e0c0f179: Beginning new tablet copy session on tablet e93615e4fb61416d8740ce61970610af from peer b77f2b2eade540c6bfd4f75e5229a3cd at {username='slave'} at 127.23.107.133:38087: session id = b77f2b2eade540c6bfd4f75e5229a3cd-e93615e4fb61416d8740ce61970610af
I20260807 13:55:17.783258 5272 tablet_copy_source_session.cc:215] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:55:17.784710 28635 ts_tablet_manager.cc:1916] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: Deleting tablet data with delete state TABLET_DATA_COPYING
@ 0x7f533226a8bd kudu::tablet::FlushMRSOp::Perform() at ??:0
I20260807 13:55:17.798882 28606 ts_tablet_manager.cc:1929] T bdac11c33b2b486eb34bc93def74489c P edf940ebcc1140cfa0c23214e0c0f179: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.4
I20260807 13:55:17.806303 5129 maintenance_manager.cc:419] P 01adf83af3e04875b5fac9470d4da915: Scheduling FlushMRSOp(ffa98a163d7540e3a911a39334657138): perf score=0.033398
I20260807 13:55:17.811441 28635 ts_tablet_manager.cc:1929] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.8
W20260807 13:55:17.811689 28635 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/data (498814976 bytes available vs 518351011 bytes reserved) (error 28)
W20260807 13:55:17.812393 5153 consensus_peers.cc:576] T e93615e4fb61416d8740ce61970610af P edf940ebcc1140cfa0c23214e0c0f179 -> Peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): Unable to start Tablet Copy on peer: error { code: UNKNOWN_ERROR status { code: IO_ERROR message: "Init tablet metadata failed: Could not create a new directory group for tablet copy: All healthy data directories are full" posix_code: 28 } }
I20260807 13:55:17.819410 5272 tablet_copy_service.cc:342] P edf940ebcc1140cfa0c23214e0c0f179: Request end of tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-e93615e4fb61416d8740ce61970610af received from {username='slave'} at 127.23.107.133:38087
I20260807 13:55:17.819558 5272 tablet_copy_service.cc:434] P edf940ebcc1140cfa0c23214e0c0f179: ending tablet copy session b77f2b2eade540c6bfd4f75e5229a3cd-e93615e4fb61416d8740ce61970610af on tablet e93615e4fb61416d8740ce61970610af with peer b77f2b2eade540c6bfd4f75e5229a3cd
I20260807 13:55:17.820468 28635 ts_tablet_manager.cc:1916] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
@ 0x7f5324ed3b09 kudu::MaintenanceManager::LaunchOp() at ??:0
@ 0x7f5324ed6a43 kudu::MaintenanceManager::RunSchedulerThread()::$_3::operator()() at ??:0
@ 0x7f5324ed68d9 std::_Function_handler<>::_M_invoke() at ??:0
I20260807 13:55:17.844882 28635 ts_tablet_manager.cc:1929] T e93615e4fb61416d8740ce61970610af P b77f2b2eade540c6bfd4f75e5229a3cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
@ 0xaa68ad std::function<>::operator()() at ??:?
@ 0x7f5324e4a850 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f5324e4db4c kudu::ThreadPool::CreateThread()::$_1::operator()() at ??:0
I20260807 13:55:17.869143 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
@ 0x7f5324e4d9c9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa68ad std::function<>::operator()() at ??:?
I20260807 13:55:17.873310 4634 maintenance_manager.cc:643] P fa83b7af134b4e3b949ac3b4e4bcb5e7: FlushMRSOp(966ebd287fc14e498e5bd3e6542194ca) complete. Timing: real 0.180s user 0.064s sys 0.070s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":37853,"dirs.run_cpu_time_us":225,"dirs.run_wall_time_us":7683,"drs_written":1,"lbm_read_time_us":119,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2395,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":676,"thread_start_us":78907,"threads_started":2,"wal-append.queue_time_us":41278}
I20260807 13:55:17.874972 4779 maintenance_manager.cc:419] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Scheduling UndoDeltaBlockGCOp(966ebd287fc14e498e5bd3e6542194ca): 4840 bytes on disk
I20260807 13:55:17.876891 4634 maintenance_manager.cc:643] P fa83b7af134b4e3b949ac3b4e4bcb5e7: UndoDeltaBlockGCOp(966ebd287fc14e498e5bd3e6542194ca) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":133,"lbm_reads_lt_1ms":4}
I20260807 13:55:17.896435 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:17.898876 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
@ 0x7f5324e29dd9 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f53284f96db start_thread at ??:0
@ 0x7f5320fb061f clone at ??:0
I20260807 13:55:17.966441 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:17.977036 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:18.054538 4688 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
W20260807 13:55:18.076159 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:18.079893 4983 maintenance_manager.cc:643] P 01adf83af3e04875b5fac9470d4da915: FlushMRSOp(ffa98a163d7540e3a911a39334657138) complete. Timing: real 0.273s user 0.099s sys 0.076s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":31680,"dirs.run_cpu_time_us":217,"dirs.run_wall_time_us":2615,"drs_written":1,"lbm_read_time_us":77,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3623,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":21,"peak_mem_usage":0,"rows_written":635,"thread_start_us":136898,"threads_started":2,"wal-append.queue_time_us":105974}
I20260807 13:55:18.081400 5129 maintenance_manager.cc:419] P 01adf83af3e04875b5fac9470d4da915: Scheduling UndoDeltaBlockGCOp(ffa98a163d7540e3a911a39334657138): 4583 bytes on disk
I20260807 13:55:18.083448 4983 maintenance_manager.cc:643] P 01adf83af3e04875b5fac9470d4da915: UndoDeltaBlockGCOp(ffa98a163d7540e3a911a39334657138) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":107,"lbm_reads_lt_1ms":4}
W20260807 13:55:18.325361 7274 connection.cc:573] client connection to 127.23.107.132:41217 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 13:55:18.326486 7444 connection.cc:573] client connection to 127.23.107.132:41217 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 13:55:18.326608 7102 connection.cc:573] client connection to 127.23.107.132:41217 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 13:55:18.326972 4632 connection.cc:573] client connection to 127.23.107.132:41217 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 13:55:18.333238 7102 consensus_peers.cc:597] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:55:18.333463 7102 consensus_peers.cc:597] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:55:18.333993 4632 consensus_peers.cc:576] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
W20260807 13:55:18.334124 4632 consensus_peers.cc:576] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
W20260807 13:55:18.335028 7274 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:55:18.358772 7444 consensus_peers.cc:597] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:55:18.368657 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:18.370185 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:18.393898 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:18.411415 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:18.413906 4688 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260807 13:55:18.432303 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
W20260807 13:55:18.532475 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:18.608906 4631 consensus_peers.cc:597] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 13:55:18.755457 4632 consensus_peers.cc:576] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:18.776108 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:18.795125 5039 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:18.819476 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
W20260807 13:55:18.826653 4632 consensus_peers.cc:576] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:18.838285 5129 maintenance_manager.cc:419] P 01adf83af3e04875b5fac9470d4da915: Scheduling FlushMRSOp(eab259b597a64c04869543ccb1d9038c): perf score=0.033340
I20260807 13:55:18.843672 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:18.864144 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:18.881774 27792 raft_consensus.cc:493] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edf940ebcc1140cfa0c23214e0c0f179)
I20260807 13:55:18.882055 27792 raft_consensus.cc:515] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:55:18.883298 27792 leader_election.cc:290] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:55:18.885030 4779 maintenance_manager.cc:419] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Scheduling FlushMRSOp(d02aa7a26c024b4083421b5d742f7bcb): perf score=0.033359
I20260807 13:55:18.886790 5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80898a5a2cf046f1b7344dfceb175bbd" candidate_uuid: "31d7630573c8475a9f84978d4ebfb879" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "01adf83af3e04875b5fac9470d4da915" is_pre_election: true
W20260807 13:55:18.890513 7613 leader_election.cc:336] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:18.890640 7613 leader_election.cc:304] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31d7630573c8475a9f84978d4ebfb879; no voters: 01adf83af3e04875b5fac9470d4da915, edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:55:18.891342 27792 raft_consensus.cc:2749] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:55:18.891892 4981 consensus_peers.cc:597] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 13:55:18.900914 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:18.907423 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:18.923008 7327 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:18.951975 7669 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:18.965691 27792 raft_consensus.cc:493] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edf940ebcc1140cfa0c23214e0c0f179)
I20260807 13:55:18.965874 27792 raft_consensus.cc:515] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:55:18.966550 27792 leader_election.cc:290] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
W20260807 13:55:18.976440 7612 leader_election.cc:336] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:18.982043 7613 leader_election.cc:336] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:18.982410 7613 leader_election.cc:304] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31d7630573c8475a9f84978d4ebfb879; no voters: c9d2944272bc447dafce7620ac2dbd4b, edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:55:18.982993 27792 raft_consensus.cc:2749] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:19.007411 4634 maintenance_manager.cc:643] P fa83b7af134b4e3b949ac3b4e4bcb5e7: FlushMRSOp(d02aa7a26c024b4083421b5d742f7bcb) complete. Timing: real 0.122s user 0.057s sys 0.006s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":6420,"dirs.run_cpu_time_us":185,"dirs.run_wall_time_us":1485,"drs_written":1,"lbm_read_time_us":131,"lbm_reads_lt_1ms":4,"lbm_write_time_us":14022,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":689,"thread_start_us":12864,"threads_started":2,"wal-append.queue_time_us":6419}
I20260807 13:55:19.009447 4779 maintenance_manager.cc:419] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Scheduling UndoDeltaBlockGCOp(d02aa7a26c024b4083421b5d742f7bcb): 4923 bytes on disk
I20260807 13:55:19.011168 4634 maintenance_manager.cc:643] P fa83b7af134b4e3b949ac3b4e4bcb5e7: UndoDeltaBlockGCOp(d02aa7a26c024b4083421b5d742f7bcb) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":127,"lbm_reads_lt_1ms":4}
I20260807 13:55:19.019308 4688 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260807 13:55:19.033766 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:19.049149 27792 raft_consensus.cc:493] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edf940ebcc1140cfa0c23214e0c0f179)
I20260807 13:55:19.049520 27792 raft_consensus.cc:515] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:55:19.050635 27792 leader_election.cc:290] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975)
I20260807 13:55:19.052459 7354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a68df09cb4c7d9522a33d259ebf78" candidate_uuid: "31d7630573c8475a9f84978d4ebfb879" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "12ab71778f2f4b378765aaed1a0676a5" is_pre_election: true
W20260807 13:55:19.057428 7613 leader_election.cc:336] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:19.057624 7613 leader_election.cc:304] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31d7630573c8475a9f84978d4ebfb879; no voters: 12ab71778f2f4b378765aaed1a0676a5, edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:55:19.058302 27792 raft_consensus.cc:2749] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:55:19.093060 7612 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111) [suppressed 13 similar messages]
W20260807 13:55:19.094759 7612 consensus_peers.cc:597] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 13:55:19.096839 29055 raft_consensus.cc:493] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edf940ebcc1140cfa0c23214e0c0f179)
I20260807 13:55:19.097074 29055 raft_consensus.cc:515] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
W20260807 13:55:19.106619 7273 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111) [suppressed 12 similar messages]
I20260807 13:55:19.107750 28683 raft_consensus.cc:493] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edf940ebcc1140cfa0c23214e0c0f179)
W20260807 13:55:19.107980 7273 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 13:55:19.107934 28683 raft_consensus.cc:515] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:55:19.108781 28683 leader_election.cc:290] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729)
I20260807 13:55:19.109902 7690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80898a5a2cf046f1b7344dfceb175bbd" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "31d7630573c8475a9f84978d4ebfb879" is_pre_election: true
I20260807 13:55:19.110183 7690 raft_consensus.cc:2468] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 1.
I20260807 13:55:19.110971 4979 leader_election.cc:304] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, 31d7630573c8475a9f84978d4ebfb879; no voters:
I20260807 13:55:19.111757 27910 raft_consensus.cc:493] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edf940ebcc1140cfa0c23214e0c0f179)
W20260807 13:55:19.111821 4982 leader_election.cc:336] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:19.111976 28683 raft_consensus.cc:2804] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:55:19.111908 27910 raft_consensus.cc:515] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:55:19.112063 28683 raft_consensus.cc:493] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Starting leader election (detected failure of leader edf940ebcc1140cfa0c23214e0c0f179)
I20260807 13:55:19.112128 28683 raft_consensus.cc:3060] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:19.112591 27910 leader_election.cc:290] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729)
I20260807 13:55:19.113322 7690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a68df09cb4c7d9522a33d259ebf78" candidate_uuid: "12ab71778f2f4b378765aaed1a0676a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "31d7630573c8475a9f84978d4ebfb879" is_pre_election: true
I20260807 13:55:19.113550 7690 raft_consensus.cc:2468] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12ab71778f2f4b378765aaed1a0676a5 in term 1.
I20260807 13:55:19.113897 7271 leader_election.cc:304] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5, 31d7630573c8475a9f84978d4ebfb879; no voters:
I20260807 13:55:19.115254 28683 raft_consensus.cc:515] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:55:19.116369 7690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80898a5a2cf046f1b7344dfceb175bbd" candidate_uuid: "01adf83af3e04875b5fac9470d4da915" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "31d7630573c8475a9f84978d4ebfb879"
I20260807 13:55:19.116552 7690 raft_consensus.cc:3060] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:55:19.116626 7274 leader_election.cc:336] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
W20260807 13:55:19.117707 4982 leader_election.cc:336] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:19.117795 27910 raft_consensus.cc:2804] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:55:19.117888 27910 raft_consensus.cc:493] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader edf940ebcc1140cfa0c23214e0c0f179)
I20260807 13:55:19.118009 27910 raft_consensus.cc:3060] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:19.119639 7690 raft_consensus.cc:2468] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01adf83af3e04875b5fac9470d4da915 in term 2.
I20260807 13:55:19.120209 4979 leader_election.cc:304] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01adf83af3e04875b5fac9470d4da915, 31d7630573c8475a9f84978d4ebfb879; no voters: edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:55:19.120498 28906 raft_consensus.cc:2804] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:55:19.120620 28683 leader_election.cc:290] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [CANDIDATE]: Term 2 election: Requested vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729)
I20260807 13:55:19.121006 27910 raft_consensus.cc:515] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:55:19.122229 4688 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
W20260807 13:55:19.123828 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:19.123799 7690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a68df09cb4c7d9522a33d259ebf78" candidate_uuid: "12ab71778f2f4b378765aaed1a0676a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "31d7630573c8475a9f84978d4ebfb879"
I20260807 13:55:19.124009 7690 raft_consensus.cc:3060] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:19.126137 27910 leader_election.cc:290] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 election: Requested vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729)
I20260807 13:55:19.127802 7690 raft_consensus.cc:2468] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12ab71778f2f4b378765aaed1a0676a5 in term 2.
I20260807 13:55:19.128300 7271 leader_election.cc:304] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5, 31d7630573c8475a9f84978d4ebfb879; no voters:
I20260807 13:55:19.128816 27910 raft_consensus.cc:2804] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Leader election won for term 2
W20260807 13:55:19.130483 7274 leader_election.cc:336] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:19.135663 27910 raft_consensus.cc:697] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 LEADER]: Becoming Leader. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Running, Role: LEADER
I20260807 13:55:19.136076 27910 consensus_queue.cc:237] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
W20260807 13:55:19.142151 4632 consensus_peers.cc:576] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:19.145743 28906 raft_consensus.cc:697] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [term 2 LEADER]: Becoming Leader. State: Replica: 01adf83af3e04875b5fac9470d4da915, State: Running, Role: LEADER
I20260807 13:55:19.146276 28906 consensus_queue.cc:237] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:55:19.148763 29055 leader_election.cc:290] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075)
W20260807 13:55:19.158718 7443 leader_election.cc:336] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:19.161110 7444 leader_election.cc:336] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:19.161267 7444 leader_election.cc:304] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4; no voters: c9d2944272bc447dafce7620ac2dbd4b, edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:55:19.161572 29055 raft_consensus.cc:2749] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:19.165639 7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93615e4fb61416d8740ce61970610af" candidate_uuid: "8a9903f009ff46b4a6875490823076c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" is_pre_election: true
W20260807 13:55:19.166994 7443 leader_election.cc:343] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): Illegal state: cannot vote while shut down
I20260807 13:55:19.174216 4511 catalog_manager.cc:5697] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 reported cstate change: term changed from 1 to 2, leader changed from edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) to 01adf83af3e04875b5fac9470d4da915 (127.23.107.131). New cstate: current_term: 2 leader_uuid: "01adf83af3e04875b5fac9470d4da915" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } }
W20260807 13:55:19.202808 4631 consensus_peers.cc:597] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 13:55:19.205484 4511 catalog_manager.cc:5697] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: term changed from 1 to 2, leader changed from edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) to 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134). New cstate: current_term: 2 leader_uuid: "12ab71778f2f4b378765aaed1a0676a5" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
W20260807 13:55:19.225693 7102 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111) [suppressed 15 similar messages]
W20260807 13:55:19.241045 4632 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111) [suppressed 59 similar messages]
I20260807 13:55:19.245321 27792 raft_consensus.cc:493] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edf940ebcc1140cfa0c23214e0c0f179)
I20260807 13:55:19.245615 27792 raft_consensus.cc:515] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:55:19.246573 27792 leader_election.cc:290] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075)
I20260807 13:55:19.248113 7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c10b910e9f354933b60ae70f1baa9b6f" candidate_uuid: "31d7630573c8475a9f84978d4ebfb879" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" is_pre_election: true
I20260807 13:55:19.248486 7178 raft_consensus.cc:2468] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31d7630573c8475a9f84978d4ebfb879 in term 1.
I20260807 13:55:19.250203 7612 leader_election.cc:304] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31d7630573c8475a9f84978d4ebfb879, b77f2b2eade540c6bfd4f75e5229a3cd; no voters:
W20260807 13:55:19.252709 7613 leader_election.cc:336] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
W20260807 13:55:19.253913 4632 consensus_peers.cc:576] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:19.254688 27792 raft_consensus.cc:2804] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:55:19.254824 27792 raft_consensus.cc:493] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Starting leader election (detected failure of leader edf940ebcc1140cfa0c23214e0c0f179)
I20260807 13:55:19.254969 27792 raft_consensus.cc:3060] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:19.262357 27792 raft_consensus.cc:515] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:55:19.270098 27792 leader_election.cc:290] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 election: Requested vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075)
I20260807 13:55:19.271474 7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c10b910e9f354933b60ae70f1baa9b6f" candidate_uuid: "31d7630573c8475a9f84978d4ebfb879" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd"
I20260807 13:55:19.271797 7179 raft_consensus.cc:3060] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:19.280586 7179 raft_consensus.cc:2468] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31d7630573c8475a9f84978d4ebfb879 in term 2.
I20260807 13:55:19.281141 7612 leader_election.cc:304] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31d7630573c8475a9f84978d4ebfb879, b77f2b2eade540c6bfd4f75e5229a3cd; no voters:
I20260807 13:55:19.281598 27792 raft_consensus.cc:2804] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:55:19.284797 27792 raft_consensus.cc:697] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 [term 2 LEADER]: Becoming Leader. State: Replica: 31d7630573c8475a9f84978d4ebfb879, State: Running, Role: LEADER
I20260807 13:55:19.285125 27792 consensus_queue.cc:237] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
W20260807 13:55:19.286228 7613 leader_election.cc:336] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:19.290035 28657 raft_consensus.cc:493] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edf940ebcc1140cfa0c23214e0c0f179)
I20260807 13:55:19.290212 28657 raft_consensus.cc:515] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:55:19.290932 28657 leader_election.cc:290] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975)
I20260807 13:55:19.292014 7354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1715828a5d96455abecae985d1dca004" candidate_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "12ab71778f2f4b378765aaed1a0676a5" is_pre_election: true
W20260807 13:55:19.293062 7102 leader_election.cc:336] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:19.293226 7102 leader_election.cc:304] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b77f2b2eade540c6bfd4f75e5229a3cd; no voters: 12ab71778f2f4b378765aaed1a0676a5, edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:55:19.293684 28657 raft_consensus.cc:2749] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:19.297869 4983 maintenance_manager.cc:643] P 01adf83af3e04875b5fac9470d4da915: FlushMRSOp(eab259b597a64c04869543ccb1d9038c) complete. Timing: real 0.459s user 0.089s sys 0.028s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":487,"dirs.run_cpu_time_us":241,"dirs.run_wall_time_us":1344,"drs_written":1,"lbm_read_time_us":73,"lbm_reads_lt_1ms":4,"lbm_write_time_us":806,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":53622,"threads_started":2,"wal-append.queue_time_us":45114}
I20260807 13:55:19.302407 5129 maintenance_manager.cc:419] P 01adf83af3e04875b5fac9470d4da915: Scheduling UndoDeltaBlockGCOp(eab259b597a64c04869543ccb1d9038c): 4840 bytes on disk
I20260807 13:55:19.303231 4983 maintenance_manager.cc:643] P 01adf83af3e04875b5fac9470d4da915: UndoDeltaBlockGCOp(eab259b597a64c04869543ccb1d9038c) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":98,"lbm_reads_lt_1ms":4}
I20260807 13:55:19.306041 4511 catalog_manager.cc:5697] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 reported cstate change: term changed from 1 to 2, leader changed from edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) to 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136). New cstate: current_term: 2 leader_uuid: "31d7630573c8475a9f84978d4ebfb879" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
W20260807 13:55:19.319862 4981 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111) [suppressed 22 similar messages]
I20260807 13:55:19.383567 27910 raft_consensus.cc:493] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edf940ebcc1140cfa0c23214e0c0f179)
I20260807 13:55:19.383813 27910 raft_consensus.cc:515] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:55:19.384980 27910 leader_election.cc:290] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075)
I20260807 13:55:19.385743 7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1715828a5d96455abecae985d1dca004" candidate_uuid: "12ab71778f2f4b378765aaed1a0676a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" is_pre_election: true
I20260807 13:55:19.386040 7179 raft_consensus.cc:2468] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12ab71778f2f4b378765aaed1a0676a5 in term 1.
I20260807 13:55:19.386598 7273 leader_election.cc:304] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5, b77f2b2eade540c6bfd4f75e5229a3cd; no voters:
I20260807 13:55:19.386910 27910 raft_consensus.cc:2804] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:55:19.387003 27910 raft_consensus.cc:493] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader edf940ebcc1140cfa0c23214e0c0f179)
I20260807 13:55:19.387084 27910 raft_consensus.cc:3060] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:55:19.387166 7274 leader_election.cc:336] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:19.391134 27910 raft_consensus.cc:515] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
W20260807 13:55:19.394582 7274 leader_election.cc:336] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:19.395732 7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1715828a5d96455abecae985d1dca004" candidate_uuid: "12ab71778f2f4b378765aaed1a0676a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd"
I20260807 13:55:19.396025 7179 raft_consensus.cc:3060] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:19.402341 7179 raft_consensus.cc:2468] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12ab71778f2f4b378765aaed1a0676a5 in term 2.
I20260807 13:55:19.403036 7273 leader_election.cc:304] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5, b77f2b2eade540c6bfd4f75e5229a3cd; no voters: edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:55:19.403393 29167 raft_consensus.cc:2804] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:55:19.403388 27910 leader_election.cc:290] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 election: Requested vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075)
I20260807 13:55:19.442464 29167 raft_consensus.cc:697] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 LEADER]: Becoming Leader. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Running, Role: LEADER
I20260807 13:55:19.442898 29167 consensus_queue.cc:237] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:55:19.451846 4511 catalog_manager.cc:5697] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: term changed from 1 to 2, leader changed from edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132) to 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134). New cstate: current_term: 2 leader_uuid: "12ab71778f2f4b378765aaed1a0676a5" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:55:19.461215 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:55:19.501099 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
W20260807 13:55:19.559859 4632 consensus_peers.cc:576] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:19.564469 7669 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:19.587599 7327 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:19.590394 4688 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
W20260807 13:55:19.605605 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:19.616968 7690 raft_consensus.cc:1275] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Refusing update from remote peer 01adf83af3e04875b5fac9470d4da915: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260807 13:55:19.619192 28906 consensus_queue.cc:1048] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:55:19.645186 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260807 13:55:19.670900 4982 consensus_peers.cc:597] T 80898a5a2cf046f1b7344dfceb175bbd P 01adf83af3e04875b5fac9470d4da915 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:55:19.699254 4981 consensus_peers.cc:597] T ffa98a163d7540e3a911a39334657138 P 01adf83af3e04875b5fac9470d4da915 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 13:55:19.707962 7274 consensus_peers.cc:597] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:55:19.723580 4632 consensus_peers.cc:576] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
W20260807 13:55:19.729202 7613 consensus_peers.cc:597] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:55:19.731825 7179 raft_consensus.cc:1275] T c10b910e9f354933b60ae70f1baa9b6f P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Refusing update from remote peer 31d7630573c8475a9f84978d4ebfb879: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260807 13:55:19.732626 27792 consensus_queue.cc:1048] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:55:19.758582 7690 raft_consensus.cc:1275] T 242a68df09cb4c7d9522a33d259ebf78 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260807 13:55:19.761291 29167 consensus_queue.cc:1048] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:55:19.893633 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:55:19.897055 7327 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:19.931393 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:19.931473 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:19.951627 7669 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
W20260807 13:55:19.958061 4632 consensus_peers.cc:576] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
W20260807 13:55:19.980333 4631 consensus_peers.cc:597] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 13:55:19.992009 7274 consensus_peers.cc:597] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:55:19.996793 7179 raft_consensus.cc:1275] T 1715828a5d96455abecae985d1dca004 P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
I20260807 13:55:19.997568 29167 consensus_queue.cc:1048] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260807 13:55:20.058517 5129 maintenance_manager.cc:419] P 01adf83af3e04875b5fac9470d4da915: Scheduling FlushMRSOp(faef317e47a244c6965864f82f21edfa): perf score=0.033368
I20260807 13:55:20.062886 4688 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
W20260807 13:55:20.083060 7444 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111) [suppressed 7 similar messages]
W20260807 13:55:20.119514 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:20.131366 7748 rebalancer_tool-test.cc:1258] rebalancer run info: Runtime error: /tmp/dist-test-task2KnpY3/build/asan/bin/kudu: process exited with non-zero status 1
stdout: Per-server replica distribution summary:
Statistic | Value
-----------------------+-----------
Minimum Replica Count | 0
Maximum Replica Count | 23
Average Replica Count | 11.250000
Per-table replica distribution summary:
Replica Skew | Value
--------------+----------
Minimum | 3
Maximum | 3
Average | 3.000000
stderr: W20260807 13:53:25.433614 7752 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:25.434054 7752 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260807 13:53:29.610848 7752 rebalancer_tool.cc:215] running whole-cluster rebalancing
W20260807 13:53:31.798583 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 96e83925faa542ffa4808b01a5adbbb3: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:31.800709 7752 rebalancer_tool.cc:1212] table b6c061acc30c4e5aa6bee1f054e3a59a: no follower replicas available on c9d2944272bc447dafce7620ac2dbd4b, falling back to leader replicas
W20260807 13:53:31.801090 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 6008038c907645199b055dacb5772621: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:31.801313 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 2ff801ea568346e096cc895a279c109c: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:31.801512 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c2c7db1795a1414c8299bebbeaf60404: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:31.801667 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 35d13981f3a742dd9369d1e7bf18498c: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:31.801831 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 2ff801ea568346e096cc895a279c109c: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:31.802024 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b6c061acc30c4e5aa6bee1f054e3a59a: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:31.802201 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e242e42da20d4458a49a269a9569307a: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:31.802338 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 14867b014aab43119171102f60bb134d: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:31.802459 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 14867b014aab43119171102f60bb134d: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:31.802625 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 7f1d26639edd4cb398339b2b0d3659a3: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:31.802724 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 91303cf8b9064e06b8c4165942b287f2: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:31.802850 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 91303cf8b9064e06b8c4165942b287f2: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:31.802946 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e242e42da20d4458a49a269a9569307a: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:31.807071 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 96e83925faa542ffa4808b01a5adbbb3: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:31.807237 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c2c7db1795a1414c8299bebbeaf60404: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 31d7630573c8475a9f84978d4ebfb879
I20260807 13:53:32.175436 7752 rebalancer_tool.cc:1090] tablet 541201ddfdf041ed87b3d0e731763a37: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> 'b77f2b2eade540c6bfd4f75e5229a3cd' move scheduled
I20260807 13:53:32.619443 7752 rebalancer_tool.cc:1090] tablet 96bc42d66fa04fb69afa630969dbb579: '01adf83af3e04875b5fac9470d4da915' -> '31d7630573c8475a9f84978d4ebfb879' move scheduled
I20260807 13:53:33.390755 7752 rebalancer_tool.cc:1100] tablet 68717842b14e4f06b528c08a65acd3b7: 'c9d2944272bc447dafce7620ac2dbd4b' -> '12ab71778f2f4b378765aaed1a0676a5' move ignored: Illegal state: Request specified cas_config_opid_index of -1 but the committed config has opid_index of 4
I20260807 13:53:33.390946 7752 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260807 13:53:35.380378 7752 rebalancer_tool.cc:1212] table b6c061acc30c4e5aa6bee1f054e3a59a: no follower replicas available on c9d2944272bc447dafce7620ac2dbd4b, falling back to leader replicas
W20260807 13:53:35.380559 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b6c061acc30c4e5aa6bee1f054e3a59a: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:35.380767 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 2ff801ea568346e096cc895a279c109c: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:35.380973 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 96e83925faa542ffa4808b01a5adbbb3: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:35.381199 7752 rebalancer_tool.cc:1212] table e242e42da20d4458a49a269a9569307a: no follower replicas available on edf940ebcc1140cfa0c23214e0c0f179, falling back to leader replicas
W20260807 13:53:35.381270 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e242e42da20d4458a49a269a9569307a: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:35.381834 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 91303cf8b9064e06b8c4165942b287f2: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:35.382040 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 91303cf8b9064e06b8c4165942b287f2: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:35.382140 7752 rebalancer_tool.cc:1212] table b6c061acc30c4e5aa6bee1f054e3a59a: no follower replicas available on c9d2944272bc447dafce7620ac2dbd4b, falling back to leader replicas
W20260807 13:53:35.382201 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b6c061acc30c4e5aa6bee1f054e3a59a: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:35.382294 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e242e42da20d4458a49a269a9569307a: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:35.382382 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 14867b014aab43119171102f60bb134d: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:35.382514 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c2c7db1795a1414c8299bebbeaf60404: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:35.382613 7752 rebalancer_tool.cc:1212] table 35d13981f3a742dd9369d1e7bf18498c: no follower replicas available on edf940ebcc1140cfa0c23214e0c0f179, falling back to leader replicas
W20260807 13:53:35.382747 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c2c7db1795a1414c8299bebbeaf60404: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:35.382844 7752 rebalancer_tool.cc:1212] table b6c061acc30c4e5aa6bee1f054e3a59a: no follower replicas available on edf940ebcc1140cfa0c23214e0c0f179, falling back to leader replicas
W20260807 13:53:35.382925 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b6c061acc30c4e5aa6bee1f054e3a59a: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:35.383001 7752 rebalancer_tool.cc:1212] table 35d13981f3a742dd9369d1e7bf18498c: no follower replicas available on c9d2944272bc447dafce7620ac2dbd4b, falling back to leader replicas
W20260807 13:53:35.383091 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 35d13981f3a742dd9369d1e7bf18498c: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:35.383212 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 14867b014aab43119171102f60bb134d: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:53:35.557497 7752 rebalancer_tool.cc:1090] tablet 68717842b14e4f06b528c08a65acd3b7: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:53:36.085742 7752 rebalancer_tool.cc:1090] tablet eab259b597a64c04869543ccb1d9038c: 'edf940ebcc1140cfa0c23214e0c0f179' -> '12ab71778f2f4b378765aaed1a0676a5' move scheduled
I20260807 13:53:36.546002 7752 rebalancer_tool.cc:1090] tablet e93615e4fb61416d8740ce61970610af: '01adf83af3e04875b5fac9470d4da915' -> '8a9903f009ff46b4a6875490823076c4' move scheduled
I20260807 13:53:37.159654 7752 rebalancer_tool.cc:1100] tablet 242a68df09cb4c7d9522a33d259ebf78: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '31d7630573c8475a9f84978d4ebfb879' move ignored: Illegal state: Request specified cas_config_opid_index of -1 but the committed config has opid_index of 4
I20260807 13:53:37.159792 7752 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260807 13:53:39.098519 7752 rebalancer_tool.cc:1212] table 91303cf8b9064e06b8c4165942b287f2: no follower replicas available on fa83b7af134b4e3b949ac3b4e4bcb5e7, falling back to leader replicas
W20260807 13:53:39.099036 7752 rebalancer_tool.cc:1212] table b6c061acc30c4e5aa6bee1f054e3a59a: no follower replicas available on c9d2944272bc447dafce7620ac2dbd4b, falling back to leader replicas
W20260807 13:53:39.099236 7752 rebalancer_tool.cc:1212] table 35d13981f3a742dd9369d1e7bf18498c: no follower replicas available on edf940ebcc1140cfa0c23214e0c0f179, falling back to leader replicas
W20260807 13:53:39.099408 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 96e83925faa542ffa4808b01a5adbbb3: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:39.099582 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 91303cf8b9064e06b8c4165942b287f2: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:39.100000 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 14867b014aab43119171102f60bb134d: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:39.100311 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 7f1d26639edd4cb398339b2b0d3659a3: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:39.100472 7752 rebalancer_tool.cc:1212] table 91303cf8b9064e06b8c4165942b287f2: no follower replicas available on fa83b7af134b4e3b949ac3b4e4bcb5e7, falling back to leader replicas
W20260807 13:53:39.100586 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 91303cf8b9064e06b8c4165942b287f2: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:39.100744 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e242e42da20d4458a49a269a9569307a: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:53:39.405825 7752 rebalancer_tool.cc:1090] tablet 242a68df09cb4c7d9522a33d259ebf78: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move scheduled
I20260807 13:53:39.778599 7752 rebalancer_tool.cc:1090] tablet faef317e47a244c6965864f82f21edfa: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '8a9903f009ff46b4a6875490823076c4' move scheduled
I20260807 13:53:39.924424 7752 rebalancer_tool.cc:1090] tablet d27ce55f2acc4513a9fd90a338098eeb: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:53:40.370376 7752 rebalancer_tool.cc:1100] tablet 739f4f0207104455bf3e87bc04f8d13c: 'edf940ebcc1140cfa0c23214e0c0f179' -> '12ab71778f2f4b378765aaed1a0676a5' move ignored: Illegal state: Request specified cas_config_opid_index of -1 but the committed config has opid_index of 4
I20260807 13:53:40.370560 7752 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260807 13:53:42.303021 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 96e83925faa542ffa4808b01a5adbbb3: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:42.303282 7752 rebalancer_tool.cc:1212] table b6c061acc30c4e5aa6bee1f054e3a59a: no follower replicas available on c9d2944272bc447dafce7620ac2dbd4b, falling back to leader replicas
W20260807 13:53:42.303485 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 2ff801ea568346e096cc895a279c109c: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:42.303598 7752 rebalancer_tool.cc:1212] table 35d13981f3a742dd9369d1e7bf18498c: no follower replicas available on edf940ebcc1140cfa0c23214e0c0f179, falling back to leader replicas
W20260807 13:53:42.303761 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 6008038c907645199b055dacb5772621: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:42.303864 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 14867b014aab43119171102f60bb134d: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:42.303998 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e242e42da20d4458a49a269a9569307a: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 8a9903f009ff46b4a6875490823076c4
I20260807 13:53:42.506610 7752 rebalancer_tool.cc:1090] tablet 966ebd287fc14e498e5bd3e6542194ca: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move scheduled
I20260807 13:53:42.592640 7752 rebalancer_tool.cc:1090] tablet a29bfc37eabb411f845203c281444086: '01adf83af3e04875b5fac9470d4da915' -> '' move scheduled
I20260807 13:53:57.780230 7752 rebalancer_tool.cc:1139] tablet 541201ddfdf041ed87b3d0e731763a37: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> 'b77f2b2eade540c6bfd4f75e5229a3cd' move is abandoned: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }.
Pending config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:54:02.312618 7752 rebalancer_tool.cc:1152] tablet e93615e4fb61416d8740ce61970610af: '01adf83af3e04875b5fac9470d4da915' -> '8a9903f009ff46b4a6875490823076c4' move completed: OK
I20260807 13:54:02.473724 7752 rebalancer_tool.cc:1152] tablet d27ce55f2acc4513a9fd90a338098eeb: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
I20260807 13:54:04.848361 7752 rebalancer_tool.cc:1090] tablet 81cbb42cd4954383976169ec16ef2416: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:54:04.897123 7752 rebalancer_tool.cc:1152] tablet a29bfc37eabb411f845203c281444086: '01adf83af3e04875b5fac9470d4da915' -> '' move completed: OK
I20260807 13:54:04.956866 7752 rebalancer_tool.cc:1152] tablet faef317e47a244c6965864f82f21edfa: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '8a9903f009ff46b4a6875490823076c4' move completed: OK
I20260807 13:54:05.017184 7752 rebalancer_tool.cc:1152] tablet 96bc42d66fa04fb69afa630969dbb579: '01adf83af3e04875b5fac9470d4da915' -> '31d7630573c8475a9f84978d4ebfb879' move completed: OK
I20260807 13:54:05.089403 7752 rebalancer_tool.cc:1152] tablet 81cbb42cd4954383976169ec16ef2416: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
I20260807 13:54:05.259212 7752 rebalancer_tool.cc:1152] tablet 966ebd287fc14e498e5bd3e6542194ca: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move completed: OK
I20260807 13:54:05.449620 7752 rebalancer_tool.cc:1152] tablet 68717842b14e4f06b528c08a65acd3b7: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
I20260807 13:54:05.654479 7752 rebalancer_tool.cc:1152] tablet eab259b597a64c04869543ccb1d9038c: 'edf940ebcc1140cfa0c23214e0c0f179' -> '12ab71778f2f4b378765aaed1a0676a5' move completed: OK
I20260807 13:54:05.804198 7752 rebalancer_tool.cc:1152] tablet 242a68df09cb4c7d9522a33d259ebf78: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move completed: OK
I20260807 13:54:05.944088 7752 rebalancer_tool.cc:1090] tablet d02aa7a26c024b4083421b5d742f7bcb: '01adf83af3e04875b5fac9470d4da915' -> '' move scheduled
I20260807 13:54:06.017525 7752 rebalancer_tool.cc:1090] tablet 43f5461808a646c885d593f782538930: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:54:06.047236 7752 rebalancer_tool.cc:1090] tablet 782ac4fa94fb4183940fca514cc068b0: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move scheduled
I20260807 13:54:06.117452 7752 rebalancer_tool.cc:1090] tablet 16afb6ff06704a8795f1de84ffa81de0: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move scheduled
I20260807 13:54:06.235265 7752 rebalancer_tool.cc:1090] tablet 0c1327c8461e44f2ac5d77f10c390eeb: '01adf83af3e04875b5fac9470d4da915' -> '' move scheduled
I20260807 13:54:06.393141 7752 rebalancer_tool.cc:1152] tablet 0c1327c8461e44f2ac5d77f10c390eeb: '01adf83af3e04875b5fac9470d4da915' -> '' move completed: OK
I20260807 13:54:06.516458 7752 rebalancer_tool.cc:1152] tablet 16afb6ff06704a8795f1de84ffa81de0: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move completed: OK
I20260807 13:54:06.828269 7752 rebalancer_tool.cc:1152] tablet 782ac4fa94fb4183940fca514cc068b0: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move completed: OK
I20260807 13:54:09.315147 7752 rebalancer_tool.cc:1152] tablet d02aa7a26c024b4083421b5d742f7bcb: '01adf83af3e04875b5fac9470d4da915' -> '' move completed: OK
I20260807 13:54:09.416452 7752 rebalancer_tool.cc:1090] tablet 04dac80fea124c25b34af8cc290c0d7f: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move scheduled
I20260807 13:54:09.528615 7752 rebalancer_tool.cc:1090] tablet bdac11c33b2b486eb34bc93def74489c: '01adf83af3e04875b5fac9470d4da915' -> '' move scheduled
I20260807 13:54:09.652776 7752 rebalancer_tool.cc:1090] tablet 069a5f0089b24a609b27d4a07a3c4353: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:54:09.843046 7752 rebalancer_tool.cc:1090] tablet 1715828a5d96455abecae985d1dca004: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move scheduled
I20260807 13:54:09.954717 7752 rebalancer_tool.cc:1152] tablet 1715828a5d96455abecae985d1dca004: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move completed: OK
I20260807 13:54:11.264670 7752 rebalancer_tool.cc:1152] tablet 04dac80fea124c25b34af8cc290c0d7f: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move completed: OK
I20260807 13:54:11.407274 7752 rebalancer_tool.cc:1152] tablet bdac11c33b2b486eb34bc93def74489c: '01adf83af3e04875b5fac9470d4da915' -> '' move completed: OK
I20260807 13:54:13.672787 7752 rebalancer_tool.cc:1090] tablet b414c896ad884facb339e5e4a0329065: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move scheduled
I20260807 13:54:13.814148 7752 rebalancer_tool.cc:1090] tablet c10b910e9f354933b60ae70f1baa9b6f: '01adf83af3e04875b5fac9470d4da915' -> '' move scheduled
I20260807 13:54:13.895315 7752 rebalancer_tool.cc:1090] tablet 522c3523f2af4eb29e30fa55da2acd3e: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move scheduled
I20260807 13:54:13.981660 7752 rebalancer_tool.cc:1152] tablet 522c3523f2af4eb29e30fa55da2acd3e: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move completed: OK
I20260807 13:54:18.497726 7752 rebalancer_tool.cc:1152] tablet 069a5f0089b24a609b27d4a07a3c4353: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
I20260807 13:54:18.654567 7752 rebalancer_tool.cc:1152] tablet c10b910e9f354933b60ae70f1baa9b6f: '01adf83af3e04875b5fac9470d4da915' -> '' move completed: OK
I20260807 13:54:18.841605 7752 rebalancer_tool.cc:1152] tablet 43f5461808a646c885d593f782538930: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
I20260807 13:54:18.952013 7752 rebalancer_tool.cc:1090] tablet 80898a5a2cf046f1b7344dfceb175bbd: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:54:19.030097 7752 rebalancer_tool.cc:1090] tablet ffa98a163d7540e3a911a39334657138: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move scheduled
I20260807 13:54:19.160622 7752 rebalancer_tool.cc:1152] tablet ffa98a163d7540e3a911a39334657138: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move completed: OK
I20260807 13:54:19.387858 7752 rebalancer_tool.cc:1152] tablet 80898a5a2cf046f1b7344dfceb175bbd: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
I20260807 13:54:19.450897 7752 rebalancer_tool.cc:1152] tablet b414c896ad884facb339e5e4a0329065: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move completed: OK
W20260807 13:54:21.286516 7752 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 96e83925faa542ffa4808b01a5adbbb3: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:54:21.294100 7752 rebalancer_tool.cc:1212] table 2ff801ea568346e096cc895a279c109c: no follower replicas available on 01adf83af3e04875b5fac9470d4da915, falling back to leader replicas
I20260807 13:54:22.188129 7752 rebalancer_tool.cc:1090] tablet 43f5461808a646c885d593f782538930: '8a9903f009ff46b4a6875490823076c4' -> '12ab71778f2f4b378765aaed1a0676a5' move scheduled
I20260807 13:54:22.242828 7752 rebalancer_tool.cc:1100] tablet 966ebd287fc14e498e5bd3e6542194ca: '01adf83af3e04875b5fac9470d4da915' -> 'c9d2944272bc447dafce7620ac2dbd4b' move ignored: Illegal state: tablet 966ebd287fc14e498e5bd3e6542194ca: replica c9d2944272bc447dafce7620ac2dbd4b is already present
I20260807 13:54:22.242981 7752 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260807 13:54:24.847618 7752 rebalancer_tool.cc:1212] table 2ff801ea568346e096cc895a279c109c: no follower replicas available on 01adf83af3e04875b5fac9470d4da915, falling back to leader replicas
I20260807 13:54:25.299961 7752 rebalancer_tool.cc:1090] tablet e22d4edb78d24783bae07928b6c95fc2: '01adf83af3e04875b5fac9470d4da915' -> 'c9d2944272bc447dafce7620ac2dbd4b' move scheduled
I20260807 13:54:25.385696 7752 rebalancer_tool.cc:1100] tablet 50a090faa58e4f91961c9251030efacf: '31d7630573c8475a9f84978d4ebfb879' -> 'fa83b7af134b4e3b949ac3b4e4bcb5e7' move ignored: Illegal state: tablet 50a090faa58e4f91961c9251030efacf: replica fa83b7af134b4e3b949ac3b4e4bcb5e7 is already present
I20260807 13:54:25.385833 7752 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260807 13:54:27.630990 7752 rebalancer_tool.cc:1212] table b6c061acc30c4e5aa6bee1f054e3a59a: no follower replicas available on 12ab71778f2f4b378765aaed1a0676a5, falling back to leader replicas
I20260807 13:54:27.769718 7752 rebalancer_tool.cc:1090] tablet faef317e47a244c6965864f82f21edfa: '31d7630573c8475a9f84978d4ebfb879' -> '' move scheduled
I20260807 13:54:28.408142 7752 rebalancer_tool.cc:1090] tablet 04dac80fea124c25b34af8cc290c0d7f: '12ab71778f2f4b378765aaed1a0676a5' -> 'edf940ebcc1140cfa0c23214e0c0f179' move scheduled
I20260807 13:54:28.611280 7752 rebalancer_tool.cc:1100] tablet 242a68df09cb4c7d9522a33d259ebf78: '01adf83af3e04875b5fac9470d4da915' -> '12ab71778f2f4b378765aaed1a0676a5' move ignored: Illegal state: tablet 242a68df09cb4c7d9522a33d259ebf78: replica 12ab71778f2f4b378765aaed1a0676a5 is already present
I20260807 13:54:28.611474 7752 rebalancer_tool.cc:772] re-synchronizing cluster state
I20260807 13:54:31.391884 7752 rebalancer_tool.cc:1090] tablet 966ebd287fc14e498e5bd3e6542194ca: '01adf83af3e04875b5fac9470d4da915' -> 'c9d2944272bc447dafce7620ac2dbd4b' move scheduled
I20260807 13:54:31.507449 7752 rebalancer_tool.cc:1090] tablet 782ac4fa94fb4183940fca514cc068b0: '12ab71778f2f4b378765aaed1a0676a5' -> '' move scheduled
I20260807 13:54:32.185001 7752 rebalancer_tool.cc:1090] tablet 739f4f0207104455bf3e87bc04f8d13c: '12ab71778f2f4b378765aaed1a0676a5' -> 'c9d2944272bc447dafce7620ac2dbd4b' move scheduled
I20260807 13:54:37.694273 7752 rebalancer_tool.cc:1152] tablet 966ebd287fc14e498e5bd3e6542194ca: '01adf83af3e04875b5fac9470d4da915' -> 'c9d2944272bc447dafce7620ac2dbd4b' move completed: Incomplete: tablet 966ebd287fc14e498e5bd3e6542194ca, TS 01adf83af3e04875b5fac9470d4da915 -> TS c9d2944272bc447dafce7620ac2dbd4b move failed, target replica disappeared
I20260807 13:54:37.852227 7752 rebalancer_tool.cc:1152] tablet 04dac80fea124c25b34af8cc290c0d7f: '12ab71778f2f4b378765aaed1a0676a5' -> 'edf940ebcc1140cfa0c23214e0c0f179' move completed: OK
I20260807 13:54:43.233145 7752 rebalancer_tool.cc:1152] tablet 43f5461808a646c885d593f782538930: '8a9903f009ff46b4a6875490823076c4' -> '12ab71778f2f4b378765aaed1a0676a5' move completed: Incomplete: tablet 43f5461808a646c885d593f782538930, TS 8a9903f009ff46b4a6875490823076c4 -> TS 12ab71778f2f4b378765aaed1a0676a5 move failed, target replica disappeared
I20260807 13:54:43.509107 7752 rebalancer_tool.cc:1152] tablet 739f4f0207104455bf3e87bc04f8d13c: '12ab71778f2f4b378765aaed1a0676a5' -> 'c9d2944272bc447dafce7620ac2dbd4b' move completed: OK
I20260807 13:54:
I20260807 13:55:20.156185 4983 maintenance_manager.cc:643] P 01adf83af3e04875b5fac9470d4da915: FlushMRSOp(faef317e47a244c6965864f82f21edfa) complete. Timing: real 0.097s user 0.061s sys 0.011s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":18201,"dirs.run_cpu_time_us":214,"dirs.run_wall_time_us":1396,"drs_written":1,"lbm_read_time_us":141,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1443,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":18579,"threads_started":2,"wal-append.queue_time_us":608}
I20260807 13:55:20.157704 5129 maintenance_manager.cc:419] P 01adf83af3e04875b5fac9470d4da915: Scheduling UndoDeltaBlockGCOp(faef317e47a244c6965864f82f21edfa): 4923 bytes on disk
I20260807 13:55:20.158375 4983 maintenance_manager.cc:643] P 01adf83af3e04875b5fac9470d4da915: UndoDeltaBlockGCOp(faef317e47a244c6965864f82f21edfa) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":107,"lbm_reads_lt_1ms":4}
W20260807 13:55:20.166604 4631 consensus_peers.cc:597] T d02aa7a26c024b4083421b5d742f7bcb P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 13:55:20.174171 4632 consensus_peers.cc:576] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
W20260807 13:55:20.292016 4631 consensus_peers.cc:597] T 782ac4fa94fb4183940fca514cc068b0 P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 13:55:20.301263 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:55:20.318037 7669 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:20.338824 7327 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:20.357582 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:20.367209 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:20.376019 4688 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260807 13:55:20.430423 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:55:20.449635 7327 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:20.457592 7669 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:20.466185 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:20.505060 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:20.539419 4688 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
W20260807 13:55:20.554032 7274 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 13:55:20.573251 7102 consensus_peers.cc:597] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 13:55:20.574915 4632 consensus_peers.cc:576] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
W20260807 13:55:20.596819 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:20.646170 7444 consensus_peers.cc:597] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 13:55:20.674695 7102 consensus_peers.cc:597] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 13:55:20.713032 4632 consensus_peers.cc:576] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:20.766721 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:55:20.768718 7669 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:20.791677 7327 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:20.796324 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:20.801954 4688 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260807 13:55:20.822851 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260807 13:55:20.970582 4632 consensus_peers.cc:576] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:20.994668 29055 raft_consensus.cc:493] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edf940ebcc1140cfa0c23214e0c0f179)
I20260807 13:55:20.994876 29055 raft_consensus.cc:515] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:55:20.995776 29055 leader_election.cc:290] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075)
I20260807 13:55:20.997587 7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93615e4fb61416d8740ce61970610af" candidate_uuid: "8a9903f009ff46b4a6875490823076c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" is_pre_election: true
W20260807 13:55:20.998172 7444 leader_election.cc:336] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
W20260807 13:55:20.998816 7443 leader_election.cc:343] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): Illegal state: cannot vote while shut down
I20260807 13:55:20.998929 7443 leader_election.cc:304] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4; no voters: b77f2b2eade540c6bfd4f75e5229a3cd, edf940ebcc1140cfa0c23214e0c0f179
W20260807 13:55:20.999164 7443 leader_election.cc:336] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:20.999688 29055 raft_consensus.cc:2749] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:21.056905 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:55:21.060210 7327 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:21.070595 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:21.072085 7669 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:21.093876 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
W20260807 13:55:21.098723 4631 consensus_peers.cc:597] T 0c1327c8461e44f2ac5d77f10c390eeb P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 13:55:21.116967 4632 consensus_peers.cc:576] T bdac11c33b2b486eb34bc93def74489c P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:21.155994 4688 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260807 13:55:21.156253 29359 raft_consensus.cc:493] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edf940ebcc1140cfa0c23214e0c0f179)
I20260807 13:55:21.156407 29359 raft_consensus.cc:515] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:55:21.157075 29359 leader_election.cc:290] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
W20260807 13:55:21.175472 7613 leader_election.cc:336] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
W20260807 13:55:21.175952 7612 leader_election.cc:336] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:21.176148 7612 leader_election.cc:304] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31d7630573c8475a9f84978d4ebfb879; no voters: c9d2944272bc447dafce7620ac2dbd4b, edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:55:21.176431 29359 raft_consensus.cc:2749] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:55:21.207412 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:21.389127 5039 tablet_service.cc:1467] Tablet server has 7 leaders and 0 scanners
I20260807 13:55:21.416327 5129 maintenance_manager.cc:419] P 01adf83af3e04875b5fac9470d4da915: Scheduling FlushMRSOp(d27ce55f2acc4513a9fd90a338098eeb): perf score=0.033336
I20260807 13:55:21.416792 7327 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:55:21.418517 4983 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-2/data/data (497733632 bytes available vs 518351011 bytes reserved) (error 28)
W20260807 13:55:21.419196 4983 tablet_replica_mm_ops.cc:214] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915: failed to flush MRS: IO error: Failed to open DiskRowSet for flush: tablet d27ce55f2acc4513a9fd90a338098eeb: unable to open output file for column key INT32 NOT NULL: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in d27ce55f2acc4513a9fd90a338098eeb's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
F20260807 13:55:21.419322 4983 tablet_replica_mm_ops.cc:215] Check failed: tablet->HasBeenStopped() Unrecoverable flush failure caused by error: IO error: Failed to open DiskRowSet for flush: tablet d27ce55f2acc4513a9fd90a338098eeb: unable to open output file for column key INT32 NOT NULL: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in d27ce55f2acc4513a9fd90a338098eeb's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
*** Check failure stack trace: ***
W20260807 13:55:21.425499 4632 consensus_peers.cc:576] T 68717842b14e4f06b528c08a65acd3b7 P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
@ 0x7f8d045d9d5d google::LogMessage::Fail() at ??:0
@ 0x7f8d045ddb23 google::LogMessage::SendToLog() at ??:0
@ 0x7f8d045d975c google::LogMessage::Flush() at ??:0
@ 0x7f8d045daee9 google::LogMessageFatal::~LogMessageFatal() at ??:0
I20260807 13:55:21.438051 7669 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
W20260807 13:55:21.443102 4981 consensus_peers.cc:597] T d27ce55f2acc4513a9fd90a338098eeb P 01adf83af3e04875b5fac9470d4da915 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
@ 0x7f8d147428bd kudu::tablet::FlushMRSOp::Perform() at ??:0
I20260807 13:55:21.484586 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
@ 0x7f8d073abb09 kudu::MaintenanceManager::LaunchOp() at ??:0
@ 0x7f8d073aea43 kudu::MaintenanceManager::RunSchedulerThread()::$_3::operator()() at ??:0
@ 0x7f8d073ae8d9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa68ad std::function<>::operator()() at ??:?
I20260807 13:55:21.510771 4688 tablet_service.cc:1467] Tablet server has 10 leaders and 0 scanners
I20260807 13:55:21.511670 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
@ 0x7f8d07322850 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f8d07325b4c kudu::ThreadPool::CreateThread()::$_1::operator()() at ??:0
I20260807 13:55:21.527215 4779 maintenance_manager.cc:419] P fa83b7af134b4e3b949ac3b4e4bcb5e7: Scheduling FlushMRSOp(81cbb42cd4954383976169ec16ef2416): perf score=0.033374
@ 0x7f8d073259c9 std::_Function_handler<>::_M_invoke() at ??:0
W20260807 13:55:21.528661 4634 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-0/data/data (497688576 bytes available vs 518351011 bytes reserved) (error 28)
W20260807 13:55:21.529381 4634 tablet_replica_mm_ops.cc:214] T 81cbb42cd4954383976169ec16ef2416 P fa83b7af134b4e3b949ac3b4e4bcb5e7: failed to flush MRS: IO error: Failed to open DiskRowSet for flush: tablet 81cbb42cd4954383976169ec16ef2416: unable to open output file for column key INT32 NOT NULL: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in 81cbb42cd4954383976169ec16ef2416's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
@ 0xaa68ad std::function<>::operator()() at ??:?
F20260807 13:55:21.529508 4634 tablet_replica_mm_ops.cc:215] Check failed: tablet->HasBeenStopped() Unrecoverable flush failure caused by error: IO error: Failed to open DiskRowSet for flush: tablet 81cbb42cd4954383976169ec16ef2416: unable to open output file for column key INT32 NOT NULL: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in 81cbb42cd4954383976169ec16ef2416's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
*** Check failure stack trace: ***
@ 0x7f8ee9319d5d google::LogMessage::Fail() at ??:0
@ 0x7f8d07301dd9 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f8ee931db23 google::LogMessage::SendToLog() at ??:0
@ 0x7f8ee931975c google::LogMessage::Flush() at ??:0
@ 0x7f8d0a9d16db start_thread at ??:0
@ 0x7f8ee931aee9 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f8d0348861f clone at ??:0
@ 0x7f8ef94828bd kudu::tablet::FlushMRSOp::Perform() at ??:0
@ 0x7f8eec0ebb09 kudu::MaintenanceManager::LaunchOp() at ??:0
W20260807 13:55:21.561937 4631 consensus_peers.cc:597] T 50a090faa58e4f91961c9251030efacf P fa83b7af134b4e3b949ac3b4e4bcb5e7 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
@ 0x7f8eec0eea43 kudu::MaintenanceManager::RunSchedulerThread()::$_3::operator()() at ??:0
@ 0x7f8eec0ee8d9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa68ad std::function<>::operator()() at ??:?
@ 0x7f8eec062850 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f8eec065b4c kudu::ThreadPool::CreateThread()::$_1::operator()() at ??:0
@ 0x7f8eec0659c9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa68ad std::function<>::operator()() at ??:?
@ 0x7f8eec041dd9 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f8eef7116db start_thread at ??:0
@ 0x7f8ee81c861f clone at ??:0
I20260807 13:55:21.628796 7669 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:21.631259 7327 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:21.649776 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
W20260807 13:55:21.656653 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:21.657308 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260807 13:55:21.665968 7612 consensus_peers.cc:597] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 13:55:21.898818 7273 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 13:55:21.983768 7272 connection.cc:573] client connection to 127.23.107.131:40441 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 13:55:21.984887 7611 connection.cc:573] client connection to 127.23.107.131:40441 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 13:55:21.986078 7272 consensus_peers.cc:597] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:55:21.986271 7611 consensus_peers.cc:597] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:55:21.992800 7613 connection.cc:573] client connection to 127.23.107.129:32841 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 13:55:21.994244 7613 consensus_peers.cc:597] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:55:22.026665 7274 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:55:22.044512 7100 consensus_peers.cc:597] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:55:22.174285 7669 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:22.209877 7327 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:22.225421 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:22.230547 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
W20260807 13:55:22.250231 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:22.280907 7327 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:22.295279 7669 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
W20260807 13:55:22.295331 7613 consensus_peers.cc:597] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 13:55:22.311931 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:22.325762 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
W20260807 13:55:22.373250 7274 consensus_peers.cc:597] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 13:55:22.501557 7327 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:22.512017 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:22.522457 7669 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:22.525579 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:22.567412 29209 raft_consensus.cc:493] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:22.567622 29209 raft_consensus.cc:515] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:55:22.572450 29209 leader_election.cc:290] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385)
I20260807 13:55:22.572628 29209 raft_consensus.cc:493] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:22.572748 29209 raft_consensus.cc:515] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:55:22.573423 29209 leader_election.cc:290] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729)
I20260807 13:55:22.574915 7690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a5f0089b24a609b27d4a07a3c4353" candidate_uuid: "12ab71778f2f4b378765aaed1a0676a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 15 } } ignore_live_leader: false dest_uuid: "31d7630573c8475a9f84978d4ebfb879" is_pre_election: true
W20260807 13:55:22.576891 7272 leader_election.cc:336] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
I20260807 13:55:22.585474 7522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab259b597a64c04869543ccb1d9038c" candidate_uuid: "12ab71778f2f4b378765aaed1a0676a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "8a9903f009ff46b4a6875490823076c4" is_pre_election: true
I20260807 13:55:22.586521 7274 leader_election.cc:304] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5; no voters: 01adf83af3e04875b5fac9470d4da915, 8a9903f009ff46b4a6875490823076c4
I20260807 13:55:22.586848 29778 raft_consensus.cc:2749] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:55:22.587015 7274 leader_election.cc:336] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
I20260807 13:55:22.587127 7274 leader_election.cc:304] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5; no voters: 31d7630573c8475a9f84978d4ebfb879, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:22.587359 29778 raft_consensus.cc:2749] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:55:22.631242 29055 raft_consensus.cc:493] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:22.631454 29055 raft_consensus.cc:515] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:55:22.632479 29055 leader_election.cc:290] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:55:22.633399 7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27ce55f2acc4513a9fd90a338098eeb" candidate_uuid: "8a9903f009ff46b4a6875490823076c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" is_pre_election: true
W20260807 13:55:22.634838 7442 leader_election.cc:336] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
I20260807 13:55:22.635418 7443 leader_election.cc:304] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4; no voters: 01adf83af3e04875b5fac9470d4da915, b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:55:22.635715 7443 leader_election.cc:336] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:22.635730 29055 raft_consensus.cc:2749] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:22.639215 29055 raft_consensus.cc:493] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:22.639371 29055 raft_consensus.cc:515] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:55:22.639950 29055 leader_election.cc:290] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
W20260807 13:55:22.641299 7443 leader_election.cc:336] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:22.641472 7444 leader_election.cc:336] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
I20260807 13:55:22.641625 7444 leader_election.cc:304] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4; no voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:22.641906 29055 raft_consensus.cc:2749] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:55:22.688086 7274 consensus_peers.cc:597] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 13:55:22.701279 29778 raft_consensus.cc:493] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:22.701483 29778 raft_consensus.cc:515] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:55:22.702318 29778 leader_election.cc:290] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729)
I20260807 13:55:22.703361 7690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81cbb42cd4954383976169ec16ef2416" candidate_uuid: "12ab71778f2f4b378765aaed1a0676a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 8 } } ignore_live_leader: false dest_uuid: "31d7630573c8475a9f84978d4ebfb879" is_pre_election: true
W20260807 13:55:22.704617 7274 leader_election.cc:336] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
I20260807 13:55:22.704749 7274 leader_election.cc:304] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5; no voters: 31d7630573c8475a9f84978d4ebfb879, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:22.705547 29778 raft_consensus.cc:2749] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:55:22.715626 29055 raft_consensus.cc:493] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:22.715857 29055 raft_consensus.cc:515] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:55:22.716933 29055 leader_election.cc:290] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975)
I20260807 13:55:22.724979 29778 raft_consensus.cc:493] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:22.725145 29778 raft_consensus.cc:515] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:55:22.725885 29778 leader_election.cc:290] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385)
I20260807 13:55:22.726414 7522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f4f0207104455bf3e87bc04f8d13c" candidate_uuid: "12ab71778f2f4b378765aaed1a0676a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "8a9903f009ff46b4a6875490823076c4" is_pre_election: true
I20260807 13:55:22.726627 7522 raft_consensus.cc:2468] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12ab71778f2f4b378765aaed1a0676a5 in term 1.
W20260807 13:55:22.728385 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:22.728847 7274 leader_election.cc:304] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5, 8a9903f009ff46b4a6875490823076c4; no voters:
I20260807 13:55:22.729436 29778 raft_consensus.cc:2804] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:55:22.729521 29778 raft_consensus.cc:493] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:22.729590 29778 raft_consensus.cc:3060] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:55:22.730698 7272 leader_election.cc:336] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
W20260807 13:55:22.731302 7442 leader_election.cc:336] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
I20260807 13:55:22.731714 29055 raft_consensus.cc:493] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:22.731913 29055 raft_consensus.cc:515] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:55:22.732721 29055 leader_election.cc:290] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975)
I20260807 13:55:22.732756 29778 raft_consensus.cc:515] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:55:22.735911 7669 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
W20260807 13:55:22.736315 7442 leader_election.cc:336] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
I20260807 13:55:22.737690 7522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f4f0207104455bf3e87bc04f8d13c" candidate_uuid: "12ab71778f2f4b378765aaed1a0676a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "8a9903f009ff46b4a6875490823076c4"
I20260807 13:55:22.737895 7522 raft_consensus.cc:3060] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:55:22.739511 7272 leader_election.cc:336] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
I20260807 13:55:22.740974 7522 raft_consensus.cc:2468] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12ab71778f2f4b378765aaed1a0676a5 in term 2.
I20260807 13:55:22.741459 7274 leader_election.cc:304] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5, 8a9903f009ff46b4a6875490823076c4; no voters: 01adf83af3e04875b5fac9470d4da915
I20260807 13:55:22.741747 29209 raft_consensus.cc:2804] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:55:22.741806 29778 leader_election.cc:290] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 election: Requested vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385)
I20260807 13:55:22.746445 29209 raft_consensus.cc:697] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [term 2 LEADER]: Becoming Leader. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Running, Role: LEADER
I20260807 13:55:22.746740 29209 consensus_queue.cc:237] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:55:22.751122 7502 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260807 13:55:22.759730 4511 catalog_manager.cc:5697] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: term changed from 1 to 2, leader changed from 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) to 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134). New cstate: current_term: 2 leader_uuid: "12ab71778f2f4b378765aaed1a0676a5" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:55:22.762828 7158 tablet_service.cc:1467] Tablet server has 3 leaders and 0 scanners
I20260807 13:55:22.764669 7353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f4f0207104455bf3e87bc04f8d13c" candidate_uuid: "8a9903f009ff46b4a6875490823076c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "12ab71778f2f4b378765aaed1a0676a5" is_pre_election: true
I20260807 13:55:22.765161 7354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16afb6ff06704a8795f1de84ffa81de0" candidate_uuid: "8a9903f009ff46b4a6875490823076c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "12ab71778f2f4b378765aaed1a0676a5" is_pre_election: true
I20260807 13:55:22.767658 7444 leader_election.cc:304] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4; no voters: 01adf83af3e04875b5fac9470d4da915, 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:55:22.772035 7327 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:22.777458 29055 raft_consensus.cc:493] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:22.777649 29055 raft_consensus.cc:515] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:55:22.778414 29055 leader_election.cc:290] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975)
I20260807 13:55:22.778600 29055 raft_consensus.cc:2749] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:55:22.780097 7442 leader_election.cc:336] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
I20260807 13:55:22.790764 7444 leader_election.cc:304] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4; no voters: 01adf83af3e04875b5fac9470d4da915, 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:55:22.791198 29835 raft_consensus.cc:2749] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:22.791770 7354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab259b597a64c04869543ccb1d9038c" candidate_uuid: "8a9903f009ff46b4a6875490823076c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "12ab71778f2f4b378765aaed1a0676a5" is_pre_election: true
I20260807 13:55:22.791999 7354 raft_consensus.cc:2468] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a9903f009ff46b4a6875490823076c4 in term 1.
I20260807 13:55:22.792621 7444 leader_election.cc:304] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5, 8a9903f009ff46b4a6875490823076c4; no voters: 01adf83af3e04875b5fac9470d4da915
I20260807 13:55:22.793089 29835 raft_consensus.cc:2804] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:55:22.793237 29835 raft_consensus.cc:493] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:22.793426 29835 raft_consensus.cc:3060] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:22.793645 29209 raft_consensus.cc:493] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:22.793789 29209 raft_consensus.cc:515] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:55:22.794421 29209 leader_election.cc:290] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075)
I20260807 13:55:22.795117 7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06f352d0ff34b45b753a2c20f65574f" candidate_uuid: "12ab71778f2f4b378765aaed1a0676a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" is_pre_election: true
I20260807 13:55:22.796648 29835 raft_consensus.cc:515] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
W20260807 13:55:22.799908 7274 leader_election.cc:336] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
I20260807 13:55:22.800061 7274 leader_election.cc:304] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5; no voters: b77f2b2eade540c6bfd4f75e5229a3cd, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:22.800288 29209 raft_consensus.cc:2749] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:55:22.808202 7442 leader_election.cc:336] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
I20260807 13:55:22.808599 29359 raft_consensus.cc:493] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:22.808787 29359 raft_consensus.cc:515] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:55:22.809580 29359 leader_election.cc:290] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
W20260807 13:55:22.811348 7611 leader_election.cc:336] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
I20260807 13:55:22.818250 29055 raft_consensus.cc:493] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:22.818498 29055 raft_consensus.cc:515] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:55:22.819586 29055 leader_election.cc:290] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
W20260807 13:55:22.821834 7443 leader_election.cc:336] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:22.824393 7444 leader_election.cc:336] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
I20260807 13:55:22.824509 7444 leader_election.cc:304] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4; no voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7
W20260807 13:55:22.824787 7444 leader_election.cc:336] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:22.825208 29055 raft_consensus.cc:2749] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:55:22.828336 29835 leader_election.cc:290] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 election: Requested vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975)
I20260807 13:55:22.829413 7354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab259b597a64c04869543ccb1d9038c" candidate_uuid: "8a9903f009ff46b4a6875490823076c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "12ab71778f2f4b378765aaed1a0676a5"
I20260807 13:55:22.829664 7354 raft_consensus.cc:3060] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:22.833271 7354 raft_consensus.cc:2468] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a9903f009ff46b4a6875490823076c4 in term 2.
I20260807 13:55:22.835547 7444 leader_election.cc:304] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5, 8a9903f009ff46b4a6875490823076c4; no voters: 01adf83af3e04875b5fac9470d4da915
I20260807 13:55:22.835871 29835 raft_consensus.cc:2804] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:55:22.836251 29835 raft_consensus.cc:697] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 [term 2 LEADER]: Becoming Leader. State: Replica: 8a9903f009ff46b4a6875490823076c4, State: Running, Role: LEADER
I20260807 13:55:22.836679 29835 consensus_queue.cc:237] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:55:22.837083 29359 raft_consensus.cc:493] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:22.837272 29359 raft_consensus.cc:515] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:55:22.837941 29359 leader_election.cc:290] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975)
W20260807 13:55:22.837105 7613 leader_election.cc:336] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:22.838299 7613 leader_election.cc:304] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31d7630573c8475a9f84978d4ebfb879; no voters: 01adf83af3e04875b5fac9470d4da915, edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:55:22.838591 29359 raft_consensus.cc:2749] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:55:22.840078 7354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a5f0089b24a609b27d4a07a3c4353" candidate_uuid: "31d7630573c8475a9f84978d4ebfb879" candidate_term: 4 candidate_status { last_received { term: 3 index: 15 } } ignore_live_leader: false dest_uuid: "12ab71778f2f4b378765aaed1a0676a5" is_pre_election: true
I20260807 13:55:22.840307 7354 raft_consensus.cc:2468] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31d7630573c8475a9f84978d4ebfb879 in term 3.
I20260807 13:55:22.841148 7613 leader_election.cc:304] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5, 31d7630573c8475a9f84978d4ebfb879; no voters:
I20260807 13:55:22.841509 29359 raft_consensus.cc:2804] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:55:22.841616 29359 raft_consensus.cc:493] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:22.841692 29359 raft_consensus.cc:3060] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:55:22.849742 29359 raft_consensus.cc:515] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:55:22.852270 29359 leader_election.cc:290] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 4 election: Requested vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975)
I20260807 13:55:22.854336 7354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a5f0089b24a609b27d4a07a3c4353" candidate_uuid: "31d7630573c8475a9f84978d4ebfb879" candidate_term: 4 candidate_status { last_received { term: 3 index: 15 } } ignore_live_leader: false dest_uuid: "12ab71778f2f4b378765aaed1a0676a5"
I20260807 13:55:22.854575 7354 raft_consensus.cc:3060] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:55:22.857611 7354 raft_consensus.cc:2468] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31d7630573c8475a9f84978d4ebfb879 in term 4.
I20260807 13:55:22.858183 7613 leader_election.cc:304] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5, 31d7630573c8475a9f84978d4ebfb879; no voters:
I20260807 13:55:22.858593 29359 raft_consensus.cc:2804] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [term 4 FOLLOWER]: Leader election won for term 4
W20260807 13:55:22.862005 7613 leader_election.cc:336] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
W20260807 13:55:22.862589 7613 leader_election.cc:336] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
I20260807 13:55:22.865434 29359 raft_consensus.cc:697] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [term 4 LEADER]: Becoming Leader. State: Replica: 31d7630573c8475a9f84978d4ebfb879, State: Running, Role: LEADER
I20260807 13:55:22.865803 29359 consensus_queue.cc:237] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 3.15, Last appended by leader: 15, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:55:22.879527 4511 catalog_manager.cc:5697] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 reported cstate change: term changed from 1 to 2, leader changed from 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) to 8a9903f009ff46b4a6875490823076c4 (127.23.107.135). New cstate: current_term: 2 leader_uuid: "8a9903f009ff46b4a6875490823076c4" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } }
I20260807 13:55:22.881260 29801 raft_consensus.cc:493] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
W20260807 13:55:22.881377 7444 consensus_peers.cc:597] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 13:55:22.881443 29801 raft_consensus.cc:515] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:55:22.882134 29801 leader_election.cc:290] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
W20260807 13:55:22.885984 7100 leader_election.cc:336] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
W20260807 13:55:22.886356 7102 leader_election.cc:336] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
I20260807 13:55:22.886487 7102 leader_election.cc:304] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b77f2b2eade540c6bfd4f75e5229a3cd; no voters: 01adf83af3e04875b5fac9470d4da915, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:22.887089 29801 raft_consensus.cc:2749] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:22.887849 4511 catalog_manager.cc:5697] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 reported cstate change: term changed from 3 to 4, leader changed from fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) to 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136). New cstate: current_term: 4 leader_uuid: "31d7630573c8475a9f84978d4ebfb879" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:55:22.910068 29359 raft_consensus.cc:493] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:22.910306 29359 raft_consensus.cc:515] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:55:22.911127 29359 leader_election.cc:290] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
W20260807 13:55:22.913391 7612 leader_election.cc:336] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:22.913998 7613 leader_election.cc:336] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
I20260807 13:55:22.914170 7613 leader_election.cc:304] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31d7630573c8475a9f84978d4ebfb879; no voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:22.914705 29359 raft_consensus.cc:2749] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:55:22.928660 7102 consensus_peers.cc:597] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 13:55:22.937369 29359 raft_consensus.cc:493] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:22.937613 29359 raft_consensus.cc:515] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:55:22.938313 29359 leader_election.cc:290] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975)
I20260807 13:55:22.939170 7354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81cbb42cd4954383976169ec16ef2416" candidate_uuid: "31d7630573c8475a9f84978d4ebfb879" candidate_term: 3 candidate_status { last_received { term: 2 index: 8 } } ignore_live_leader: false dest_uuid: "12ab71778f2f4b378765aaed1a0676a5" is_pre_election: true
I20260807 13:55:22.939401 7354 raft_consensus.cc:2468] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31d7630573c8475a9f84978d4ebfb879 in term 2.
W20260807 13:55:22.939781 7613 leader_election.cc:336] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
I20260807 13:55:22.940069 7613 leader_election.cc:304] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5, 31d7630573c8475a9f84978d4ebfb879; no voters: fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:22.940385 29359 raft_consensus.cc:2804] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:55:22.940501 29359 raft_consensus.cc:493] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:22.940524 29835 raft_consensus.cc:493] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:22.940625 29359 raft_consensus.cc:3060] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:55:22.940722 29835 raft_consensus.cc:515] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:55:22.941413 29835 leader_election.cc:290] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
W20260807 13:55:22.942940 7444 leader_election.cc:336] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
W20260807 13:55:22.943166 7442 leader_election.cc:336] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
I20260807 13:55:22.943271 7442 leader_election.cc:304] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4; no voters: 01adf83af3e04875b5fac9470d4da915, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:22.943712 29835 raft_consensus.cc:2749] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:22.944348 29359 raft_consensus.cc:515] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:55:22.944988 29359 leader_election.cc:290] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 election: Requested vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975)
I20260807 13:55:22.946030 7354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81cbb42cd4954383976169ec16ef2416" candidate_uuid: "31d7630573c8475a9f84978d4ebfb879" candidate_term: 3 candidate_status { last_received { term: 2 index: 8 } } ignore_live_leader: false dest_uuid: "12ab71778f2f4b378765aaed1a0676a5"
I20260807 13:55:22.946236 7354 raft_consensus.cc:3060] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:55:22.946597 7613 leader_election.cc:336] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
I20260807 13:55:22.948503 7354 raft_consensus.cc:2468] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31d7630573c8475a9f84978d4ebfb879 in term 3.
I20260807 13:55:22.948642 29801 raft_consensus.cc:493] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:22.948819 29801 raft_consensus.cc:515] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:55:22.949028 7613 leader_election.cc:304] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5, 31d7630573c8475a9f84978d4ebfb879; no voters: fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:22.949278 29359 raft_consensus.cc:2804] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:55:22.949522 29801 leader_election.cc:290] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:55:22.949487 29359 raft_consensus.cc:697] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 [term 3 LEADER]: Becoming Leader. State: Replica: 31d7630573c8475a9f84978d4ebfb879, State: Running, Role: LEADER
I20260807 13:55:22.950002 29359 consensus_queue.cc:237] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 2.8, Last appended by leader: 8, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:55:22.953140 4511 catalog_manager.cc:5697] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 reported cstate change: term changed from 2 to 3, leader changed from fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) to 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136). New cstate: current_term: 3 leader_uuid: "31d7630573c8475a9f84978d4ebfb879" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } }
W20260807 13:55:22.953797 7102 leader_election.cc:336] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
W20260807 13:55:22.961788 7101 leader_election.cc:336] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:22.961941 7101 leader_election.cc:304] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b77f2b2eade540c6bfd4f75e5229a3cd; no voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:22.962213 29801 raft_consensus.cc:2749] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:55:22.985301 29801 raft_consensus.cc:493] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:22.985567 29801 raft_consensus.cc:515] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:55:22.986742 29801 leader_election.cc:290] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385)
W20260807 13:55:22.989120 7100 leader_election.cc:336] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
W20260807 13:55:22.990924 7101 leader_election.cc:336] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:22.991081 7101 leader_election.cc:304] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b77f2b2eade540c6bfd4f75e5229a3cd; no voters: 01adf83af3e04875b5fac9470d4da915, c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:55:22.991496 28657 raft_consensus.cc:493] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:22.991544 29835 raft_consensus.cc:493] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:22.991690 28657 raft_consensus.cc:515] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:55:22.991753 29835 raft_consensus.cc:515] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:55:22.992417 29835 leader_election.cc:290] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:55:22.992512 28657 leader_election.cc:290] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975)
I20260807 13:55:22.992735 28657 raft_consensus.cc:2749] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:22.994284 7354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06f352d0ff34b45b753a2c20f65574f" candidate_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "12ab71778f2f4b378765aaed1a0676a5" is_pre_election: true
I20260807 13:55:22.994527 7354 raft_consensus.cc:2468] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b77f2b2eade540c6bfd4f75e5229a3cd in term 1.
I20260807 13:55:22.995090 7102 leader_election.cc:304] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5, b77f2b2eade540c6bfd4f75e5229a3cd; no voters:
I20260807 13:55:22.995385 29801 raft_consensus.cc:2804] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:55:22.995532 29801 raft_consensus.cc:493] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:22.995658 29801 raft_consensus.cc:3060] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:55:22.996701 7442 leader_election.cc:336] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
W20260807 13:55:22.996937 7443 leader_election.cc:336] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:22.997030 7443 leader_election.cc:304] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4; no voters: 01adf83af3e04875b5fac9470d4da915, c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:55:22.997457 29835 raft_consensus.cc:2749] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:22.998893 29801 raft_consensus.cc:515] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:55:22.999580 29801 leader_election.cc:290] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 election: Requested vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975)
I20260807 13:55:23.000020 7354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06f352d0ff34b45b753a2c20f65574f" candidate_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "12ab71778f2f4b378765aaed1a0676a5"
I20260807 13:55:23.000196 7354 raft_consensus.cc:3060] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:23.001646 7522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27ce55f2acc4513a9fd90a338098eeb" candidate_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "8a9903f009ff46b4a6875490823076c4" is_pre_election: true
I20260807 13:55:23.001870 7522 raft_consensus.cc:2468] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b77f2b2eade540c6bfd4f75e5229a3cd in term 1.
W20260807 13:55:23.003054 7102 leader_election.cc:336] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
I20260807 13:55:23.003206 7354 raft_consensus.cc:2468] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77f2b2eade540c6bfd4f75e5229a3cd in term 2.
I20260807 13:55:23.004207 7102 leader_election.cc:304] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5, b77f2b2eade540c6bfd4f75e5229a3cd; no voters:
I20260807 13:55:23.004501 29801 raft_consensus.cc:2804] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:55:23.004654 29801 raft_consensus.cc:697] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 LEADER]: Becoming Leader. State: Replica: b77f2b2eade540c6bfd4f75e5229a3cd, State: Running, Role: LEADER
I20260807 13:55:23.004976 29801 consensus_queue.cc:237] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
W20260807 13:55:23.005573 7102 leader_election.cc:336] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
I20260807 13:55:23.010399 4515 catalog_manager.cc:5697] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd reported cstate change: term changed from 1 to 2, leader changed from fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129) to b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133). New cstate: current_term: 2 leader_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } }
I20260807 13:55:23.023705 29209 raft_consensus.cc:493] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:23.023881 29831 raft_consensus.cc:493] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:23.023916 29209 raft_consensus.cc:515] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:55:23.023983 29831 raft_consensus.cc:515] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:55:23.024600 29209 leader_election.cc:290] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385)
I20260807 13:55:23.024682 29831 leader_election.cc:290] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
W20260807 13:55:23.026304 7272 leader_election.cc:336] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
I20260807 13:55:23.026453 7522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16afb6ff06704a8795f1de84ffa81de0" candidate_uuid: "12ab71778f2f4b378765aaed1a0676a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "8a9903f009ff46b4a6875490823076c4" is_pre_election: true
I20260807 13:55:23.026602 7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68717842b14e4f06b528c08a65acd3b7" candidate_uuid: "12ab71778f2f4b378765aaed1a0676a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" is_pre_election: true
I20260807 13:55:23.026746 7522 raft_consensus.cc:2468] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12ab71778f2f4b378765aaed1a0676a5 in term 1.
I20260807 13:55:23.030189 7274 leader_election.cc:304] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5, 8a9903f009ff46b4a6875490823076c4; no voters: 01adf83af3e04875b5fac9470d4da915
I20260807 13:55:23.030535 29831 raft_consensus.cc:2804] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:55:23.030673 29831 raft_consensus.cc:493] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:23.030766 29831 raft_consensus.cc:3060] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:23.034638 29831 raft_consensus.cc:515] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
W20260807 13:55:23.034962 7274 leader_election.cc:336] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
I20260807 13:55:23.035058 7274 leader_election.cc:304] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5; no voters: b77f2b2eade540c6bfd4f75e5229a3cd, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:23.035300 29209 raft_consensus.cc:2749] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:23.035660 29831 leader_election.cc:290] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 election: Requested vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385)
W20260807 13:55:23.035663 7274 leader_election.cc:336] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
W20260807 13:55:23.036574 7272 leader_election.cc:336] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
I20260807 13:55:23.036536 7522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16afb6ff06704a8795f1de84ffa81de0" candidate_uuid: "12ab71778f2f4b378765aaed1a0676a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "8a9903f009ff46b4a6875490823076c4"
I20260807 13:55:23.036762 7522 raft_consensus.cc:3060] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:55:23.039813 7522 raft_consensus.cc:2468] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12ab71778f2f4b378765aaed1a0676a5 in term 2.
I20260807 13:55:23.040227 7274 leader_election.cc:304] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5, 8a9903f009ff46b4a6875490823076c4; no voters: 01adf83af3e04875b5fac9470d4da915
I20260807 13:55:23.040510 29831 raft_consensus.cc:2804] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:55:23.041126 29831 raft_consensus.cc:697] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 [term 2 LEADER]: Becoming Leader. State: Replica: 12ab71778f2f4b378765aaed1a0676a5, State: Running, Role: LEADER
I20260807 13:55:23.041549 29831 consensus_queue.cc:237] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:55:23.045102 4511 catalog_manager.cc:5697] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 reported cstate change: term changed from 1 to 2, leader changed from 01adf83af3e04875b5fac9470d4da915 (127.23.107.131) to 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134). New cstate: current_term: 2 leader_uuid: "12ab71778f2f4b378765aaed1a0676a5" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } }
I20260807 13:55:23.060019 29801 raft_consensus.cc:493] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:23.060279 29801 raft_consensus.cc:515] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:55:23.061241 29801 leader_election.cc:290] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:55:23.062225 7354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68717842b14e4f06b528c08a65acd3b7" candidate_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "12ab71778f2f4b378765aaed1a0676a5" is_pre_election: true
I20260807 13:55:23.062474 7354 raft_consensus.cc:2468] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b77f2b2eade540c6bfd4f75e5229a3cd in term 1.
W20260807 13:55:23.063975 7102 leader_election.cc:336] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
W20260807 13:55:23.064267 7102 leader_election.cc:336] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:23.064401 7102 leader_election.cc:304] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5, b77f2b2eade540c6bfd4f75e5229a3cd; no voters: edf940ebcc1140cfa0c23214e0c0f179, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:23.065054 29801 raft_consensus.cc:2749] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:23.112965 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:23.135561 7669 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:23.156126 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:23.168561 7669 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
W20260807 13:55:23.186479 7102 consensus_peers.cc:597] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 13:55:23.186708 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:23.188233 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:23.215407 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:23.231750 29850 raft_consensus.cc:493] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edf940ebcc1140cfa0c23214e0c0f179)
I20260807 13:55:23.231971 29850 raft_consensus.cc:515] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:55:23.232955 29850 leader_election.cc:290] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
W20260807 13:55:23.237532 7613 leader_election.cc:336] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
W20260807 13:55:23.237874 7612 leader_election.cc:336] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:23.238016 7612 leader_election.cc:304] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31d7630573c8475a9f84978d4ebfb879; no voters: c9d2944272bc447dafce7620ac2dbd4b, edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:55:23.238276 29359 raft_consensus.cc:2749] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:55:23.244320 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:23.301759 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:23.309100 7522 raft_consensus.cc:1275] T 739f4f0207104455bf3e87bc04f8d13c P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
I20260807 13:55:23.309898 29831 consensus_queue.cc:1048] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260807 13:55:23.319864 7274 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 13:55:23.340688 7272 consensus_peers.cc:597] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:55:23.360849 7354 raft_consensus.cc:1275] T 069a5f0089b24a609b27d4a07a3c4353 P 12ab71778f2f4b378765aaed1a0676a5 [term 4 FOLLOWER]: Refusing update from remote peer 31d7630573c8475a9f84978d4ebfb879: Log matching property violated. Preceding OpId in replica: term: 3 index: 15. Preceding OpId from leader: term: 4 index: 16. (index mismatch)
I20260807 13:55:23.361769 29359 consensus_queue.cc:1048] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260807 13:55:23.383229 7613 consensus_peers.cc:597] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:55:23.383514 7442 consensus_peers.cc:597] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:55:23.405267 7354 raft_consensus.cc:1275] T eab259b597a64c04869543ccb1d9038c P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Refusing update from remote peer 8a9903f009ff46b4a6875490823076c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260807 13:55:23.406198 29835 consensus_queue.cc:1048] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260807 13:55:23.470662 7102 consensus_peers.cc:597] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:55:23.474570 7522 raft_consensus.cc:1275] T 16afb6ff06704a8795f1de84ffa81de0 P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Refusing update from remote peer 12ab71778f2f4b378765aaed1a0676a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
I20260807 13:55:23.476377 29953 consensus_queue.cc:1048] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260807 13:55:23.484366 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:23.484577 7669 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
W20260807 13:55:23.490933 7613 consensus_peers.cc:597] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:55:23.507841 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
W20260807 13:55:23.514868 7272 consensus_peers.cc:597] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:55:23.522290 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:23.537955 29835 raft_consensus.cc:493] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edf940ebcc1140cfa0c23214e0c0f179)
I20260807 13:55:23.538165 29835 raft_consensus.cc:515] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:55:23.539012 29835 leader_election.cc:290] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075)
I20260807 13:55:23.540748 7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93615e4fb61416d8740ce61970610af" candidate_uuid: "8a9903f009ff46b4a6875490823076c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" is_pre_election: true
W20260807 13:55:23.544036 7443 leader_election.cc:343] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): Illegal state: cannot vote while shut down
W20260807 13:55:23.546303 7444 leader_election.cc:336] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:23.546432 7444 leader_election.cc:304] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4; no voters: b77f2b2eade540c6bfd4f75e5229a3cd, edf940ebcc1140cfa0c23214e0c0f179
W20260807 13:55:23.546851 7443 leader_election.cc:336] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:23.547308 29835 raft_consensus.cc:2749] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:23.549113 7354 raft_consensus.cc:1275] T 81cbb42cd4954383976169ec16ef2416 P 12ab71778f2f4b378765aaed1a0676a5 [term 3 FOLLOWER]: Refusing update from remote peer 31d7630573c8475a9f84978d4ebfb879: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 3 index: 9. (index mismatch)
I20260807 13:55:23.549810 29962 consensus_queue.cc:1048] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:55:23.579988 7354 raft_consensus.cc:1275] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5 [term 2 FOLLOWER]: Refusing update from remote peer b77f2b2eade540c6bfd4f75e5229a3cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260807 13:55:23.580696 29801 consensus_queue.cc:1048] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:55:23.797663 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
W20260807 13:55:23.816478 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:23.826642 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:23.856129 7669 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:23.856374 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:23.892769 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:23.923913 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:23.930325 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:55:23.933944 7611 consensus_peers.cc:597] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 13:55:23.943390 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:55:23.945645 7612 consensus_peers.cc:597] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260807 13:55:24.093176 7613 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111) [suppressed 48 similar messages]
W20260807 13:55:24.096328 7613 consensus_peers.cc:597] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 13:55:24.196566 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:24.207010 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:55:24.214043 7274 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111) [suppressed 63 similar messages]
I20260807 13:55:24.214768 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:24.218040 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
W20260807 13:55:24.238736 7101 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111) [suppressed 48 similar messages]
W20260807 13:55:24.240092 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:24.261999 29835 raft_consensus.cc:493] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:24.262271 29835 raft_consensus.cc:515] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:55:24.263167 29835 leader_election.cc:290] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
W20260807 13:55:24.265468 7443 leader_election.cc:336] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:24.272733 7274 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 13:55:24.283810 7444 leader_election.cc:336] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
I20260807 13:55:24.284153 7444 leader_election.cc:304] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4; no voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:24.284534 29835 raft_consensus.cc:2749] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:55:24.443501 29835 raft_consensus.cc:493] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:24.443718 29835 raft_consensus.cc:515] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:55:24.444650 29835 leader_election.cc:290] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
W20260807 13:55:24.446487 7443 leader_election.cc:336] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:24.448364 7444 leader_election.cc:336] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
I20260807 13:55:24.448487 7444 leader_election.cc:304] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4; no voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:24.448855 29835 raft_consensus.cc:2749] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:55:24.448865 7444 leader_election.cc:336] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:24.456756 29835 raft_consensus.cc:493] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:24.456961 29835 raft_consensus.cc:515] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:55:24.457815 29835 leader_election.cc:290] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
W20260807 13:55:24.459194 7444 leader_election.cc:336] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
W20260807 13:55:24.459547 7442 leader_election.cc:336] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
I20260807 13:55:24.459650 7442 leader_election.cc:304] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4; no voters: 01adf83af3e04875b5fac9470d4da915, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:24.459952 29835 raft_consensus.cc:2749] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:55:24.467645 7100 consensus_peers.cc:597] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 13:55:24.494570 7273 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260807 13:55:24.501262 7747 rebalancer_tool-test.cc:1258] rebalancer run info: Runtime error: /tmp/dist-test-task2KnpY3/build/asan/bin/kudu: process exited with non-zero status 1
stdout: Per-server replica distribution summary:
Statistic | Value
-----------------------+-----------
Minimum Replica Count | 0
Maximum Replica Count | 23
Average Replica Count | 11.250000
Per-table replica distribution summary:
Replica Skew | Value
--------------+----------
Minimum | 3
Maximum | 3
Average | 3.000000
stderr: W20260807 13:53:25.821256 7754 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:25.821707 7754 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260807 13:53:30.250016 7754 rebalancer_tool.cc:215] running whole-cluster rebalancing
W20260807 13:53:32.113621 7754 rebalancer_tool.cc:1212] table b6c061acc30c4e5aa6bee1f054e3a59a: no follower replicas available on c9d2944272bc447dafce7620ac2dbd4b, falling back to leader replicas
W20260807 13:53:32.119436 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e242e42da20d4458a49a269a9569307a: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:32.119758 7754 rebalancer_tool.cc:1212] table 14867b014aab43119171102f60bb134d: no follower replicas available on 01adf83af3e04875b5fac9470d4da915, falling back to leader replicas
W20260807 13:53:32.119907 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 14867b014aab43119171102f60bb134d: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:32.120110 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 7f1d26639edd4cb398339b2b0d3659a3: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:32.120452 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 35d13981f3a742dd9369d1e7bf18498c: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:32.120672 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 96e83925faa542ffa4808b01a5adbbb3: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:32.120816 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 91303cf8b9064e06b8c4165942b287f2: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:32.121001 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 2ff801ea568346e096cc895a279c109c: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:32.121199 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c2c7db1795a1414c8299bebbeaf60404: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:32.121647 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 6008038c907645199b055dacb5772621: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:32.121943 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b6c061acc30c4e5aa6bee1f054e3a59a: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:32.122210 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c2c7db1795a1414c8299bebbeaf60404: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:32.122464 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e242e42da20d4458a49a269a9569307a: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:32.122772 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 35d13981f3a742dd9369d1e7bf18498c: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:32.123988 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 14867b014aab43119171102f60bb134d: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:32.124291 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 96e83925faa542ffa4808b01a5adbbb3: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:53:32.949663 7754 rebalancer_tool.cc:1090] tablet c10b910e9f354933b60ae70f1baa9b6f: '01adf83af3e04875b5fac9470d4da915' -> 'b77f2b2eade540c6bfd4f75e5229a3cd' move scheduled
I20260807 13:53:33.527645 7754 rebalancer_tool.cc:1090] tablet 80898a5a2cf046f1b7344dfceb175bbd: 'c9d2944272bc447dafce7620ac2dbd4b' -> '12ab71778f2f4b378765aaed1a0676a5' move scheduled
I20260807 13:53:34.158072 7754 rebalancer_tool.cc:1090] tablet 541201ddfdf041ed87b3d0e731763a37: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '8a9903f009ff46b4a6875490823076c4' move scheduled
I20260807 13:53:34.818261 7754 rebalancer_tool.cc:1090] tablet a29bfc37eabb411f845203c281444086: 'edf940ebcc1140cfa0c23214e0c0f179' -> '31d7630573c8475a9f84978d4ebfb879' move scheduled
I20260807 13:53:35.393384 7754 rebalancer_tool.cc:1090] tablet 68717842b14e4f06b528c08a65acd3b7: '01adf83af3e04875b5fac9470d4da915' -> 'b77f2b2eade540c6bfd4f75e5229a3cd' move scheduled
I20260807 13:53:36.160386 7754 rebalancer_tool.cc:1090] tablet 069a5f0089b24a609b27d4a07a3c4353: 'c9d2944272bc447dafce7620ac2dbd4b' -> '12ab71778f2f4b378765aaed1a0676a5' move scheduled
I20260807 13:53:36.684716 7754 rebalancer_tool.cc:1090] tablet b414c896ad884facb339e5e4a0329065: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '31d7630573c8475a9f84978d4ebfb879' move scheduled
I20260807 13:53:37.361408 7754 rebalancer_tool.cc:1090] tablet 782ac4fa94fb4183940fca514cc068b0: 'edf940ebcc1140cfa0c23214e0c0f179' -> '8a9903f009ff46b4a6875490823076c4' move scheduled
I20260807 13:53:37.631583 7754 rebalancer_tool.cc:1100] tablet d02aa7a26c024b4083421b5d742f7bcb: '01adf83af3e04875b5fac9470d4da915' -> 'b77f2b2eade540c6bfd4f75e5229a3cd' move ignored: Illegal state: tablet d02aa7a26c024b4083421b5d742f7bcb: replica b77f2b2eade540c6bfd4f75e5229a3cd is already present
I20260807 13:53:37.631767 7754 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260807 13:53:39.269143 7754 rebalancer_tool.cc:1212] table 91303cf8b9064e06b8c4165942b287f2: no follower replicas available on fa83b7af134b4e3b949ac3b4e4bcb5e7, falling back to leader replicas
W20260807 13:53:39.270089 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 91303cf8b9064e06b8c4165942b287f2: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:39.270239 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 6008038c907645199b055dacb5772621: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:39.270385 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 7f1d26639edd4cb398339b2b0d3659a3: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:39.272030 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b6c061acc30c4e5aa6bee1f054e3a59a: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:39.272133 7754 rebalancer_tool.cc:1212] table e242e42da20d4458a49a269a9569307a: no follower replicas available on edf940ebcc1140cfa0c23214e0c0f179, falling back to leader replicas
W20260807 13:53:39.272258 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 35d13981f3a742dd9369d1e7bf18498c: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:39.272361 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e242e42da20d4458a49a269a9569307a: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:39.272490 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 7f1d26639edd4cb398339b2b0d3659a3: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:39.272581 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c2c7db1795a1414c8299bebbeaf60404: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:39.272718 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c2c7db1795a1414c8299bebbeaf60404: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:39.272854 7754 rebalancer_tool.cc:1212] table 2ff801ea568346e096cc895a279c109c: no follower replicas available on 01adf83af3e04875b5fac9470d4da915, falling back to leader replicas
I20260807 13:53:39.495525 7754 rebalancer_tool.cc:1090] tablet 04dac80fea124c25b34af8cc290c0d7f: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move scheduled
I20260807 13:53:39.538359 7754 rebalancer_tool.cc:1090] tablet ffa98a163d7540e3a911a39334657138: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move scheduled
I20260807 13:53:39.962343 7754 rebalancer_tool.cc:1090] tablet 16afb6ff06704a8795f1de84ffa81de0: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '8a9903f009ff46b4a6875490823076c4' move scheduled
I20260807 13:53:40.216295 7754 rebalancer_tool.cc:1090] tablet d02aa7a26c024b4083421b5d742f7bcb: '01adf83af3e04875b5fac9470d4da915' -> '' move scheduled
I20260807 13:53:40.682008 7754 rebalancer_tool.cc:1090] tablet faef317e47a244c6965864f82f21edfa: 'c9d2944272bc447dafce7620ac2dbd4b' -> '31d7630573c8475a9f84978d4ebfb879' move scheduled
I20260807 13:53:40.728000 7754 rebalancer_tool.cc:1100] tablet 739f4f0207104455bf3e87bc04f8d13c: 'edf940ebcc1140cfa0c23214e0c0f179' -> '12ab71778f2f4b378765aaed1a0676a5' move ignored: Illegal state: tablet 739f4f0207104455bf3e87bc04f8d13c: replica 12ab71778f2f4b378765aaed1a0676a5 is already present
I20260807 13:53:40.728154 7754 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260807 13:53:43.466861 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b6c061acc30c4e5aa6bee1f054e3a59a: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:43.467098 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 96e83925faa542ffa4808b01a5adbbb3: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:43.467227 7754 rebalancer_tool.cc:1212] table 91303cf8b9064e06b8c4165942b287f2: no follower replicas available on edf940ebcc1140cfa0c23214e0c0f179, falling back to leader replicas
W20260807 13:53:43.467319 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 91303cf8b9064e06b8c4165942b287f2: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:43.467428 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e242e42da20d4458a49a269a9569307a: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:43.467537 7754 rebalancer_tool.cc:1212] table 14867b014aab43119171102f60bb134d: no follower replicas available on 01adf83af3e04875b5fac9470d4da915, falling back to leader replicas
W20260807 13:53:43.467619 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 14867b014aab43119171102f60bb134d: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 31d7630573c8475a9f84978d4ebfb879
I20260807 13:53:43.662102 7754 rebalancer_tool.cc:1090] tablet e93615e4fb61416d8740ce61970610af: '01adf83af3e04875b5fac9470d4da915' -> '' move scheduled
I20260807 13:53:43.865293 7754 rebalancer_tool.cc:1090] tablet 81cbb42cd4954383976169ec16ef2416: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
W20260807 13:53:45.511190 11099 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.23.107.129:32841, user_credentials={real_user=slave}} blocked reactor thread for 110611us
W20260807 13:53:52.239859 12565 meta_cache.cc:1261] Time spent looking up entry by key: real 0.144s user 0.001s sys 0.000s
I20260807 13:53:58.468927 7754 rebalancer_tool.cc:1152] tablet e93615e4fb61416d8740ce61970610af: '01adf83af3e04875b5fac9470d4da915' -> '' move completed: OK
I20260807 13:53:58.669668 7754 rebalancer_tool.cc:1152] tablet 80898a5a2cf046f1b7344dfceb175bbd: 'c9d2944272bc447dafce7620ac2dbd4b' -> '12ab71778f2f4b378765aaed1a0676a5' move completed: OK
I20260807 13:54:06.775430 7754 rebalancer_tool.cc:1152] tablet 81cbb42cd4954383976169ec16ef2416: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
I20260807 13:54:06.910837 7754 rebalancer_tool.cc:1152] tablet 541201ddfdf041ed87b3d0e731763a37: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '8a9903f009ff46b4a6875490823076c4' move completed: OK
I20260807 13:54:07.051664 7754 rebalancer_tool.cc:1152] tablet 782ac4fa94fb4183940fca514cc068b0: 'edf940ebcc1140cfa0c23214e0c0f179' -> '8a9903f009ff46b4a6875490823076c4' move completed: OK
I20260807 13:54:11.220048 7754 rebalancer_tool.cc:1090] tablet 1715828a5d96455abecae985d1dca004: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:54:11.355010 7754 rebalancer_tool.cc:1090] tablet bdac11c33b2b486eb34bc93def74489c: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move scheduled
I20260807 13:54:13.686219 7754 rebalancer_tool.cc:1152] tablet faef317e47a244c6965864f82f21edfa: 'c9d2944272bc447dafce7620ac2dbd4b' -> '31d7630573c8475a9f84978d4ebfb879' move completed: OK
I20260807 13:54:13.804143 7754 rebalancer_tool.cc:1152] tablet d02aa7a26c024b4083421b5d742f7bcb: '01adf83af3e04875b5fac9470d4da915' -> '' move completed: OK
I20260807 13:54:13.874292 7754 rebalancer_tool.cc:1152] tablet 16afb6ff06704a8795f1de84ffa81de0: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '8a9903f009ff46b4a6875490823076c4' move completed: OK
I20260807 13:54:18.487775 7754 rebalancer_tool.cc:1152] tablet bdac11c33b2b486eb34bc93def74489c: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move completed: OK
I20260807 13:54:18.779881 7754 rebalancer_tool.cc:1152] tablet c10b910e9f354933b60ae70f1baa9b6f: '01adf83af3e04875b5fac9470d4da915' -> 'b77f2b2eade540c6bfd4f75e5229a3cd' move completed: OK
I20260807 13:54:18.863080 7754 rebalancer_tool.cc:1152] tablet b414c896ad884facb339e5e4a0329065: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '31d7630573c8475a9f84978d4ebfb879' move completed: OK
I20260807 13:54:18.957278 7754 rebalancer_tool.cc:1152] tablet a29bfc37eabb411f845203c281444086: 'edf940ebcc1140cfa0c23214e0c0f179' -> '31d7630573c8475a9f84978d4ebfb879' move completed: OK
I20260807 13:54:19.013211 7754 rebalancer_tool.cc:1152] tablet 68717842b14e4f06b528c08a65acd3b7: '01adf83af3e04875b5fac9470d4da915' -> 'b77f2b2eade540c6bfd4f75e5229a3cd' move completed: OK
I20260807 13:54:19.123436 7754 rebalancer_tool.cc:1152] tablet 069a5f0089b24a609b27d4a07a3c4353: 'c9d2944272bc447dafce7620ac2dbd4b' -> '12ab71778f2f4b378765aaed1a0676a5' move completed: OK
I20260807 13:54:19.369002 7754 rebalancer_tool.cc:1090] tablet 312c7ed04e334b08b506c8908224a7da: '01adf83af3e04875b5fac9470d4da915' -> '' move scheduled
I20260807 13:54:19.462817 7754 rebalancer_tool.cc:1090] tablet 242a68df09cb4c7d9522a33d259ebf78: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move scheduled
I20260807 13:54:19.508690 7754 rebalancer_tool.cc:1152] tablet 242a68df09cb4c7d9522a33d259ebf78: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move completed: OK
I20260807 13:54:19.606217 7754 rebalancer_tool.cc:1152] tablet 312c7ed04e334b08b506c8908224a7da: '01adf83af3e04875b5fac9470d4da915' -> '' move completed: OK
I20260807 13:54:19.728617 7754 rebalancer_tool.cc:1152] tablet 1715828a5d96455abecae985d1dca004: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
I20260807 13:54:19.889811 7754 rebalancer_tool.cc:1152] tablet ffa98a163d7540e3a911a39334657138: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move completed: OK
I20260807 13:54:22.473647 7754 rebalancer_tool.cc:1090] tablet 96bc42d66fa04fb69afa630969dbb579: '01adf83af3e04875b5fac9470d4da915' -> '' move scheduled
I20260807 13:54:22.540421 7754 rebalancer_tool.cc:1090] tablet d06f352d0ff34b45b753a2c20f65574f: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:54:22.703368 7754 rebalancer_tool.cc:1090] tablet 739f4f0207104455bf3e87bc04f8d13c: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move scheduled
I20260807 13:54:22.784579 7754 rebalancer_tool.cc:1090] tablet 522c3523f2af4eb29e30fa55da2acd3e: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move scheduled
I20260807 13:54:22.864087 7754 rebalancer_tool.cc:1152] tablet 522c3523f2af4eb29e30fa55da2acd3e: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move completed: OK
I20260807 13:54:23.063606 7754 rebalancer_tool.cc:1152] tablet 739f4f0207104455bf3e87bc04f8d13c: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move completed: OK
I20260807 13:54:23.244253 7754 rebalancer_tool.cc:1152] tablet d06f352d0ff34b45b753a2c20f65574f: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
I20260807 13:54:23.573253 7754 rebalancer_tool.cc:1152] tablet 96bc42d66fa04fb69afa630969dbb579: '01adf83af3e04875b5fac9470d4da915' -> '' move completed: OK
I20260807 13:54:24.074581 7754 rebalancer_tool.cc:1152] tablet 04dac80fea124c25b34af8cc290c0d7f: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move completed: OK
I20260807 13:54:24.226850 7754 rebalancer_tool.cc:1090] tablet d27ce55f2acc4513a9fd90a338098eeb: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move scheduled
I20260807 13:54:24.355659 7754 rebalancer_tool.cc:1090] tablet eab259b597a64c04869543ccb1d9038c: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:54:24.475062 7754 rebalancer_tool.cc:1090] tablet 50a090faa58e4f91961c9251030efacf: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move scheduled
I20260807 13:54:24.582835 7754 rebalancer_tool.cc:1090] tablet 43f5461808a646c885d593f782538930: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:54:24.879281 7754 rebalancer_tool.cc:1090] tablet 966ebd287fc14e498e5bd3e6542194ca: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:54:27.029062 7754 rebalancer_tool.cc:1152] tablet 43f5461808a646c885d593f782538930: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
I20260807 13:54:29.464754 7754 rebalancer_tool.cc:1152] tablet eab259b597a64c04869543ccb1d9038c: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
I20260807 13:54:35.184583 7754 rebalancer_tool.cc:1152] tablet 50a090faa58e4f91961c9251030efacf: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move completed: OK
I20260807 13:54:35.517536 7754 rebalancer_tool.cc:1152] tablet d27ce55f2acc4513a9fd90a338098eeb: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move completed: OK
I20260807 13:54:35.770771 7754 rebalancer_tool.cc:1152] tablet 966ebd287fc14e498e5bd3e6542194ca: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
I20260807 13:54:38.576458 7754 rebalancer_tool.cc:1090] tablet 50a090faa58e4f91961c9251030efacf: '31d7630573c8475a9f84978d4ebfb879' -> 'fa83b7af134b4e3b949ac3b4e4bcb5e7' move scheduled
I20260807 13:54:39.080132 7754 rebalancer_tool.cc:1090] tablet 966ebd287fc14e498e5bd3e6542194ca: '01adf83af3e04875b5fac9470d4da915' -> 'edf940ebcc1140cfa0c23214e0c0f179' move scheduled
I20260807 13:54:39.471441 7754 rebalancer_tool.cc:1090] tablet 541201ddfdf041ed87b3d0e731763a37: '8a9903f009ff46b4a6875490823076c4' -> '' move scheduled
I20260807 13:54:47.263602 7754 rebalancer_tool.cc:1152] tablet 541201ddfdf041ed87b3d0e731763a37: '8a9903f009ff46b4a6875490823076c4' -> '' move completed: OK
I20260807 13:54:47.347612 7754 rebalancer_tool.cc:1152] tablet 966ebd287fc14e498e5bd3e6542194ca: '01adf83af3e04875b5fac9470d4da915' -> 'edf940ebcc1140cfa0c23214e0c0f179' move completed: OK
I20260807 13:54:47.451036 7754 rebalancer_tool.cc:1152] tablet 50a090faa58e4f91961c9251030efacf: '31d7630573c8475a9f84978d4ebfb879' -> 'fa83b7af134b4e3b949ac3b4e4bcb5e7' move completed: OK
W20260807 13:54:49.964926 7754 rebalancer_tool.cc:1212] table e242e42da20d4458a49a269a9569307a: no follower replicas available on c9d2944272bc447dafce7620ac2dbd4b, falling back to leader replicas
I20260807 13:54:50.431921 7754 rebalancer_tool.cc:1090] tablet 069a5f0089b24a609b27d4a07a3c4353: 'c9d2944272bc447dafce7620ac2dbd4b' -> '12ab71778f2f4b378765aaed1a0676a5' move scheduled
I20260807 13:54:50.583768 7754 rebalancer_tool.cc:1090] tablet 1715828a5d96455abecae985d1dca004: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:54:51.108754 7754 rebalancer_tool.cc:1090] tablet 541201ddfdf041ed87b3d0e731763a37: 'c9d2944272bc447dafce7620ac2dbd4b' -> '12ab71778f2f4b378765aaed1a0676a5' move scheduled
I20260807 13:54:56.500306 7754 rebalancer_tool.cc:1152] tablet 1715828a5d96455abecae985d1dca004: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
I20260807 13:54:56.732282 7754 rebalancer_tool.cc:1152] tablet 069a5f0089b24a609b27d4a07a3c4353: 'c9d2944272bc447dafce7620ac2dbd4b' -> '12ab71778f2f4b378765aaed1a0676a5' move completed: OK
I20260807 13:54:56.865468 7754 rebalancer_tool.cc:1152] tablet 541201ddfdf041ed87b3d0e731763a37: 'c9d2944272bc447dafce7620ac2dbd4b' -> '12ab71778f2f4b378765aaed1a0676a5' move completed: OK
W20260807 13:54:57.743639 25490 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.GetTabletLocations -> {remote=127.23.107.190:41317, user_credentials={real_user=slave}} blocked reactor thread for 57742us
W20260807 13:54:58.764468 7754 rebalancer_tool.cc:1212] table e242e42da20d4458a49a269a9569307a: no follower replicas available on edf940ebcc1140cfa0c23214e0c0f179, falling back to leader replicas
I20260807 13:54:59.232208 7754 rebalancer_tool.cc:1090] tablet 96bc42d66fa04fb69afa630969dbb579: 'edf940ebcc1140cfa0c23214e0c0f179' -> '31d7630573c8475a9f84978d4ebfb879' move scheduled
I20260807 13:54:59.300303 7754 rebalancer_tool.cc:1090] tablet 0c1327c8461e44f2ac5d77f10c390eeb: '8a9903f009ff46b4a6875490823076c4' -> '' move scheduled
I20260807 13:55:06.799764 7754 rebalancer_tool.cc:1152] tablet 0c1327c8461e44f2ac5d77f10c390eeb: '8a9903f009ff46b4a6875490823076c4' -> '' move completed: OK
I20260807 13:55:06.947013 7754 rebalancer_tool.cc:1152] tablet 96bc42d66fa04fb69afa630969dbb579: 'edf940ebcc1140cfa0c23214e0c0f179' -> '31d7630573c8475a9f84978d4ebfb879' move completed: Incomplete: tablet 96bc42d66fa04fb69afa630969dbb579, TS edf940ebcc1140cfa0c23214e0c0f179 -> TS 31d7630573c8475a9f84978d4ebfb879 move failed, target replica disappeared
W20260807 13:55:08.679680 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.23.107.129:32841, user_credentials={real_user=slave}} blocked reactor thread for 46620.7us
W20260807 13:55:09.162556 7754 rebalancer_tool.cc:1212] table e242e42da20d4458a49a269a9569307a: no follower replicas available on 01adf83af3e04875b5fac9470d4da915, falling back to leader replicas
W20260807 13:55:09.162698 7754 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e242e42da20d4458a49a269a9569307a: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 31d7630573c8475a9f84978d4ebfb879
I20260807 13:55:09.261209 7754 rebalancer_tool.cc:1100] tablet e93615e4fb61416d8740ce61970610af: 'c9d2944272bc447dafce7620ac2dbd4b' -> '8a9903f009ff46b4a6875490823076c4' move ignored: Illegal state: tablet e93615e4fb61416d8740ce61970610af: replica 8a9903f009ff46b4a6875490823076c4 is already present
I20260807 13:55:09.261397 7754 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260807 13:55:11.394750 7754 rebalancer_tool.cc:1212] table b6c061acc30c4e5aa6bee1f054e3a59a: no follower replicas available on b77f2b2eade540c6bfd4f75e5229a3cd, falling back to leader replicas
I20260807 13:55:11.737308 7754 rebalancer_tool.cc:1090] tablet 312c7ed04e334b08b506c8908224a7da: 'b77f2b2eade540c6bfd4f75e5229a3cd' -> 'c9d2944272bc447dafce7620ac2dbd4b' move scheduled
I20260807 13:55:11.903515 7754 rebalancer_tool.cc:1090] tablet 541201ddfdf041ed87b3d0e731763a37: '01adf83af3e04875b5fac9470d4da915' -> '' move scheduled
I20260807 13:55:12.743096 7754 rebalancer_tool.cc:1090] tablet bdac11c33b2b486eb34bc93def74489c: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> 'edf940ebcc1140cfa0c23214e0c0f179' move scheduled
W20260807 13:55:14.226694 28334 negotiation.cc:336] Failed RPC negotiation. Trace:
0807 13:55:14.050028 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.23.107.130:37489 (local address 127.0.0.1:32980)
0807 13:55:14.050265 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0807 13:55:14.050284 (+ 19us) client_negotiation.cc:175] Beginning negotiation
0807 13:55:14.050389 (+ 105us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0807 13:55:14.225202 (+174813us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":135}
I20260807 13:55:14.592844 7754 rebalancer_tool.cc:1152] tablet 541201ddfdf041ed87b3d0e731763a37: '01adf83af3e04875b5fac9470d4da915' -> '' move completed: OK
W20260807 13:55:18.028776 28873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.23.107.135:40385, user_credentials={real_user=slave}} blocked reactor thread for 47180.3us
W20260807 13:55:18.328238 28970 negotiation.cc:336] Failed RPC negotiation. Trace:
0807 13:55:17.909948 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.23.107.132:41217 (local address 127.0.0.1:35554)
0807 13:55:17.918893 (+ 8945us) negotiation.cc:107] Waiting for socket to connect
0807 13:55:17.918909 (+ 16us) client_negotiation.cc:175] Beginning negotiation
0807 13:55:17.919061 (+ 152us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0807 13:55:18.327984 (+408923us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":8815,"thread_start_us":59451,"threads_started":1}
W20260807 13:55:21.985635 29513 negotiation.cc:336] Failed RPC negotiation. Trace:
0807 13:55:21.584246 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.23.107.131:40441 (local address 127.0.0.1:38128)
0807 13:55:21.584409 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 13:55:21.584429 (+ 20us) client_negotiation.cc:175] Beginning negotiation
0807 13:55:21.584557 (+ 128us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0807 13:55:21.985379 (+400822us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 13:55:21.993620 29579 negotiation.cc:336] Failed RPC negotiation. Trace:
0807 13:55:21.651816 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.23.107.129:32841 (local address 127.0.0.1:39352)
0807 13:55:21.651984 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 13:55:21.651998 (+ 14us) client_negotiation.cc:175] Beginning negotiation
0807 13:55:21.652104 (+ 106us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0807 13:55:21.993407 (+341303us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metri
I20260807 13:55:24.620246 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:24.630107 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:24.655229 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:24.664407 30179 raft_consensus.cc:493] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:24.664583 30179 raft_consensus.cc:515] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:55:24.667625 30215 raft_consensus.cc:493] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:24.667863 7354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68717842b14e4f06b528c08a65acd3b7" candidate_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "12ab71778f2f4b378765aaed1a0676a5" is_pre_election: true
I20260807 13:55:24.667848 30215 raft_consensus.cc:515] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:55:24.668074 7354 raft_consensus.cc:2468] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b77f2b2eade540c6bfd4f75e5229a3cd in term 1.
W20260807 13:55:24.670979 7612 leader_election.cc:336] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:24.671312 7272 consensus_peers.cc:597] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 13:55:24.665405 30179 leader_election.cc:290] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:55:24.672300 30215 leader_election.cc:290] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
W20260807 13:55:24.674109 7613 leader_election.cc:336] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
I20260807 13:55:24.674212 7613 leader_election.cc:304] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31d7630573c8475a9f84978d4ebfb879; no voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:24.674705 30215 raft_consensus.cc:2749] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:55:24.671980 7102 leader_election.cc:336] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
W20260807 13:55:24.677642 7102 leader_election.cc:336] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:24.677744 7102 leader_election.cc:304] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5, b77f2b2eade540c6bfd4f75e5229a3cd; no voters: edf940ebcc1140cfa0c23214e0c0f179, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:24.677984 30179 raft_consensus.cc:2749] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:24.681262 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
W20260807 13:55:24.749714 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:24.788793 29835 raft_consensus.cc:493] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:24.789063 29835 raft_consensus.cc:515] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:55:24.789964 29835 leader_election.cc:290] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
W20260807 13:55:24.791664 7442 leader_election.cc:336] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
W20260807 13:55:24.792218 7443 leader_election.cc:336] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:24.792318 7443 leader_election.cc:304] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4; no voters: 01adf83af3e04875b5fac9470d4da915, c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:55:24.792641 29835 raft_consensus.cc:2749] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:55:24.823371 7613 consensus_peers.cc:597] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 13:55:24.870540 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:24.871711 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:24.878221 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:24.884718 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
W20260807 13:55:24.901142 7274 consensus_peers.cc:597] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 13:55:24.905889 30179 raft_consensus.cc:493] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:24.906109 30179 raft_consensus.cc:515] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:55:24.906860 30179 leader_election.cc:290] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
I20260807 13:55:24.915333 30179 raft_consensus.cc:493] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:24.915552 30179 raft_consensus.cc:515] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
W20260807 13:55:24.915719 7102 leader_election.cc:336] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
I20260807 13:55:24.916214 30179 leader_election.cc:290] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
W20260807 13:55:24.917166 7100 leader_election.cc:336] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
I20260807 13:55:24.917317 7100 leader_election.cc:304] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b77f2b2eade540c6bfd4f75e5229a3cd; no voters: 01adf83af3e04875b5fac9470d4da915, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:24.917681 30179 raft_consensus.cc:2749] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:55:24.919255 7101 leader_election.cc:336] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:24.920395 7102 leader_election.cc:336] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
I20260807 13:55:24.920513 7102 leader_election.cc:304] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b77f2b2eade540c6bfd4f75e5229a3cd; no voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:24.920903 30179 raft_consensus.cc:2749] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:55:25.050401 30215 raft_consensus.cc:493] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:25.050625 30215 raft_consensus.cc:515] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:55:25.051420 30215 leader_election.cc:290] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
W20260807 13:55:25.052966 7613 leader_election.cc:336] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
W20260807 13:55:25.053215 7611 leader_election.cc:336] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
I20260807 13:55:25.053318 7611 leader_election.cc:304] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31d7630573c8475a9f84978d4ebfb879; no voters: 01adf83af3e04875b5fac9470d4da915, edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:55:25.053632 30215 raft_consensus.cc:2749] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:55:25.152559 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:25.158885 30179 raft_consensus.cc:493] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:25.159114 30179 raft_consensus.cc:515] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:55:25.160197 30179 leader_election.cc:290] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385)
I20260807 13:55:25.160794 7524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27ce55f2acc4513a9fd90a338098eeb" candidate_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "8a9903f009ff46b4a6875490823076c4" is_pre_election: true
I20260807 13:55:25.161052 7524 raft_consensus.cc:2468] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b77f2b2eade540c6bfd4f75e5229a3cd in term 1.
W20260807 13:55:25.161914 7100 leader_election.cc:336] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
W20260807 13:55:25.162134 7101 leader_election.cc:336] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:25.162341 7101 leader_election.cc:304] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4, b77f2b2eade540c6bfd4f75e5229a3cd; no voters: 01adf83af3e04875b5fac9470d4da915, c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:55:25.162628 30179 raft_consensus.cc:2749] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:55:25.215173 7442 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111) [suppressed 42 similar messages]
W20260807 13:55:25.254756 7274 consensus_peers.cc:597] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 13:55:25.284029 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:25.285228 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:25.287036 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:25.289937 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:55:25.423679 7102 consensus_peers.cc:597] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260807 13:55:25.497574 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:25.503652 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:25.504089 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:25.505918 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:55:25.552917 7444 consensus_peers.cc:597] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 13:55:25.572475 7102 consensus_peers.cc:597] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 13:55:25.628556 7442 consensus_peers.cc:597] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 13:55:25.628865 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:25.822494 7613 consensus_peers.cc:597] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 13:55:25.904413 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:25.906289 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:25.916093 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:25.922643 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
W20260807 13:55:25.966604 7613 consensus_peers.cc:597] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 13:55:25.998081 7272 consensus_peers.cc:597] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 13:55:26.093343 7102 consensus_peers.cc:597] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 13:55:26.106849 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
W20260807 13:55:26.112884 7272 consensus_peers.cc:597] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 13:55:26.114606 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:26.131618 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:26.132841 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:55:26.133082 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:26.137768 29835 raft_consensus.cc:493] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:26.137926 29835 raft_consensus.cc:515] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:55:26.138581 29835 leader_election.cc:290] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
W20260807 13:55:26.146023 7444 leader_election.cc:336] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
W20260807 13:55:26.147011 7443 leader_election.cc:336] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:26.147140 7443 leader_election.cc:304] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4; no voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:26.147595 29835 raft_consensus.cc:2749] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:55:26.232478 7274 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260807 13:55:26.282727 30372 raft_consensus.cc:493] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:26.282940 30372 raft_consensus.cc:515] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:55:26.283864 30372 leader_election.cc:290] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:55:26.284745 7354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68717842b14e4f06b528c08a65acd3b7" candidate_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "12ab71778f2f4b378765aaed1a0676a5" is_pre_election: true
I20260807 13:55:26.284986 7354 raft_consensus.cc:2468] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b77f2b2eade540c6bfd4f75e5229a3cd in term 1.
W20260807 13:55:26.285902 7102 leader_election.cc:336] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
W20260807 13:55:26.286047 7102 leader_election.cc:336] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:26.286103 7102 leader_election.cc:304] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5, b77f2b2eade540c6bfd4f75e5229a3cd; no voters: edf940ebcc1140cfa0c23214e0c0f179, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:26.286293 30372 raft_consensus.cc:2749] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:55:26.381810 7611 consensus_peers.cc:597] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 13:55:26.519526 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:26.530643 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:26.541975 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:26.542750 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
W20260807 13:55:26.626499 7612 consensus_peers.cc:597] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260807 13:55:26.639496 29835 raft_consensus.cc:493] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:26.639719 29835 raft_consensus.cc:515] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:55:26.640467 29835 leader_election.cc:290] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
W20260807 13:55:26.642413 7442 leader_election.cc:336] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
W20260807 13:55:26.646405 7443 leader_election.cc:336] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:26.646543 7443 leader_election.cc:304] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4; no voters: 01adf83af3e04875b5fac9470d4da915, c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:55:26.647017 30539 raft_consensus.cc:2749] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:55:26.726358 7613 consensus_peers.cc:597] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 13:55:26.732252 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:26.740793 30372 raft_consensus.cc:493] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:26.740985 30372 raft_consensus.cc:515] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:55:26.741780 30372 leader_election.cc:290] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
W20260807 13:55:26.746904 7102 leader_election.cc:336] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
I20260807 13:55:26.755210 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:26.758337 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:26.772854 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
W20260807 13:55:26.773376 7100 leader_election.cc:336] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
I20260807 13:55:26.773716 7100 leader_election.cc:304] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b77f2b2eade540c6bfd4f75e5229a3cd; no voters: 01adf83af3e04875b5fac9470d4da915, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:26.774008 30372 raft_consensus.cc:2749] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:26.783102 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:55:26.874949 7273 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260807 13:55:26.960812 7100 consensus_peers.cc:597] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 13:55:26.983170 7274 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 13:55:27.008858 30215 raft_consensus.cc:493] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edf940ebcc1140cfa0c23214e0c0f179)
I20260807 13:55:27.009060 30215 raft_consensus.cc:515] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:55:27.009754 30215 leader_election.cc:290] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
W20260807 13:55:27.011317 7612 leader_election.cc:336] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:27.011468 7613 leader_election.cc:336] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:27.011579 7613 leader_election.cc:304] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31d7630573c8475a9f84978d4ebfb879; no voters: c9d2944272bc447dafce7620ac2dbd4b, edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:55:27.011830 30215 raft_consensus.cc:2749] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:27.123070 30539 raft_consensus.cc:493] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:27.123304 30539 raft_consensus.cc:515] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:55:27.124157 30539 leader_election.cc:290] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
W20260807 13:55:27.124737 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:27.126528 7443 leader_election.cc:336] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:27.127180 7444 leader_election.cc:336] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
I20260807 13:55:27.127307 7444 leader_election.cc:304] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4; no voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:27.127607 30539 raft_consensus.cc:2749] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:55:27.127647 7444 leader_election.cc:336] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:27.139374 30372 raft_consensus.cc:493] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:27.139568 30372 raft_consensus.cc:515] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:55:27.140327 30372 leader_election.cc:290] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
W20260807 13:55:27.142575 7102 leader_election.cc:336] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
W20260807 13:55:27.143170 7101 leader_election.cc:336] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:27.143254 7101 leader_election.cc:304] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b77f2b2eade540c6bfd4f75e5229a3cd; no voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:27.143532 30372 raft_consensus.cc:2749] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:55:27.186079 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:27.187281 30539 raft_consensus.cc:493] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:27.187546 30539 raft_consensus.cc:515] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:55:27.188460 30539 leader_election.cc:290] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
W20260807 13:55:27.190856 7444 leader_election.cc:336] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
W20260807 13:55:27.193007 7442 leader_election.cc:336] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
I20260807 13:55:27.193133 7442 leader_election.cc:304] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4; no voters: 01adf83af3e04875b5fac9470d4da915, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:27.193652 30539 raft_consensus.cc:2749] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:27.202617 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:55:27.209010 7272 consensus_peers.cc:597] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 13:55:27.209048 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:27.221606 30372 raft_consensus.cc:493] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:27.221793 30372 raft_consensus.cc:515] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:55:27.222643 30372 leader_election.cc:290] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385)
I20260807 13:55:27.223361 7524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27ce55f2acc4513a9fd90a338098eeb" candidate_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "8a9903f009ff46b4a6875490823076c4" is_pre_election: true
I20260807 13:55:27.223606 7524 raft_consensus.cc:2468] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b77f2b2eade540c6bfd4f75e5229a3cd in term 1.
I20260807 13:55:27.224269 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:27.225008 30215 raft_consensus.cc:493] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:27.225172 30215 raft_consensus.cc:515] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:55:27.225833 30215 leader_election.cc:290] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
W20260807 13:55:27.227447 7612 leader_election.cc:336] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:27.228540 7613 leader_election.cc:336] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
I20260807 13:55:27.228693 7613 leader_election.cc:304] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31d7630573c8475a9f84978d4ebfb879; no voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:27.229221 30215 raft_consensus.cc:2749] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:55:27.231756 7100 leader_election.cc:336] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
W20260807 13:55:27.232489 7101 leader_election.cc:336] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:27.232596 7101 leader_election.cc:304] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4, b77f2b2eade540c6bfd4f75e5229a3cd; no voters: 01adf83af3e04875b5fac9470d4da915, c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:55:27.233065 30372 raft_consensus.cc:2749] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:55:27.292481 7274 consensus_peers.cc:597] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 13:55:27.347316 7613 consensus_peers.cc:597] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260807 13:55:27.404644 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:27.412932 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:27.415685 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:27.424991 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
W20260807 13:55:27.692751 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:27.809381 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:27.811571 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:27.822279 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:27.837052 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:27.845957 30539 raft_consensus.cc:493] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:27.846184 30539 raft_consensus.cc:515] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:55:27.846868 30539 leader_election.cc:290] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
W20260807 13:55:27.859840 7444 leader_election.cc:336] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
W20260807 13:55:27.861809 7443 leader_election.cc:336] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:27.862006 7443 leader_election.cc:304] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4; no voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:27.863466 30539 raft_consensus.cc:2749] T 782ac4fa94fb4183940fca514cc068b0 P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:55:27.863799 7274 consensus_peers.cc:597] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 13:55:27.928897 7102 consensus_peers.cc:597] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260807 13:55:27.962478 7102 consensus_peers.cc:597] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260807 13:55:27.995713 30215 raft_consensus.cc:493] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:27.995934 30215 raft_consensus.cc:515] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:55:27.996742 30215 leader_election.cc:290] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
W20260807 13:55:28.000489 7613 leader_election.cc:336] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
W20260807 13:55:28.013156 7611 leader_election.cc:336] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
I20260807 13:55:28.013367 7611 leader_election.cc:304] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31d7630573c8475a9f84978d4ebfb879; no voters: 01adf83af3e04875b5fac9470d4da915, edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:55:28.013656 30215 raft_consensus.cc:2749] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:55:28.042479 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:28.046254 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
W20260807 13:55:28.056177 7444 consensus_peers.cc:597] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260807 13:55:28.056553 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:28.057566 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
W20260807 13:55:28.169059 7442 consensus_peers.cc:597] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 13:55:28.178401 7613 consensus_peers.cc:597] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 13:55:28.203698 30744 raft_consensus.cc:493] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:28.203874 30744 raft_consensus.cc:515] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:55:28.204594 30744 leader_election.cc:290] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:55:28.205159 7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68717842b14e4f06b528c08a65acd3b7" candidate_uuid: "12ab71778f2f4b378765aaed1a0676a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" is_pre_election: true
I20260807 13:55:28.205426 7179 raft_consensus.cc:2468] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12ab71778f2f4b378765aaed1a0676a5 in term 1.
W20260807 13:55:28.206523 7274 leader_election.cc:336] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
W20260807 13:55:28.206779 7274 leader_election.cc:336] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:28.206881 7274 leader_election.cc:304] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5, b77f2b2eade540c6bfd4f75e5229a3cd; no voters: edf940ebcc1140cfa0c23214e0c0f179, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:28.207152 30744 raft_consensus.cc:2749] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:28.230569 30539 raft_consensus.cc:493] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edf940ebcc1140cfa0c23214e0c0f179)
I20260807 13:55:28.230787 30539 raft_consensus.cc:515] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:55:28.231724 30539 leader_election.cc:290] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075)
I20260807 13:55:28.232977 7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93615e4fb61416d8740ce61970610af" candidate_uuid: "8a9903f009ff46b4a6875490823076c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" is_pre_election: true
W20260807 13:55:28.233317 7444 leader_election.cc:336] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
W20260807 13:55:28.233507 7443 leader_election.cc:336] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:28.233697 7443 leader_election.cc:304] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4; no voters: c9d2944272bc447dafce7620ac2dbd4b, edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:55:28.234025 30539 raft_consensus.cc:2749] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:55:28.234117 7443 leader_election.cc:343] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): Illegal state: cannot vote while shut down
W20260807 13:55:28.302313 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:28.419930 7272 consensus_peers.cc:597] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 13:55:28.460448 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:28.464114 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:28.464588 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:28.468237 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:55:28.523670 7613 consensus_peers.cc:597] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 13:55:28.617115 7102 consensus_peers.cc:597] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 13:55:28.652467 30882 raft_consensus.cc:493] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:28.652671 30882 raft_consensus.cc:515] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:55:28.653594 30882 leader_election.cc:290] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
W20260807 13:55:28.656494 7443 leader_election.cc:336] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:28.656814 7444 leader_election.cc:336] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
I20260807 13:55:28.656931 7444 leader_election.cc:304] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4; no voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:28.657192 30882 raft_consensus.cc:2749] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:55:28.657481 7444 leader_election.cc:336] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:28.681945 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
W20260807 13:55:28.686976 7272 consensus_peers.cc:597] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 13:55:28.694082 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:28.707019 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:28.714672 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:55:28.840345 7274 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260807 13:55:28.909978 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:29.056039 7611 consensus_peers.cc:597] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 13:55:29.062597 7612 consensus_peers.cc:597] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260807 13:55:29.117398 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:29.125577 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:29.133451 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:29.142557 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
W20260807 13:55:29.248389 7613 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111) [suppressed 69 similar messages]
W20260807 13:55:29.306071 7101 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111) [suppressed 65 similar messages]
W20260807 13:55:29.308226 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:29.325816 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:29.329535 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:29.336689 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:29.336988 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
W20260807 13:55:29.341590 7613 consensus_peers.cc:597] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 13:55:29.342538 7274 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111) [suppressed 80 similar messages]
W20260807 13:55:29.357152 7273 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260807 13:55:29.361986 7100 consensus_peers.cc:597] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 13:55:29.494303 7274 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 13:55:29.669169 7613 consensus_peers.cc:597] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260807 13:55:29.735641 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:29.760094 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:29.761515 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:29.778970 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:55:29.855087 7274 consensus_peers.cc:597] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260807 13:55:29.896733 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:29.909013 7272 consensus_peers.cc:597] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260807 13:55:29.922497 31053 raft_consensus.cc:493] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:29.922698 31053 raft_consensus.cc:515] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }
I20260807 13:55:29.923425 31053 leader_election.cc:290] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
W20260807 13:55:29.925395 7612 leader_election.cc:336] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:29.925540 7613 leader_election.cc:336] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
I20260807 13:55:29.925668 7613 leader_election.cc:304] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31d7630573c8475a9f84978d4ebfb879; no voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:29.925940 31053 raft_consensus.cc:2749] T 50a090faa58e4f91961c9251030efacf P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:55:29.995500 7274 consensus_peers.cc:597] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260807 13:55:29.999671 30744 raft_consensus.cc:493] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:29.999922 30744 raft_consensus.cc:515] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:55:30.000684 30744 leader_election.cc:290] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:55:30.001192 7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68717842b14e4f06b528c08a65acd3b7" candidate_uuid: "12ab71778f2f4b378765aaed1a0676a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" is_pre_election: true
I20260807 13:55:30.001513 7179 raft_consensus.cc:2468] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12ab71778f2f4b378765aaed1a0676a5 in term 1.
I20260807 13:55:30.014420 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:30.025053 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:30.035079 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
W20260807 13:55:30.036731 7274 leader_election.cc:336] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
W20260807 13:55:30.037021 7274 leader_election.cc:336] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:30.038939 7274 leader_election.cc:304] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5, b77f2b2eade540c6bfd4f75e5229a3cd; no voters: edf940ebcc1140cfa0c23214e0c0f179, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:30.044150 30882 raft_consensus.cc:493] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:30.044303 30882 raft_consensus.cc:515] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:55:30.045046 30882 leader_election.cc:290] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:55:30.045452 30744 raft_consensus.cc:2749] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:30.045657 7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27ce55f2acc4513a9fd90a338098eeb" candidate_uuid: "8a9903f009ff46b4a6875490823076c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" is_pre_election: true
I20260807 13:55:30.045869 7179 raft_consensus.cc:2468] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a9903f009ff46b4a6875490823076c4 in term 1.
W20260807 13:55:30.053866 7442 leader_election.cc:336] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
W20260807 13:55:30.054172 7443 leader_election.cc:336] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:30.054270 7443 leader_election.cc:304] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4, b77f2b2eade540c6bfd4f75e5229a3cd; no voters: 01adf83af3e04875b5fac9470d4da915, c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:55:30.054757 30882 raft_consensus.cc:2749] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:30.055639 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:30.226632 30372 raft_consensus.cc:493] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:30.226799 30372 raft_consensus.cc:515] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:55:30.227479 30372 leader_election.cc:290] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
W20260807 13:55:30.228983 7102 leader_election.cc:336] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
W20260807 13:55:30.229250 7100 leader_election.cc:336] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
I20260807 13:55:30.229374 7100 leader_election.cc:304] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b77f2b2eade540c6bfd4f75e5229a3cd; no voters: 01adf83af3e04875b5fac9470d4da915, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:30.229629 30372 raft_consensus.cc:2749] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:30.304661 30882 raft_consensus.cc:493] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:30.304877 30882 raft_consensus.cc:515] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:55:30.305653 30882 leader_election.cc:290] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
W20260807 13:55:30.306303 7443 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:30.306303 7442 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111) [suppressed 38 similar messages]
W20260807 13:55:30.307385 7443 leader_election.cc:336] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:30.307629 7442 leader_election.cc:336] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
I20260807 13:55:30.307714 7442 leader_election.cc:304] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4; no voters: 01adf83af3e04875b5fac9470d4da915, c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:55:30.307965 30882 raft_consensus.cc:2749] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:30.383339 30215 raft_consensus.cc:493] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edf940ebcc1140cfa0c23214e0c0f179)
I20260807 13:55:30.383592 30215 raft_consensus.cc:515] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:55:30.384577 30215 leader_election.cc:290] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
W20260807 13:55:30.386318 7613 leader_election.cc:336] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
W20260807 13:55:30.386658 7612 leader_election.cc:336] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:30.386804 7612 leader_election.cc:304] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31d7630573c8475a9f84978d4ebfb879; no voters: c9d2944272bc447dafce7620ac2dbd4b, edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:55:30.387138 30215 raft_consensus.cc:2749] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:30.444555 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
W20260807 13:55:30.447635 7102 consensus_peers.cc:597] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260807 13:55:30.453125 7444 consensus_peers.cc:597] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260807 13:55:30.453974 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
W20260807 13:55:30.463354 7102 consensus_peers.cc:597] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260807 13:55:30.463799 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:30.465986 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:30.466030 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:55:30.615952 7442 consensus_peers.cc:597] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260807 13:55:30.669966 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:30.683954 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:30.687372 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:30.688726 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:55:30.723397 7613 consensus_peers.cc:597] T 81cbb42cd4954383976169ec16ef2416 P 31d7630573c8475a9f84978d4ebfb879 -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 13:55:30.804153 7613 consensus_peers.cc:597] T 069a5f0089b24a609b27d4a07a3c4353 P 31d7630573c8475a9f84978d4ebfb879 -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 13:55:30.821134 7272 consensus_peers.cc:597] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 13:55:30.912901 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:30.959785 7272 consensus_peers.cc:597] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260807 13:55:31.084560 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:31.088727 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:31.092446 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:31.101855 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
W20260807 13:55:31.194211 7102 consensus_peers.cc:597] T d06f352d0ff34b45b753a2c20f65574f P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 13:55:31.297248 7274 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260807 13:55:31.318737 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:31.321643 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:31.321986 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:31.323779 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:55:31.377228 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:31.595728 30882 raft_consensus.cc:493] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edf940ebcc1140cfa0c23214e0c0f179)
I20260807 13:55:31.595928 30882 raft_consensus.cc:515] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:55:31.596740 30882 leader_election.cc:290] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075)
I20260807 13:55:31.598026 7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93615e4fb61416d8740ce61970610af" candidate_uuid: "8a9903f009ff46b4a6875490823076c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" is_pre_election: true
W20260807 13:55:31.598191 7444 leader_election.cc:336] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
W20260807 13:55:31.598804 7443 leader_election.cc:343] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): Illegal state: cannot vote while shut down
I20260807 13:55:31.598939 7443 leader_election.cc:304] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4; no voters: b77f2b2eade540c6bfd4f75e5229a3cd, edf940ebcc1140cfa0c23214e0c0f179
W20260807 13:55:31.599206 7443 leader_election.cc:336] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:31.599205 30882 raft_consensus.cc:2749] T e93615e4fb61416d8740ce61970610af P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:55:31.722848 7611 consensus_peers.cc:597] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260807 13:55:31.729157 7612 consensus_peers.cc:597] T a29bfc37eabb411f845203c281444086 P 31d7630573c8475a9f84978d4ebfb879 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260807 13:55:31.730703 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
W20260807 13:55:31.733083 7274 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260807 13:55:31.755534 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:31.759478 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:31.768615 30882 raft_consensus.cc:493] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:31.768781 30882 raft_consensus.cc:515] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } }
I20260807 13:55:31.769557 30882 leader_election.cc:290] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
I20260807 13:55:31.771947 7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27ce55f2acc4513a9fd90a338098eeb" candidate_uuid: "8a9903f009ff46b4a6875490823076c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" is_pre_election: true
I20260807 13:55:31.772230 7179 raft_consensus.cc:2468] T d27ce55f2acc4513a9fd90a338098eeb P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a9903f009ff46b4a6875490823076c4 in term 1.
I20260807 13:55:31.778190 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:55:31.780741 7442 leader_election.cc:336] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
W20260807 13:55:31.784185 7443 leader_election.cc:336] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:31.784320 7443 leader_election.cc:304] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4, b77f2b2eade540c6bfd4f75e5229a3cd; no voters: 01adf83af3e04875b5fac9470d4da915, c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:55:31.784875 30882 raft_consensus.cc:2749] T d27ce55f2acc4513a9fd90a338098eeb P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:55:31.835669 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:31.846412 7613 consensus_peers.cc:597] T b414c896ad884facb339e5e4a0329065 P 31d7630573c8475a9f84978d4ebfb879 -> Peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Couldn't send request to peer fa83b7af134b4e3b949ac3b4e4bcb5e7. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260807 13:55:31.886749 30882 raft_consensus.cc:493] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:31.886994 30882 raft_consensus.cc:515] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:55:31.887846 30882 leader_election.cc:290] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
W20260807 13:55:31.889945 7444 leader_election.cc:336] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
W20260807 13:55:31.890149 7444 leader_election.cc:336] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:31.890283 7444 leader_election.cc:304] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4; no voters: edf940ebcc1140cfa0c23214e0c0f179, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:31.890571 30882 raft_consensus.cc:2749] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:55:31.890934 7443 leader_election.cc:336] T bdac11c33b2b486eb34bc93def74489c P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:31.921198 7100 consensus_peers.cc:597] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260807 13:55:31.925653 7273 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Couldn't send request to peer c9d2944272bc447dafce7620ac2dbd4b. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260807 13:55:31.995774 30215 raft_consensus.cc:493] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:31.995986 30215 raft_consensus.cc:515] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } }
I20260807 13:55:31.996711 30215 leader_election.cc:290] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217), 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441)
W20260807 13:55:32.000326 7613 leader_election.cc:336] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:32.003362 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
W20260807 13:55:32.010111 7611 leader_election.cc:336] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
I20260807 13:55:32.010265 7611 leader_election.cc:304] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31d7630573c8475a9f84978d4ebfb879; no voters: 01adf83af3e04875b5fac9470d4da915, edf940ebcc1140cfa0c23214e0c0f179
I20260807 13:55:32.010565 30215 raft_consensus.cc:2749] T 80898a5a2cf046f1b7344dfceb175bbd P 31d7630573c8475a9f84978d4ebfb879 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:55:32.017144 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:32.017861 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:32.025034 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:32.184939 30372 raft_consensus.cc:493] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:32.185155 30372 raft_consensus.cc:515] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } }
I20260807 13:55:32.185786 30372 leader_election.cc:290] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489)
W20260807 13:55:32.187180 7102 leader_election.cc:336] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
W20260807 13:55:32.187337 7101 leader_election.cc:336] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:32.187458 7101 leader_election.cc:304] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b77f2b2eade540c6bfd4f75e5229a3cd; no voters: c9d2944272bc447dafce7620ac2dbd4b, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:32.187668 30372 raft_consensus.cc:2749] T d02aa7a26c024b4083421b5d742f7bcb P b77f2b2eade540c6bfd4f75e5229a3cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:55:32.225641 31419 raft_consensus.cc:493] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01adf83af3e04875b5fac9470d4da915)
I20260807 13:55:32.225907 31419 raft_consensus.cc:515] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "8a9903f009ff46b4a6875490823076c4" member_type: VOTER last_known_addr { host: "127.23.107.135" port: 40385 } } peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } }
I20260807 13:55:32.226763 31419 leader_election.cc:290] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441), fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841)
W20260807 13:55:32.228139 7442 leader_election.cc:336] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111)
W20260807 13:55:32.228359 7444 leader_election.cc:336] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
I20260807 13:55:32.228547 7444 leader_election.cc:304] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a9903f009ff46b4a6875490823076c4; no voters: 01adf83af3e04875b5fac9470d4da915, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:32.228842 30882 raft_consensus.cc:2749] T 43f5461808a646c885d593f782538930 P 8a9903f009ff46b4a6875490823076c4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:55:32.265477 7613 consensus_peers.cc:597] T c10b910e9f354933b60ae70f1baa9b6f P 31d7630573c8475a9f84978d4ebfb879 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260807 13:55:32.400575 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:32.409895 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
W20260807 13:55:32.419932 7274 consensus_peers.cc:597] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260807 13:55:32.423862 7272 consensus_peers.cc:597] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260807 13:55:32.425016 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
I20260807 13:55:32.435792 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
W20260807 13:55:32.458925 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
I20260807 13:55:32.460341 30372 raft_consensus.cc:493] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa83b7af134b4e3b949ac3b4e4bcb5e7)
I20260807 13:55:32.460513 30372 raft_consensus.cc:515] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "fa83b7af134b4e3b949ac3b4e4bcb5e7" member_type: VOTER last_known_addr { host: "127.23.107.129" port: 32841 } } peers { permanent_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" member_type: VOTER last_known_addr { host: "127.23.107.133" port: 38075 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } } peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } }
I20260807 13:55:32.467929 30372 leader_election.cc:290] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841), 12ab71778f2f4b378765aaed1a0676a5 (127.23.107.134:35975), edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217)
I20260807 13:55:32.468888 7354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68717842b14e4f06b528c08a65acd3b7" candidate_uuid: "b77f2b2eade540c6bfd4f75e5229a3cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "12ab71778f2f4b378765aaed1a0676a5" is_pre_election: true
I20260807 13:55:32.469129 7354 raft_consensus.cc:2468] T 68717842b14e4f06b528c08a65acd3b7 P 12ab71778f2f4b378765aaed1a0676a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b77f2b2eade540c6bfd4f75e5229a3cd in term 1.
W20260807 13:55:32.470490 7102 leader_election.cc:336] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa83b7af134b4e3b949ac3b4e4bcb5e7 (127.23.107.129:32841): Network error: Client connection negotiation failed: client connection to 127.23.107.129:32841: connect: Connection refused (error 111)
W20260807 13:55:32.470685 7102 leader_election.cc:336] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111)
I20260807 13:55:32.470814 7102 leader_election.cc:304] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 12ab71778f2f4b378765aaed1a0676a5, b77f2b2eade540c6bfd4f75e5229a3cd; no voters: edf940ebcc1140cfa0c23214e0c0f179, fa83b7af134b4e3b949ac3b4e4bcb5e7
I20260807 13:55:32.471800 30372 raft_consensus.cc:2749] T 68717842b14e4f06b528c08a65acd3b7 P b77f2b2eade540c6bfd4f75e5229a3cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:55:32.614111 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:32.619345 7668 tablet_service.cc:1467] Tablet server has 5 leaders and 0 scanners
I20260807 13:55:32.624538 7502 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260807 13:55:32.641116 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
W20260807 13:55:32.695521 7274 consensus_peers.cc:597] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260807 13:55:32.747879 7741 maintenance_manager.cc:419] P 31d7630573c8475a9f84978d4ebfb879: Scheduling FlushMRSOp(e22d4edb78d24783bae07928b6c95fc2): perf score=0.033394
W20260807 13:55:32.751535 7614 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-7/data/data (495304704 bytes available vs 518351011 bytes reserved) (error 28)
W20260807 13:55:32.752409 7614 tablet_replica_mm_ops.cc:214] T e22d4edb78d24783bae07928b6c95fc2 P 31d7630573c8475a9f84978d4ebfb879: failed to flush MRS: IO error: Failed to open DiskRowSet for flush: tablet e22d4edb78d24783bae07928b6c95fc2: unable to open output file for column key INT32 NOT NULL: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in e22d4edb78d24783bae07928b6c95fc2's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
F20260807 13:55:32.752561 7614 tablet_replica_mm_ops.cc:215] Check failed: tablet->HasBeenStopped() Unrecoverable flush failure caused by error: IO error: Failed to open DiskRowSet for flush: tablet e22d4edb78d24783bae07928b6c95fc2: unable to open output file for column key INT32 NOT NULL: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in e22d4edb78d24783bae07928b6c95fc2's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
*** Check failure stack trace: ***
@ 0x7f2d709c5d5d google::LogMessage::Fail() at ??:0
@ 0x7f2d709c9b23 google::LogMessage::SendToLog() at ??:0
@ 0x7f2d709c575c google::LogMessage::Flush() at ??:0
@ 0x7f2d709c6ee9 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f2d80b2e8bd kudu::tablet::FlushMRSOp::Perform() at ??:0
@ 0x7f2d73797b09 kudu::MaintenanceManager::LaunchOp() at ??:0
@ 0x7f2d7379aa43 kudu::MaintenanceManager::RunSchedulerThread()::$_3::operator()() at ??:0
@ 0x7f2d7379a8d9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa68ad std::function<>::operator()() at ??:?
W20260807 13:55:32.783552 7102 consensus_peers.cc:597] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
@ 0x7f2d7370e850 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f2d73711b4c kudu::ThreadPool::CreateThread()::$_1::operator()() at ??:0
@ 0x7f2d737119c9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa68ad std::function<>::operator()() at ??:?
@ 0x7f2d736eddd9 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f2d76dbd6db start_thread at ??:0
@ 0x7f2d6f87461f clone at ??:0
I20260807 13:55:32.990684 7590 maintenance_manager.cc:419] P 8a9903f009ff46b4a6875490823076c4: Scheduling FlushMRSOp(ffa98a163d7540e3a911a39334657138): perf score=0.033361
W20260807 13:55:33.002444 7445 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-6/data/data (495251456 bytes available vs 518351011 bytes reserved) (error 28)
W20260807 13:55:33.003536 7445 tablet_replica_mm_ops.cc:214] T ffa98a163d7540e3a911a39334657138 P 8a9903f009ff46b4a6875490823076c4: failed to flush MRS: IO error: Failed to open DiskRowSet for flush: tablet ffa98a163d7540e3a911a39334657138: unable to open output file for column key INT32 NOT NULL: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in ffa98a163d7540e3a911a39334657138's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
F20260807 13:55:33.004594 7445 tablet_replica_mm_ops.cc:215] Check failed: tablet->HasBeenStopped() Unrecoverable flush failure caused by error: IO error: Failed to open DiskRowSet for flush: tablet ffa98a163d7540e3a911a39334657138: unable to open output file for column key INT32 NOT NULL: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in ffa98a163d7540e3a911a39334657138's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
*** Check failure stack trace: ***
@ 0x7feee632ed5d google::LogMessage::Fail() at ??:0
@ 0x7feee6332b23 google::LogMessage::SendToLog() at ??:0
W20260807 13:55:33.023541 7444 consensus_peers.cc:597] T 522c3523f2af4eb29e30fa55da2acd3e P 8a9903f009ff46b4a6875490823076c4 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
@ 0x7feee632e75c google::LogMessage::Flush() at ??:0
W20260807 13:55:33.028254 7442 consensus_peers.cc:597] T eab259b597a64c04869543ccb1d9038c P 8a9903f009ff46b4a6875490823076c4 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
@ 0x7feee632fee9 google::LogMessageFatal::~LogMessageFatal() at ??:0
W20260807 13:55:33.044653 7102 consensus_peers.cc:597] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
@ 0x7feef64978bd kudu::tablet::FlushMRSOp::Perform() at ??:0
I20260807 13:55:33.051858 7251 maintenance_manager.cc:419] P b77f2b2eade540c6bfd4f75e5229a3cd: Scheduling FlushMRSOp(966ebd287fc14e498e5bd3e6542194ca): perf score=0.033369
@ 0x7feee9100b09 kudu::MaintenanceManager::LaunchOp() at ??:0
@ 0x7feee9103a43 kudu::MaintenanceManager::RunSchedulerThread()::$_3::operator()() at ??:0
W20260807 13:55:33.068711 7101 consensus_peers.cc:576] T 312c7ed04e334b08b506c8908224a7da P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer c9d2944272bc447dafce7620ac2dbd4b (127.23.107.130:37489): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.23.107.130:37489: connect: Connection refused (error 111)
W20260807 13:55:33.078953 7104 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-4/data/data (495251456 bytes available vs 518351011 bytes reserved) (error 28)
W20260807 13:55:33.080080 7104 tablet_replica_mm_ops.cc:214] T 966ebd287fc14e498e5bd3e6542194ca P b77f2b2eade540c6bfd4f75e5229a3cd: failed to flush MRS: IO error: Failed to open DiskRowSet for flush: tablet 966ebd287fc14e498e5bd3e6542194ca: unable to open output file for column key INT32 NOT NULL: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in 966ebd287fc14e498e5bd3e6542194ca's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
F20260807 13:55:33.080201 7104 tablet_replica_mm_ops.cc:215] Check failed: tablet->HasBeenStopped() Unrecoverable flush failure caused by error: IO error: Failed to open DiskRowSet for flush: tablet 966ebd287fc14e498e5bd3e6542194ca: unable to open output file for column key INT32 NOT NULL: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in 966ebd287fc14e498e5bd3e6542194ca's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
*** Check failure stack trace: ***
@ 0x7f753329ed5d google::LogMessage::Fail() at ??:0
@ 0x7f75332a2b23 google::LogMessage::SendToLog() at ??:0
@ 0x7f753329e75c google::LogMessage::Flush() at ??:0
@ 0x7feee91038d9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f753329fee9 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0xaa68ad std::function<>::operator()() at ??:?
W20260807 13:55:33.101606 7099 connection.cc:573] client connection to 127.23.107.136:43729 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 13:55:33.104636 31418 negotiation.cc:336] Failed RPC negotiation. Trace:
0807 13:55:33.102550 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.23.107.136:43729 (local address 127.23.107.133:35491)
0807 13:55:33.103444 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0807 13:55:33.103549 (+ 105us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.107.136:43729: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":707}
W20260807 13:55:33.105249 7099 consensus_peers.cc:597] T 541201ddfdf041ed87b3d0e731763a37 P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729): Couldn't send request to peer 31d7630573c8475a9f84978d4ebfb879. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.136:43729: connect: Connection reset by peer (error 104). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:55:33.116778 7099 consensus_peers.cc:597] T 04dac80fea124c25b34af8cc290c0d7f P b77f2b2eade540c6bfd4f75e5229a3cd -> Peer 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729): Couldn't send request to peer 31d7630573c8475a9f84978d4ebfb879. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.136:43729: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
@ 0x7feee9077850 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7feee907ab4c kudu::ThreadPool::CreateThread()::$_1::operator()() at ??:0
@ 0x7feee907a9c9 std::_Function_handler<>::_M_invoke() at ??:0
I20260807 13:55:33.135571 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
@ 0xaa68ad std::function<>::operator()() at ??:?
@ 0x7feee9056dd9 kudu::Thread::SuperviseThread() at ??:0
@ 0x7feeec7266db start_thread at ??:0
@ 0x7feee51dd61f clone at ??:0
@ 0x7f75434078bd kudu::tablet::FlushMRSOp::Perform() at ??:0
@ 0x7f7536070b09 kudu::MaintenanceManager::LaunchOp() at ??:0
I20260807 13:55:33.190227 7158 tablet_service.cc:1467] Tablet server has 4 leaders and 0 scanners
@ 0x7f7536073a43 kudu::MaintenanceManager::RunSchedulerThread()::$_3::operator()() at ??:0
@ 0x7f75360738d9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa68ad std::function<>::operator()() at ??:?
@ 0x7f7535fe7850 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f7535feab4c kudu::ThreadPool::CreateThread()::$_1::operator()() at ??:0
@ 0x7f7535fea9c9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa68ad std::function<>::operator()() at ??:?
@ 0x7f7535fc6dd9 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f75396966db start_thread at ??:0
@ 0x7f753214d61f clone at ??:0
W20260807 13:55:33.261214 7271 consensus_peers.cc:597] T 242a68df09cb4c7d9522a33d259ebf78 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer 31d7630573c8475a9f84978d4ebfb879 (127.23.107.136:43729): Couldn't send request to peer 31d7630573c8475a9f84978d4ebfb879. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.136:43729: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:55:33.430279 7274 connection.cc:573] client connection to 127.23.107.135:40385 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 13:55:33.431640 7274 consensus_peers.cc:597] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): Couldn't send request to peer 8a9903f009ff46b4a6875490823076c4. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.135:40385: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:55:33.461534 7274 consensus_peers.cc:597] T faef317e47a244c6965864f82f21edfa P 12ab71778f2f4b378765aaed1a0676a5 -> Peer 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): Couldn't send request to peer 8a9903f009ff46b4a6875490823076c4. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.135:40385: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:55:33.488672 7274 consensus_peers.cc:597] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 -> Peer 8a9903f009ff46b4a6875490823076c4 (127.23.107.135:40385): Couldn't send request to peer 8a9903f009ff46b4a6875490823076c4. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.135:40385: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:55:33.515672 7273 connection.cc:573] client connection to 127.23.107.133:38075 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 13:55:33.517155 7273 consensus_peers.cc:597] T 1715828a5d96455abecae985d1dca004 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer b77f2b2eade540c6bfd4f75e5229a3cd (127.23.107.133:38075): Couldn't send request to peer b77f2b2eade540c6bfd4f75e5229a3cd. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.133:38075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:55:33.571977 7272 consensus_peers.cc:597] T 739f4f0207104455bf3e87bc04f8d13c P 12ab71778f2f4b378765aaed1a0676a5 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260807 13:55:33.604064 7272 consensus_peers.cc:597] T 16afb6ff06704a8795f1de84ffa81de0 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer 01adf83af3e04875b5fac9470d4da915 (127.23.107.131:40441): Couldn't send request to peer 01adf83af3e04875b5fac9470d4da915. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.131:40441: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260807 13:55:33.674342 7327 tablet_service.cc:1467] Tablet server has 6 leaders and 0 scanners
I20260807 13:55:33.675181 7416 maintenance_manager.cc:419] P 12ab71778f2f4b378765aaed1a0676a5: Scheduling FlushMRSOp(d06f352d0ff34b45b753a2c20f65574f): perf score=0.033394
W20260807 13:55:33.678689 7275 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0/raft_consensus-itest-cluster/ts-5/data/data (495214592 bytes available vs 518351011 bytes reserved) (error 28)
W20260807 13:55:33.679747 7275 tablet_replica_mm_ops.cc:214] T d06f352d0ff34b45b753a2c20f65574f P 12ab71778f2f4b378765aaed1a0676a5: failed to flush MRS: IO error: Failed to open DiskRowSet for flush: tablet d06f352d0ff34b45b753a2c20f65574f: unable to open output file for column key INT32 NOT NULL: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in d06f352d0ff34b45b753a2c20f65574f's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
F20260807 13:55:33.679930 7275 tablet_replica_mm_ops.cc:215] Check failed: tablet->HasBeenStopped() Unrecoverable flush failure caused by error: IO error: Failed to open DiskRowSet for flush: tablet d06f352d0ff34b45b753a2c20f65574f: unable to open output file for column key INT32 NOT NULL: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in d06f352d0ff34b45b753a2c20f65574f's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
*** Check failure stack trace: ***
@ 0x7fc1612ead5d google::LogMessage::Fail() at ??:0
@ 0x7fc1612eeb23 google::LogMessage::SendToLog() at ??:0
@ 0x7fc1612ea75c google::LogMessage::Flush() at ??:0
@ 0x7fc1612ebee9 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fc1714538bd kudu::tablet::FlushMRSOp::Perform() at ??:0
@ 0x7fc1640bcb09 kudu::MaintenanceManager::LaunchOp() at ??:0
@ 0x7fc1640bfa43 kudu::MaintenanceManager::RunSchedulerThread()::$_3::operator()() at ??:0
@ 0x7fc1640bf8d9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa68ad std::function<>::operator()() at ??:?
@ 0x7fc164033850 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fc164036b4c kudu::ThreadPool::CreateThread()::$_1::operator()() at ??:0
@ 0x7fc1640369c9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa68ad std::function<>::operator()() at ??:?
W20260807 13:55:33.732821 7274 consensus_peers.cc:597] T 96bc42d66fa04fb69afa630969dbb579 P 12ab71778f2f4b378765aaed1a0676a5 -> Peer edf940ebcc1140cfa0c23214e0c0f179 (127.23.107.132:41217): Couldn't send request to peer edf940ebcc1140cfa0c23214e0c0f179. Status: Network error: Client connection negotiation failed: client connection to 127.23.107.132:41217: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
@ 0x7fc164012dd9 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fc1676e26db start_thread at ??:0
@ 0x7fc16019961f clone at ??:0
I20260807 13:55:34.143672 7749 rebalancer_tool-test.cc:1258] rebalancer run info: Runtime error: /tmp/dist-test-task2KnpY3/build/asan/bin/kudu: process exited with non-zero status 1
stdout: Per-server replica distribution summary:
Statistic | Value
-----------------------+-----------
Minimum Replica Count | 0
Maximum Replica Count | 23
Average Replica Count | 11.250000
Per-table replica distribution summary:
Replica Skew | Value
--------------+----------
Minimum | 3
Maximum | 3
Average | 3.000000
stderr: W20260807 13:53:25.685473 7755 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:53:25.685914 7755 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260807 13:53:28.984730 7755 rebalancer_tool.cc:215] running whole-cluster rebalancing
W20260807 13:53:31.498384 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 96e83925faa542ffa4808b01a5adbbb3: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:31.498744 7755 rebalancer_tool.cc:1212] table b6c061acc30c4e5aa6bee1f054e3a59a: no follower replicas available on c9d2944272bc447dafce7620ac2dbd4b, falling back to leader replicas
W20260807 13:53:31.498977 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 6008038c907645199b055dacb5772621: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:31.499198 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 7f1d26639edd4cb398339b2b0d3659a3: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:31.505280 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 14867b014aab43119171102f60bb134d: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:31.506031 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b6c061acc30c4e5aa6bee1f054e3a59a: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:31.506276 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 14867b014aab43119171102f60bb134d: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:31.506451 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table e242e42da20d4458a49a269a9569307a: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:31.507380 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 2ff801ea568346e096cc895a279c109c: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:31.507504 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 35d13981f3a742dd9369d1e7bf18498c: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:31.507637 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 91303cf8b9064e06b8c4165942b287f2: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:31.507741 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table c2c7db1795a1414c8299bebbeaf60404: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:31.507836 7755 rebalancer_tool.cc:1212] table 14867b014aab43119171102f60bb134d: no follower replicas available on 01adf83af3e04875b5fac9470d4da915, falling back to leader replicas
W20260807 13:53:31.507947 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 14867b014aab43119171102f60bb134d: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:31.508067 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 6008038c907645199b055dacb5772621: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:31.508194 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 7f1d26639edd4cb398339b2b0d3659a3: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:31.508320 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 91303cf8b9064e06b8c4165942b287f2: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server b77f2b2eade540c6bfd4f75e5229a3cd
I20260807 13:53:32.348269 7755 rebalancer_tool.cc:1090] tablet ffa98a163d7540e3a911a39334657138: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '8a9903f009ff46b4a6875490823076c4' move scheduled
I20260807 13:53:33.382332 7755 rebalancer_tool.cc:1090] tablet 782ac4fa94fb4183940fca514cc068b0: 'edf940ebcc1140cfa0c23214e0c0f179' -> '12ab71778f2f4b378765aaed1a0676a5' move scheduled
I20260807 13:53:33.930280 7755 rebalancer_tool.cc:1090] tablet 312c7ed04e334b08b506c8908224a7da: '01adf83af3e04875b5fac9470d4da915' -> 'b77f2b2eade540c6bfd4f75e5229a3cd' move scheduled
I20260807 13:53:34.313798 7755 rebalancer_tool.cc:1100] tablet 43f5461808a646c885d593f782538930: 'c9d2944272bc447dafce7620ac2dbd4b' -> '31d7630573c8475a9f84978d4ebfb879' move ignored: Illegal state: tablet 43f5461808a646c885d593f782538930: replica 31d7630573c8475a9f84978d4ebfb879 is already present
I20260807 13:53:34.314011 7755 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260807 13:53:35.993886 9368 outbound_call.cc:321] RPC callback for RPC call kudu.server.GenericService.ServerClock -> {remote=127.23.107.133:38075, user_credentials={real_user=slave}} blocked reactor thread for 50959.7us
W20260807 13:53:36.395397 7755 rebalancer_tool.cc:1212] table b6c061acc30c4e5aa6bee1f054e3a59a: no follower replicas available on c9d2944272bc447dafce7620ac2dbd4b, falling back to leader replicas
W20260807 13:53:36.395869 7755 rebalancer_tool.cc:1212] table 2ff801ea568346e096cc895a279c109c: no follower replicas available on edf940ebcc1140cfa0c23214e0c0f179, falling back to leader replicas
W20260807 13:53:36.395978 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 2ff801ea568346e096cc895a279c109c: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:36.396128 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 2ff801ea568346e096cc895a279c109c: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:36.396304 7755 rebalancer_tool.cc:1212] table 96e83925faa542ffa4808b01a5adbbb3: no follower replicas available on edf940ebcc1140cfa0c23214e0c0f179, falling back to leader replicas
W20260807 13:53:36.396425 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 96e83925faa542ffa4808b01a5adbbb3: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:36.396538 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 96e83925faa542ffa4808b01a5adbbb3: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:36.396705 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 35d13981f3a742dd9369d1e7bf18498c: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:36.396831 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 91303cf8b9064e06b8c4165942b287f2: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:36.396962 7755 rebalancer_tool.cc:1212] table e242e42da20d4458a49a269a9569307a: no follower replicas available on edf940ebcc1140cfa0c23214e0c0f179, falling back to leader replicas
W20260807 13:53:36.397164 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 6008038c907645199b055dacb5772621: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:36.402812 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b6c061acc30c4e5aa6bee1f054e3a59a: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:36.403069 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 96e83925faa542ffa4808b01a5adbbb3: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:36.403236 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 6008038c907645199b055dacb5772621: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:36.403414 7755 rebalancer_tool.cc:1212] table 2ff801ea568346e096cc895a279c109c: no follower replicas available on c9d2944272bc447dafce7620ac2dbd4b, falling back to leader replicas
W20260807 13:53:36.403532 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 2ff801ea568346e096cc895a279c109c: could not find any suitable replica to move from server c9d2944272bc447dafce7620ac2dbd4b to server 8a9903f009ff46b4a6875490823076c4
I20260807 13:53:36.837571 7755 rebalancer_tool.cc:1090] tablet 242a68df09cb4c7d9522a33d259ebf78: 'c9d2944272bc447dafce7620ac2dbd4b' -> '31d7630573c8475a9f84978d4ebfb879' move scheduled
I20260807 13:53:37.185958 7755 rebalancer_tool.cc:1090] tablet e22d4edb78d24783bae07928b6c95fc2: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move scheduled
I20260807 13:53:37.776816 7755 rebalancer_tool.cc:1090] tablet 81cbb42cd4954383976169ec16ef2416: 'c9d2944272bc447dafce7620ac2dbd4b' -> '12ab71778f2f4b378765aaed1a0676a5' move scheduled
I20260807 13:53:37.889883 7755 rebalancer_tool.cc:1100] tablet e93615e4fb61416d8740ce61970610af: '01adf83af3e04875b5fac9470d4da915' -> '8a9903f009ff46b4a6875490823076c4' move ignored: Illegal state: tablet e93615e4fb61416d8740ce61970610af: replica 8a9903f009ff46b4a6875490823076c4 is already present
I20260807 13:53:37.890152 7755 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260807 13:53:39.629808 7755 rebalancer_tool.cc:1212] table 91303cf8b9064e06b8c4165942b287f2: no follower replicas available on fa83b7af134b4e3b949ac3b4e4bcb5e7, falling back to leader replicas
W20260807 13:53:39.630370 7755 rebalancer_tool.cc:1212] table b6c061acc30c4e5aa6bee1f054e3a59a: no follower replicas available on c9d2944272bc447dafce7620ac2dbd4b, falling back to leader replicas
W20260807 13:53:39.630590 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 91303cf8b9064e06b8c4165942b287f2: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:39.630915 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 6008038c907645199b055dacb5772621: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 12ab71778f2f4b378765aaed1a0676a5
W20260807 13:53:39.631080 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 96e83925faa542ffa4808b01a5adbbb3: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:39.631248 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 96e83925faa542ffa4808b01a5adbbb3: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:39.631361 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 6008038c907645199b055dacb5772621: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:39.631502 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 35d13981f3a742dd9369d1e7bf18498c: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server b77f2b2eade540c6bfd4f75e5229a3cd
W20260807 13:53:39.631640 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b6c061acc30c4e5aa6bee1f054e3a59a: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 12ab71778f2f4b378765aaed1a0676a5
I20260807 13:53:39.751067 7755 rebalancer_tool.cc:1090] tablet e93615e4fb61416d8740ce61970610af: '01adf83af3e04875b5fac9470d4da915' -> '' move scheduled
I20260807 13:53:40.284322 7755 rebalancer_tool.cc:1090] tablet 739f4f0207104455bf3e87bc04f8d13c: 'edf940ebcc1140cfa0c23214e0c0f179' -> '12ab71778f2f4b378765aaed1a0676a5' move scheduled
I20260807 13:53:40.418051 7755 rebalancer_tool.cc:1100] tablet 16afb6ff06704a8795f1de84ffa81de0: 'c9d2944272bc447dafce7620ac2dbd4b' -> '8a9903f009ff46b4a6875490823076c4' move ignored: Illegal state: tablet 16afb6ff06704a8795f1de84ffa81de0: replica 8a9903f009ff46b4a6875490823076c4 is already present
I20260807 13:53:40.418278 7755 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260807 13:53:42.321391 7755 rebalancer_tool.cc:1212] table b6c061acc30c4e5aa6bee1f054e3a59a: no follower replicas available on c9d2944272bc447dafce7620ac2dbd4b, falling back to leader replicas
W20260807 13:53:42.321805 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 96e83925faa542ffa4808b01a5adbbb3: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:42.322132 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 91303cf8b9064e06b8c4165942b287f2: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:42.322366 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 96e83925faa542ffa4808b01a5adbbb3: could not find any suitable replica to move from server edf940ebcc1140cfa0c23214e0c0f179 to server 8a9903f009ff46b4a6875490823076c4
W20260807 13:53:42.322490 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 14867b014aab43119171102f60bb134d: could not find any suitable replica to move from server fa83b7af134b4e3b949ac3b4e4bcb5e7 to server 31d7630573c8475a9f84978d4ebfb879
W20260807 13:53:42.322629 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table b6c061acc30c4e5aa6bee1f054e3a59a: could not find any suitable replica to move from server 01adf83af3e04875b5fac9470d4da915 to server b77f2b2eade540c6bfd4f75e5229a3cd
I20260807 13:53:42.394119 7755 rebalancer_tool.cc:1090] tablet 541201ddfdf041ed87b3d0e731763a37: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move scheduled
I20260807 13:53:42.559361 7755 rebalancer_tool.cc:1090] tablet 0c1327c8461e44f2ac5d77f10c390eeb: '01adf83af3e04875b5fac9470d4da915' -> '' move scheduled
I20260807 13:53:42.725455 7755 rebalancer_tool.cc:1090] tablet 966ebd287fc14e498e5bd3e6542194ca: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move scheduled
W20260807 13:53:43.868769 10959 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.GetTableSchema -> {remote=127.23.107.190:41317, user_credentials={real_user=slave}} blocked reactor thread for 51859.4us
I20260807 13:53:47.333379 7755 rebalancer_tool.cc:1152] tablet 782ac4fa94fb4183940fca514cc068b0: 'edf940ebcc1140cfa0c23214e0c0f179' -> '12ab71778f2f4b378765aaed1a0676a5' move completed: OK
W20260807 13:53:59.358029 13778 sasl_common.cc:323] Time spent creating new SASL kudu client: real 0.297s user 0.000s sys 0.000s
I20260807 13:54:00.721705 7755 rebalancer_tool.cc:1152] tablet 312c7ed04e334b08b506c8908224a7da: '01adf83af3e04875b5fac9470d4da915' -> 'b77f2b2eade540c6bfd4f75e5229a3cd' move completed: OK
I20260807 13:54:01.073695 7755 rebalancer_tool.cc:1152] tablet 0c1327c8461e44f2ac5d77f10c390eeb: '01adf83af3e04875b5fac9470d4da915' -> '' move completed: OK
I20260807 13:54:01.261899 7755 rebalancer_tool.cc:1152] tablet e22d4edb78d24783bae07928b6c95fc2: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move completed: OK
I20260807 13:54:01.642416 7755 rebalancer_tool.cc:1090] tablet d02aa7a26c024b4083421b5d742f7bcb: '01adf83af3e04875b5fac9470d4da915' -> '' move scheduled
I20260807 13:54:01.759339 7755 rebalancer_tool.cc:1090] tablet 80898a5a2cf046f1b7344dfceb175bbd: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:54:01.870936 7755 rebalancer_tool.cc:1152] tablet d02aa7a26c024b4083421b5d742f7bcb: '01adf83af3e04875b5fac9470d4da915' -> '' move completed: OK
I20260807 13:54:01.951185 7755 rebalancer_tool.cc:1152] tablet 80898a5a2cf046f1b7344dfceb175bbd: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
I20260807 13:54:02.047467 7755 rebalancer_tool.cc:1152] tablet e93615e4fb61416d8740ce61970610af: '01adf83af3e04875b5fac9470d4da915' -> '' move completed: OK
I20260807 13:54:02.087015 7755 rebalancer_tool.cc:1152] tablet 739f4f0207104455bf3e87bc04f8d13c: 'edf940ebcc1140cfa0c23214e0c0f179' -> '12ab71778f2f4b378765aaed1a0676a5' move completed: OK
I20260807 13:54:04.846573 7755 rebalancer_tool.cc:1152] tablet 242a68df09cb4c7d9522a33d259ebf78: 'c9d2944272bc447dafce7620ac2dbd4b' -> '31d7630573c8475a9f84978d4ebfb879' move completed: OK
I20260807 13:54:04.918025 7755 rebalancer_tool.cc:1152] tablet 966ebd287fc14e498e5bd3e6542194ca: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move completed: OK
I20260807 13:54:04.999154 7755 rebalancer_tool.cc:1152] tablet 541201ddfdf041ed87b3d0e731763a37: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move completed: OK
I20260807 13:54:05.108283 7755 rebalancer_tool.cc:1152] tablet 81cbb42cd4954383976169ec16ef2416: 'c9d2944272bc447dafce7620ac2dbd4b' -> '12ab71778f2f4b378765aaed1a0676a5' move completed: OK
I20260807 13:54:05.186218 7755 rebalancer_tool.cc:1090] tablet 68717842b14e4f06b528c08a65acd3b7: '01adf83af3e04875b5fac9470d4da915' -> '' move scheduled
I20260807 13:54:05.326442 7755 rebalancer_tool.cc:1090] tablet d06f352d0ff34b45b753a2c20f65574f: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move scheduled
I20260807 13:54:05.549031 7755 rebalancer_tool.cc:1090] tablet 069a5f0089b24a609b27d4a07a3c4353: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:54:05.736745 7755 rebalancer_tool.cc:1090] tablet b414c896ad884facb339e5e4a0329065: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move scheduled
I20260807 13:54:05.907608 7755 rebalancer_tool.cc:1090] tablet c10b910e9f354933b60ae70f1baa9b6f: '01adf83af3e04875b5fac9470d4da915' -> '' move scheduled
I20260807 13:54:05.996775 7755 rebalancer_tool.cc:1152] tablet c10b910e9f354933b60ae70f1baa9b6f: '01adf83af3e04875b5fac9470d4da915' -> '' move completed: OK
I20260807 13:54:06.129055 7755 rebalancer_tool.cc:1152] tablet b414c896ad884facb339e5e4a0329065: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move completed: OK
I20260807 13:54:13.455447 7755 rebalancer_tool.cc:1152] tablet 68717842b14e4f06b528c08a65acd3b7: '01adf83af3e04875b5fac9470d4da915' -> '' move completed: OK
I20260807 13:54:13.663829 7755 rebalancer_tool.cc:1152] tablet ffa98a163d7540e3a911a39334657138: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '8a9903f009ff46b4a6875490823076c4' move completed: OK
I20260807 13:54:13.823206 7755 rebalancer_tool.cc:1090] tablet 50a090faa58e4f91961c9251030efacf: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move scheduled
I20260807 13:54:13.853591 7755 rebalancer_tool.cc:1090] tablet a29bfc37eabb411f845203c281444086: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move scheduled
I20260807 13:54:13.942757 7755 rebalancer_tool.cc:1090] tablet d27ce55f2acc4513a9fd90a338098eeb: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:54:14.025019 7755 rebalancer_tool.cc:1152] tablet a29bfc37eabb411f845203c281444086: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move completed: OK
I20260807 13:54:14.135124 7755 rebalancer_tool.cc:1152] tablet 50a090faa58e4f91961c9251030efacf: 'fa83b7af134b4e3b949ac3b4e4bcb5e7' -> '' move completed: OK
I20260807 13:54:14.265122 7755 rebalancer_tool.cc:1152] tablet d27ce55f2acc4513a9fd90a338098eeb: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
I20260807 13:54:14.440136 7755 rebalancer_tool.cc:1152] tablet 069a5f0089b24a609b27d4a07a3c4353: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
I20260807 13:54:14.574779 7755 rebalancer_tool.cc:1152] tablet d06f352d0ff34b45b753a2c20f65574f: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move completed: OK
I20260807 13:54:14.748966 7755 rebalancer_tool.cc:1090] tablet 16afb6ff06704a8795f1de84ffa81de0: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:54:14.905571 7755 rebalancer_tool.cc:1090] tablet bdac11c33b2b486eb34bc93def74489c: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move scheduled
I20260807 13:54:14.986213 7755 rebalancer_tool.cc:1090] tablet eab259b597a64c04869543ccb1d9038c: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:54:15.420998 7755 rebalancer_tool.cc:1090] tablet 1715828a5d96455abecae985d1dca004: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:54:15.516422 7755 rebalancer_tool.cc:1152] tablet 1715828a5d96455abecae985d1dca004: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
I20260807 13:54:17.896420 7755 rebalancer_tool.cc:1152] tablet bdac11c33b2b486eb34bc93def74489c: 'edf940ebcc1140cfa0c23214e0c0f179' -> '' move completed: OK
I20260807 13:54:20.285297 7755 rebalancer_tool.cc:1152] tablet eab259b597a64c04869543ccb1d9038c: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
I20260807 13:54:22.674084 7755 rebalancer_tool.cc:1152] tablet 16afb6ff06704a8795f1de84ffa81de0: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move completed: OK
W20260807 13:54:24.723896 7755 rebalancer_tool.cc:1212] table 91303cf8b9064e06b8c4165942b287f2: no follower replicas available on 12ab71778f2f4b378765aaed1a0676a5, falling back to leader replicas
W20260807 13:54:24.724059 7755 rebalancer_tool.cc:1230] No replica could be moved this iteration: Not found: table 91303cf8b9064e06b8c4165942b287f2: could not find any suitable replica to move from server 12ab71778f2f4b378765aaed1a0676a5 to server c9d2944272bc447dafce7620ac2dbd4b
I20260807 13:54:25.000452 7755 rebalancer_tool.cc:1090] tablet faef317e47a244c6965864f82f21edfa: '31d7630573c8475a9f84978d4ebfb879' -> '' move scheduled
I20260807 13:54:25.280746 7755 rebalancer_tool.cc:1100] tablet e22d4edb78d24783bae07928b6c95fc2: '01adf83af3e04875b5fac9470d4da915' -> 'c9d2944272bc447dafce7620ac2dbd4b' move ignored: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } }.
Pending config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "01adf83af3e04875b5fac9470d4da915" member_type: VOTER last_known_addr { host: "127.23.107.131" port: 40441 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "c9d2944272bc447dafce7620ac2dbd4b" member_type: VOTER last_known_addr { host: "127.23.107.130" port: 37489 } }
I20260807 13:54:25.280880 7755 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260807 13:54:27.193960 7755 rebalancer_tool.cc:1212] table b6c061acc30c4e5aa6bee1f054e3a59a: no follower replicas available on 12ab71778f2f4b378765aaed1a0676a5, falling back to leader replicas
I20260807 13:54:28.187244 7755 rebalancer_tool.cc:1090] tablet 242a68df09cb4c7d9522a33d259ebf78: '01adf83af3e04875b5fac9470d4da915' -> '12ab71778f2f4b378765aaed1a0676a5' move scheduled
I20260807 13:54:28.372534 7755 rebalancer_tool.cc:1090] tablet 96bc42d66fa04fb69afa630969dbb579: '8a9903f009ff46b4a6875490823076c4' -> '' move scheduled
I20260807 13:54:28.802768 7755 rebalancer_tool.cc:1090] tablet b414c896ad884facb339e5e4a0329065: '12ab71778f2f4b378765aaed1a0676a5' -> 'fa83b7af134b4e3b949ac3b4e4bcb5e7' move scheduled
I20260807 13:54:28.940752 7755 rebalancer_tool.cc:1100] tablet 04dac80fea124c25b34af8cc290c0d7f: '12ab71778f2f4b378765aaed1a0676a5' -> 'edf940ebcc1140cfa0c23214e0c0f179' move ignored: Illegal state: tablet 04dac80fea124c25b34af8cc290c0d7f: replica edf940ebcc1140cfa0c23214e0c0f179 is already present
I20260807 13:54:28.940927 7755 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260807 13:54:30.948328 7755 rebalancer_tool.cc:1212] table b6c061acc30c4e5aa6bee1f054e3a59a: no follower replicas available on 12ab71778f2f4b378765aaed1a0676a5, falling back to leader replicas
I20260807 13:54:31.445608 7755 rebalancer_tool.cc:1090] tablet 069a5f0089b24a609b27d4a07a3c4353: '12ab71778f2f4b378765aaed1a0676a5' -> 'c9d2944272bc447dafce7620ac2dbd4b' move scheduled
I20260807 13:54:31.554296 7755 rebalancer_tool.cc:1090] tablet 04dac80fea124c25b34af8cc290c0d7f: '12ab71778f2f4b378765aaed1a0676a5' -> '' move scheduled
I20260807 13:54:31.677763 7755 rebalancer_tool.cc:1090] tablet 43f5461808a646c885d593f782538930: '12ab71778f2f4b378765aaed1a0676a5' -> '' move scheduled
I20260807 13:54:41.676802 7755 rebalancer_tool.cc:1139] tablet 96bc42d66fa04fb69afa630969dbb579: '8a9903f009ff46b4a6875490823076c4' -> '' move is abandoned: Not found: Server with UUID 8a9903f009ff46b4a6875490823076c4 not a member of the config. RaftConfig: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "edf940ebcc1140cfa0c23214e0c0f179" member_type: VOTER last_known_addr { host: "127.23.107.132" port: 41217 } } peers { permanent_uuid: "31d7630573c8475a9f84978d4ebfb879" member_type: VOTER last_known_addr { host: "127.23.107.136" port: 43729 } } peers { permanent_uuid: "12ab71778f2f4b378765aaed1a0676a5" member_type: VOTER last_known_addr { host: "127.23.107.134" port: 35975 } }
I20260807 13:54:49.830164 7755 rebalancer_tool.cc:1152] tablet faef317e47a244c6965864f82f21edfa: '31d7630573c8475a9f84978d4ebfb879' -> '' move completed: OK
I20260807 13:54:49.954833 7755 rebalancer_tool.cc:1152] tablet 04dac80fea124c25b34af8cc290c0d7f: '12ab71778f2f4b378765aaed1a0676a5' -> '' move completed: OK
I20260807 13:54:50.098217 7755 rebalancer_tool.cc:1152] tablet b414c896ad884facb339e5e4a0329065: '12ab71778f2f4b378765aaed1a0676a5' -> 'fa83b7af134b4e3b949ac3b4e4bcb5e7' move completed: OK
I20260807 13:54:50.290206 7755 rebalancer_tool.cc:1152] tablet 43f5461808a646c885d593f782538930: '12ab71778f2f4b378765aaed1a0676a5' -> '' move completed: OK
I20260807 13:54:53.062879 7755 rebalancer_tool.cc:1152] tablet 242a68df09cb4c7d9522a33d259ebf78: '01adf83af3e04875b5fac9470d4da915' -> '12ab71778f2f4b378765aaed1a0676a5' move completed: OK
I20260807 13:54:53.255606 7755 rebalancer_tool.cc:1152] tablet 069a5f0089b24a609b27d4a07a3c4353: '12ab71778f2f4b378765aaed1a0676a5' -> 'c9d2944272bc447dafce7620ac2dbd4b' move completed: OK
I20260807 13:54:55.580966 7755 rebalancer_tool.cc:1100] tablet 68717842b14e4f06b528c08a65acd3b7: 'c9d2944272bc447dafce7620ac2dbd4b' -> '12ab71778f2f4b378765aaed1a0676a5' move ignored: Illegal state: tablet 68717842b14e4f06b528c08a65acd3b7: replica 12ab71778f2f4b378765aaed1a0676a5 is already present
I20260807 13:54:55.581208 7755 rebalancer_tool.cc:772] re-synchronizing cluster state
W20260807 13:54:57.014506 7755 rebalancer_tool.cc:1212] table b6c061acc30c4e5aa6bee1f054e3a59a: no follower replicas available on c9d2944272bc447dafce7620ac2dbd4b, falling back to leader replicas
I20260807 13:54:57.161079 7755 rebalancer_tool.cc:1090] tablet 312c7ed04e334b08b506c8908224a7da: 'c9d2944272bc447dafce7620ac2dbd4b' -> '' move scheduled
I20260807 13:54:57.693315 7755 rebalancer_tool.cc:1090] tablet 541201ddfdf041ed87b3d0e731763a37: 'edf940ebcc1140cfa0c23214e0c0f179' -> '01adf83af3e04875b5fac9470d4da915' move scheduled
I20260807 13:54:58.488363 7755 rebal
E20260807 13:55:34.152511 23982 external_mini_cluster.cc:968] Process with UUID fa83b7af134b4e3b949ac3b4e4bcb5e7 has crashed
E20260807 13:55:34.152654 23982 external_mini_cluster.cc:968] Process with UUID c9d2944272bc447dafce7620ac2dbd4b has crashed
E20260807 13:55:34.152729 23982 external_mini_cluster.cc:968] Process with UUID 01adf83af3e04875b5fac9470d4da915 has crashed
E20260807 13:55:34.152799 23982 external_mini_cluster.cc:968] Process with UUID edf940ebcc1140cfa0c23214e0c0f179 has crashed
E20260807 13:55:34.152876 23982 external_mini_cluster.cc:968] Process with UUID b77f2b2eade540c6bfd4f75e5229a3cd has crashed
E20260807 13:55:34.152942 23982 external_mini_cluster.cc:968] Process with UUID 12ab71778f2f4b378765aaed1a0676a5 has crashed
E20260807 13:55:34.153007 23982 external_mini_cluster.cc:968] Process with UUID 8a9903f009ff46b4a6875490823076c4 has crashed
E20260807 13:55:34.153071 23982 external_mini_cluster.cc:968] Process with UUID 31d7630573c8475a9f84978d4ebfb879 has crashed
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/mini-cluster/external_mini_cluster.cc:972: Failure
Expected equality of these values:
0
num_crashes
Which is: 8
At least one process crashed
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tools/rebalancer_tool-test.cc:1282: Failure
Expected: cluster_->AssertNoCrashes() doesn't generate new fatal failures in the current thread.
Actual: it does.
I20260807 13:55:34.155179 23982 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task2KnpY3/build/asan/bin/kudu pid 4483
I20260807 13:55:34.169203 4559 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 13:55:34.498703 23982 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2KnpY3/build/asan/bin/kudu with pid 4483
2026-08-07T13:55:34Z chronyd exiting
I20260807 13:55:34.584950 23982 test_util.cc:182] -----------------------------------------------
I20260807 13:55:34.585073 23982 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.ConcurrentRebalancersTest.TwoConcurrentRebalancers_0.1786110610279261-23982-0
[ FAILED ] ConcurrentRebalancersTest.TwoConcurrentRebalancers/0, where GetParam() = 4-byte object <00-00 00-00> (153524 ms)
[----------] 1 test from ConcurrentRebalancersTest (153524 ms total)
[----------] 1 test from RebalancerAndSingleReplicaTablets
[ RUN ] RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove/0
I20260807 13:55:34.589895 23982 ts_itest-base.cc:115] Starting cluster with:
I20260807 13:55:34.589974 23982 ts_itest-base.cc:116] --------------
I20260807 13:55:34.590014 23982 ts_itest-base.cc:117] 4 tablet servers
I20260807 13:55:34.590055 23982 ts_itest-base.cc:118] 1 replicas per TS
I20260807 13:55:34.590102 23982 ts_itest-base.cc:119] --------------
2026-08-07T13:55:34Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-07T13:55:34Z Disabled control of system clock
I20260807 13:55:34.670318 23982 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2KnpY3/build/asan/bin/kudu
/tmp/dist-test-task2KnpY3/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.107.190:45869
--webserver_interface=127.23.107.190
--webserver_port=0
--builtin_ntp_servers=127.23.107.148:39211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.107.190:45869
--raft_prepare_replacement_before_eviction=false
--tserver_unresponsive_timeout_ms=3000
--enable_range_replica_placement=false with env {}
W20260807 13:55:35.051246 31725 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 13:55:35.051538 31725 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 13:55:35.051682 31725 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260807 13:55:35.063678 31725 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260807 13:55:35.063846 31725 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 13:55:35.063967 31725 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260807 13:55:35.064052 31725 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 13:55:35.064167 31725 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260807 13:55:35.079820 31725 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.107.148:39211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal
--enable_range_replica_placement=false
--ipki_ca_key_size=768
--master_addresses=127.23.107.190:45869
--tserver_unresponsive_timeout_ms=3000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.107.190:45869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.23.107.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision cb747ff0ca0209e3fa98be4167c67edd474acd67
build type FASTDEBUG
built by None at 07 Aug 2026 13:43:26 UTC on bdcb31816ec0
build id 13226
ASAN enabled
I20260807 13:55:35.082319 31725 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:55:35.084860 31725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 13:55:35.100852 31732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:55:35.100935 31731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:55:35.101979 31735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:55:35.103201 31725 server_base.cc:1061] running on GCE node
I20260807 13:55:35.104408 31725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 13:55:35.106565 31725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 13:55:35.107839 31725 hybrid_clock.cc:648] HybridClock initialized: now 1786110935107719 us; error 67 us; skew 500 ppm
I20260807 13:55:35.108354 31725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:55:35.111353 31725 webserver.cc:533] Webserver started at http://127.23.107.190:42763/ using document root <none> and password file <none>
I20260807 13:55:35.112460 31725 fs_manager.cc:362] Metadata directory not provided
I20260807 13:55:35.112625 31725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:55:35.113101 31725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:55:35.116992 31725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "c13ebb157f1b4e5081fbd6f93c820be0"
format_stamp: "Formatted at 2026-08-07 13:55:35 on dist-test-slave-bw88"
I20260807 13:55:35.118211 31725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "c13ebb157f1b4e5081fbd6f93c820be0"
format_stamp: "Formatted at 2026-08-07 13:55:35 on dist-test-slave-bw88"
W20260807 13:55:35.128123 31725 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/data (495079424 bytes available vs 518351011 bytes reserved) (error 28)
I20260807 13:55:35.128355 31725 fs_manager.cc:696] Time spent creating directory manager: real 0.010s user 0.006s sys 0.001s
I20260807 13:55:35.133657 31742 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:55:35.135711 31725 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260807 13:55:35.135921 31725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal
uuid: "c13ebb157f1b4e5081fbd6f93c820be0"
format_stamp: "Formatted at 2026-08-07 13:55:35 on dist-test-slave-bw88"
I20260807 13:55:35.136204 31725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:55:35.167421 31725 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 13:55:35.168334 31725 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:55:35.168606 31725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:55:35.191035 31725 rpc_server.cc:307] RPC server started. Bound to: 127.23.107.190:45869
I20260807 13:55:35.191054 31812 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.107.190:45869 every 8 connection(s)
I20260807 13:55:35.192775 31725 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260807 13:55:35.194191 23982 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2KnpY3/build/asan/bin/kudu as pid 31725
I20260807 13:55:35.194420 23982 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/wal/instance
W20260807 13:55:35.198537 31814 dir_manager.cc:275] Insufficient disk space under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-task2KnpY3/test-tmp/rebalancer_tool-test.3.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_0.1786110610279261-23982-0/raft_consensus-itest-cluster/master-0/data/data (495071232 bytes available vs 518351011 bytes reserved) (error 28)
E20260807 13:55:35.198853 31814 master.cc:417] Unable to init master catalog manager: IO error: Unable to initialize catalog manager: Failed to initialize sys tables async: Failed to create TabletMetadata: All healthy data directories are full (error 28)
I20260807 13:55:35.199079 31725 master.cc:562] Master@127.23.107.190:45869 shutting down...
W20260807 13:55:35.212873 31746 connection.cc:466] server connection from 127.0.0.1:46848 torn down before Call kudu.master.MasterService.ConnectToMaster from 127.0.0.1:46848 (request call id 0) could send its response
I20260807 13:55:35.225414 31725 master.cc:584] Master@127.23.107.190:45869 shutdown complete.
W20260807 13:55:35.227528 31725 builtin_ntp.cc:688] coult not shutdown socket: Network error: shutdown error: Transport endpoint is not connected (error 107)
IO error: Unable to initialize catalog manager: Failed to initialize sys tables async: Failed to create TabletMetadata: All healthy data directories are full (error 28)
F20260807 13:55:40.205615 23982 external_mini_cluster.cc:656] Check failed: leader_master() != nullptr Must have started at least 1 master before adding tablet servers
*** Check failure stack trace: ***
*** Aborted at 1786110940 (unix time) try "date -d @1786110940" if you are using GNU date ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800005dae) received by PID 23982 (TID 0x7f1b20e5bd40) from PID 23982; stack trace: ***
@ 0x7f1b2c0f1980 (unknown) at ??:0
@ 0x7f1b21915e87 gsignal at ??:0
@ 0x7f1b219177f1 abort at ??:0
@ 0x7f1b240cad5d google::LogMessage::Fail() at ??:0
@ 0x7f1b240ceb23 google::LogMessage::SendToLog() at ??:0
@ 0x7f1b240ca75c google::LogMessage::Flush() at ??:0
@ 0x7f1b240cbee9 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f1b3b0252a6 kudu::cluster::ExternalMiniCluster::AddTabletServer() at ??:0
@ 0x7f1b3b01e86f kudu::cluster::ExternalMiniCluster::Start() at ??:0
@ 0x7f1b3ba24f62 kudu::tserver::TabletServerIntegrationTestBase::CreateCluster() at ??:0
@ 0x7f1b3ba2f1d7 kudu::tserver::TabletServerIntegrationTestBase::BuildAndStart() at ??:0
@ 0x613b4f kudu::tools::RebalancerAndSingleReplicaTablets_SingleReplicasStayOrMove_Test::TestBody() at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tools/rebalancer_tool-test.cc:1645
@ 0x7f1b3a2380ed testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
@ 0x7f1b3a22cbdb testing::Test::Run() at ??:0
@ 0x7f1b3a22cd9d testing::TestInfo::Run() at ??:0
@ 0x7f1b3a22d377 testing::TestSuite::Run() at ??:0
@ 0x7f1b3a22d77c testing::internal::UnitTestImpl::RunAllTests() at ??:0
@ 0x7f1b3a23860d testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
@ 0x7f1b3a22ce63 testing::UnitTest::Run() at ??:0
@ 0x702e52 RUN_ALL_TESTS() at /home/jenkins-slave/workspace/build_and_test_flaky@2/thirdparty/installed/uninstrumented/include/gtest/gtest.h:2293
@ 0x700d29 main at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/test_main.cc:115
@ 0x7f1b218f8c87 __libc_start_main at ??:0
@ 0x50fa6a _start at ??:?